Aug 02 10:31:16.094783 ip-10-0-130-84 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 02 10:31:16.094798 ip-10-0-130-84 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 02 10:31:16.094808 ip-10-0-130-84 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 02 10:31:16.095209 ip-10-0-130-84 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 02 10:31:26.191354 ip-10-0-130-84 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 02 10:31:26.191370 ip-10-0-130-84 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3a8de60fe8c149df9cf3f4085afdf3e1 --
Aug 02 10:33:24.223514 ip-10-0-130-84 systemd[1]: Starting Kubernetes Kubelet...
Aug 02 10:33:24.598479 ip-10-0-130-84 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 02 10:33:24.598479 ip-10-0-130-84 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 02 10:33:24.598479 ip-10-0-130-84 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 02 10:33:24.598479 ip-10-0-130-84 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 02 10:33:24.598479 ip-10-0-130-84 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 02 10:33:24.600203 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.600116    2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 02 10:33:24.603238 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603223    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 02 10:33:24.603238 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603239    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603242    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603245    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603248    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603251    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603254    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603256    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603271    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603274    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603277    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603279    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603282    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603285    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603288    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603291    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603293    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603296    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603299    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603307    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603310    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 02 10:33:24.603322 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603313    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603316    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603319    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603322    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603325    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603330    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603333    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603336    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603339    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603342    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603344    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603347    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603349    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603352    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603354    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603357    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603359    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603362    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603364    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603367    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 02 10:33:24.603828 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603369    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603372    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603374    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603377    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603380    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603382    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603384    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603387    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603389    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603391    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603394    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603396    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603398    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603401    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603404    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603407    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603410    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603412    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603414    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603417    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 02 10:33:24.604354 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603419    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603422    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603424    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603427    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603430    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603432    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603435    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603437    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603439    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603442    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603444    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603447    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603449    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603451    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603454    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603456    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603459    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603462    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603464    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603466    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 02 10:33:24.604877 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603469    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603471    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603474    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603476    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603478    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603483    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603488    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603492    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603495    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603498    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603500    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603503    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603506    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603509    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603512    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603514    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603517    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.603520    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604971    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 02 10:33:24.605439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604981    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604986    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604989    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604992    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604994    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.604997    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605000    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605004    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605007    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605010    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605014    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605017    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605019    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605022    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605024    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605027    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605030    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605032    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605035    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 02 10:33:24.605926 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605038    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605041    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605043    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605046    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605049    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605052    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605054    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605056    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605059    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605062    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605064    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605067    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605069    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605072    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605074    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605077    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605079    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605081    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605084    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 02 10:33:24.606460 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605087    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605090    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605093    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605096    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605098    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605101    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605104    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605106    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605109    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605111    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605113    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605116    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605118    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605121    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605124    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605127    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605129    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605132    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605134    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605137    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605139    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 02 10:33:24.606958 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605141    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605144    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605146    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605150    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605153    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605156    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605159    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605162    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605164    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605168    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605170    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605172    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605175    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605177    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605180    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605182    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605184    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605188    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605191    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 02 10:33:24.607523 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605193    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605196    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605198    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605201    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605205    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605208    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605211    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605213    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605216    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605218    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605220    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605223    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605226    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605228    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605230    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605233    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605236    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605238    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605241    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605244    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 02 10:33:24.608007 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605672    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605679    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605683    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605686    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605689    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605691    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605694    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605696    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605699    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605701    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605704    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605707    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605710    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605712    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605714    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605717    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605720    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605724    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605726    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605729    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 02 10:33:24.608546 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605731    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605734    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605736    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605739    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605741    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605743    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605746    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605750    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605753    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605755    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605758    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605760    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605763    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605765    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605768    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605770    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605773    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605775    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605777    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 02 10:33:24.609062 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605780    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605782    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605785    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605787    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605790    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605793    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605795    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605797    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605800    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605803    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605806    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605809    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605812    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605814    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605816    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605819    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605821    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605824    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605826    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605829    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 02 10:33:24.609568 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605833    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605836    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605839    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605842    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605845    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605847    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605850    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605852    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605855    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605857    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605860    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605863    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605865    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605867    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605870    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605872    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605875    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605877    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605880    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605883    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 02 10:33:24.610084 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605885    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605889    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605891    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605894    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605897    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605899    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605902    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605904    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605906    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605909    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605912    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605914    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605916    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605919    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605921    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605924    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605926    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605929    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605931    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.605934    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606000    2563 flags.go:64] FLAG: --address="0.0.0.0"
Aug 02 10:33:24.610675 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606007    2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606014    2563 flags.go:64] FLAG: --anonymous-auth="true"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606018    2563 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606022    2563 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606025    2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606029    2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606033    2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606036    2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606039    2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606043    2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606046    2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606049    2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606052    2563 flags.go:64] FLAG: --cgroup-root=""
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606055    2563 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606058    2563 flags.go:64] FLAG: --client-ca-file=""
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606061    2563 flags.go:64] FLAG: --cloud-provider="external"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606064    2563 flags.go:64] FLAG: --cluster-dns="[]"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606068    2563 flags.go:64] FLAG: --cluster-domain=""
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606070    2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606073    2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606076    2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606079    2563 flags.go:64] FLAG: --container-log-max-files="5"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606083    2563 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 02 10:33:24.611342 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606086    2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606089    2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606092    2563 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606095    2563 flags.go:64] FLAG: --contention-profiling="false"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606098    2563 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606101    2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606107    2563 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606109    2563 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606113    2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606116    2563 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606119    2563 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606122    2563 flags.go:64] FLAG: --enable-load-reader="false"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606124    2563 flags.go:64] FLAG: --enable-server="true"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606139    2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606145    2563 flags.go:64] FLAG: --event-burst="100"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606148    2563 flags.go:64] FLAG: --event-qps="50"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606152    2563 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606155    2563 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606157    2563 flags.go:64] FLAG: --eviction-hard=""
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606162    2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606164    2563 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606169    2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606172    2563 flags.go:64] FLAG: --eviction-soft=""
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606175    2563 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606178    2563 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 02 10:33:24.611928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606181    2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606183    2563 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606186    2563 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606189    2563 flags.go:64] FLAG: --fail-swap-on="true"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606191    2563 flags.go:64] FLAG: --feature-gates=""
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606195    2563 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606198    2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606201    2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606204    2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606207    2563 flags.go:64] FLAG: --healthz-port="10248"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606210    2563 flags.go:64] FLAG: --help="false"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606213    2563 flags.go:64] FLAG: --hostname-override="ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606216    2563 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606220    2563 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606222    2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606225    2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606229    2563 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606232    2563 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606234    2563 flags.go:64] FLAG: --image-service-endpoint=""
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606237    2563 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606240    2563 flags.go:64] FLAG: --kube-api-burst="100"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606242    2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606246    2563 flags.go:64] FLAG: --kube-api-qps="50"
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606248    2563 flags.go:64] FLAG: --kube-reserved=""
Aug 02 10:33:24.612717 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606251    2563 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606254    2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606257    2563 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606276    2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606281    2563 flags.go:64] FLAG: --lock-file=""
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606284    2563 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606287    2563 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606290    2563 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606295    2563 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606298    2563 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606301    2563 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606304    2563 flags.go:64] FLAG: --logging-format="text"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606307    2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606310    2563 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606313    2563 flags.go:64] FLAG: --manifest-url=""
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606316    2563 flags.go:64] FLAG: --manifest-url-header=""
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606320    2563 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606323    2563 flags.go:64] FLAG: --max-open-files="1000000"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606327    2563 flags.go:64] FLAG: --max-pods="110"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606330    2563 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606333    2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606337    2563 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606340    2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606342    2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606345    2563 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 02 10:33:24.613795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606348    2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606355    2563 flags.go:64] FLAG: --node-status-max-images="50"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606358    2563 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606361    2563 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606364    2563 flags.go:64] FLAG: --pod-cidr=""
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606367    2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606373    2563 flags.go:64] FLAG: --pod-manifest-path=""
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606375    2563 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606378    2563 flags.go:64] FLAG: --pods-per-core="0"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606381    2563 flags.go:64] FLAG: --port="10250"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606384    2563 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606387    2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b924f3835faf9b72"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606391    2563 flags.go:64] FLAG: --qos-reserved=""
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606394    2563 flags.go:64] FLAG: --read-only-port="10255"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606397    2563 flags.go:64] FLAG: --register-node="true"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606400    2563 flags.go:64] FLAG: --register-with-taints=""
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606404    2563 flags.go:64] FLAG: --registry-burst="10"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606407    2563 flags.go:64] FLAG: --registry-qps="5"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606409    2563 flags.go:64] FLAG: --reserved-cpus=""
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606412    2563 flags.go:64] FLAG: --reserved-memory=""
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606416    2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606419    2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606429    2563 flags.go:64] FLAG: --rotate-certificates="false"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606433    2563 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606435    2563 flags.go:64] FLAG: --runonce="false"
Aug 02 10:33:24.614906 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606438    2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606441    2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606444    2563 flags.go:64] FLAG: --seccomp-default="false"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606449    2563 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606451    2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606454    2563 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606457    2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606460    2563 flags.go:64] FLAG: --storage-driver-password="root"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606463    2563 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606466    2563 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606469    2563 flags.go:64] FLAG: --storage-driver-user="root"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606472    2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606475    2563 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606478    2563 flags.go:64] FLAG: --system-cgroups=""
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606480    2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606486    2563 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606488    2563 flags.go:64] FLAG: --tls-cert-file=""
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606491    2563 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606495    2563 flags.go:64] FLAG: --tls-min-version=""
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606499    2563 flags.go:64] FLAG: --tls-private-key-file=""
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606503    2563 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606506    2563 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606508    2563 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606511    2563 flags.go:64] FLAG: --v="2"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606515    2563 flags.go:64] FLAG: --version="false"
Aug 02 10:33:24.616143 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606519    2563 flags.go:64] FLAG: --vmodule=""
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606522    2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.606526    2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606636    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606640    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606643    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606646    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606648    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606651    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606654    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606658    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606661    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606663    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606666    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606670    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606673    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606676    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606679    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 02 10:33:24.617072 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606683    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606686    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606689    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606691    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606694    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606697    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606699    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606702    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606706    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606709    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606712    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606714    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606717    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606719    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606722    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606724    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606727    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606729    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606732    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606734    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 02 10:33:24.617619 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606736    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606739    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606741    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606744    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606749    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606751    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606754    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606756    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606759    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606761    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606763    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606766    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606768    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606771    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606773    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606775    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606778    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606780    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606783    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606785    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 02 10:33:24.618548 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606789    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606792    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606795    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606797    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606800    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606802    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606805    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606807    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606810    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606812    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606814    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606817    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606820    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606822    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606824    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606827    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606830    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606833    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606835    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606838    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 02 10:33:24.619228 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606840    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606843    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606845    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606847    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606850    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606852    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606855    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606857    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606860    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606863    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606865    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606868    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606871    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606874    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606876    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606879    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606882    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606884    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606887    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606889    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 02 10:33:24.619912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606892    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606894    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606897    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.606901    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.607416    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.614853    2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.614874    2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.614901    2563 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.614912    2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.614998    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615007    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615012    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615017    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615022    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 02 10:33:24.620565 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615026    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615030    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615035    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615039    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615044    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615048    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615052    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615056    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615060    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615065    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615069    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615074    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615078    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615086    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615093    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615098    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615103    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615108    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615115    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 02 10:33:24.620948 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615121    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615125    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615130    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615135    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615139    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615144    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615150    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615154    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615158    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615163    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615167    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615173    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615178    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615183    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615187    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615191    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615196    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615200    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615204    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615208    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 02 10:33:24.621477 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615213    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615217    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615221    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615225    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615231    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615235    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615240    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615244    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615249    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615253    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615257    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615281    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615286    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615290    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615294    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615298    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615303    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615309    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615313    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615317    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 02 10:33:24.622010 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615322    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615326    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615330    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615334    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615339    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615343    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615347    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615351    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615356    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615360    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615364    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615368    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615372    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615376    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615380    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615384    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615388    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615393    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615397    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 02 10:33:24.622563 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615402    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615407    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615411    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615415    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615419    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615423    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615427    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615431    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615435    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615440    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615445    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615449    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615454    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615458    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615462    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 02 10:33:24.623053 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615467    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.615475    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615667    2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615676    2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615681    2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615685    2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615689    2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615694    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615698    2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615703    2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615707    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615711    2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615715    2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615720    2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615724    2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 02 10:33:24.623475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615728    2563 feature_gate.go:328] unrecognized feature gate: Example2
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615732    2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615737    2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615741    2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615746    2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615751    2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615755    2563 feature_gate.go:328] unrecognized feature gate: Example
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615759    2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615763    2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615767    2563 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615772    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615776    2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615780    2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615785    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615788    2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615792    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615797    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615801    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615806    2563 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615810    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 02 10:33:24.623871 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615814    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615818    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615823    2563 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615827    2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615831    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615835    2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615839    2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615843    2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615848    2563 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615852    2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615858    2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615864    2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615868    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615873    2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615878    2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615882    2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615888    2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615895    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615900    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 02 10:33:24.624591 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615905    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615910    2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615914    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615919    2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615923    2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615927    2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615932    2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615937    2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615941    2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615945    2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615950    2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615956    2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615961    2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615965    2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615970    2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615975    2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615979    2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615984    2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615989    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 02 10:33:24.625396 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615994    2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.615998    2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616003    2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616007    2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616011    2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616015    2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616020    2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616024    2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616028    2563 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616032    2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616036    2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616040    2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616045    2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616050    2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616054    2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616058    2563 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616062    2563 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616066    2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616071    2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616075    2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 02 10:33:24.625984 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616080    2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616084    2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616088    2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616092    2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616096    2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616100    2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616104    2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:24.616108    2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.616117    2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.616283    2563 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.619402    2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.621327    2563 server.go:1019] "Starting client certificate rotation"
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.621427    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 02 10:33:24.626590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.621461    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 02 10:33:24.626970 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.624490    2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 02 10:33:24.628983 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.628966    2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 02 10:33:24.636802 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.636779    2563 log.go:25] "Validated CRI v1 runtime API"
Aug 02 10:33:24.638903 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.638888    2563 log.go:25] "Validated CRI v1 image API"
Aug 02 10:33:24.639760 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.639736    2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 02 10:33:24.642103 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.642085    2563 fs.go:135] Filesystem UUIDs: map[058fb588-6523-4837-a64a-c86bab416be6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aa1156e4-20ce-4c98-a1a9-a31f9e76acbb:/dev/nvme0n1p4]
Aug 02 10:33:24.642161 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.642105    2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 02 10:33:24.647127 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.647010    2563 manager.go:216] Machine: {Timestamp:2026-08-02 10:33:24.64577461 +0000 UTC m=+0.303992210 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101165 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287a63a5b037e9b06b14c354b39b01 SystemUUID:ec287a63-a5b0-37e9-b06b-14c354b39b01 BootID:3a8de60f-e8c1-49df-9cf3-f4085afdf3e1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fe:67:f6:7f:0f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fe:67:f6:7f:0f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:60:83:e8:8c:72 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 02 10:33:24.647127 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.647125    2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 02 10:33:24.647226 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.647208    2563 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 02 10:33:24.649584 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.649560    2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 02 10:33:24.649723 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.649588    2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-84.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 02 10:33:24.650271 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.650249    2563 topology_manager.go:138] "Creating topology manager with none policy"
Aug 02 10:33:24.650305 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.650279    2563 container_manager_linux.go:309] "Creating device plugin manager"
Aug 02 10:33:24.650305 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.650288    2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 02 10:33:24.650813 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.650803    2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 02 10:33:24.651428 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.651418    2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 02 10:33:24.652082 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.652068    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 02 10:33:24.654174 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654162    2563 state_mem.go:36] "Initialized new in-memory state store"
Aug 02 10:33:24.654306 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654296    2563 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 02 10:33:24.654347 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654325    2563 kubelet.go:486] "Attempting to sync node with API server"
Aug 02 10:33:24.654347 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654335    2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 02 10:33:24.654433 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654348    2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 02 10:33:24.654433 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654357    2563 kubelet.go:398] "Adding apiserver pod source"
Aug 02 10:33:24.654433 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654365    2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 02 10:33:24.654754 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654739    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 02 10:33:24.654796 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.654770    2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 02 10:33:24.656726 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.656709    2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 02 10:33:24.658238 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.658223    2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 02 10:33:24.658335 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.658253    2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 02 10:33:24.659499 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659488    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 02 10:33:24.659535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659503    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 02 10:33:24.659535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659510    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 02 10:33:24.659535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659515    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 02 10:33:24.659535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659525    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 02 10:33:24.659535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659531    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 02 10:33:24.659676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659539    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 02 10:33:24.659676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659544    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 02 10:33:24.659676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659550    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 02 10:33:24.659676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659556    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 02 10:33:24.659676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659571    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 02 10:33:24.659676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.659577    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 02 10:33:24.660319 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.660308    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 02 10:33:24.660319 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.660319    2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 02 10:33:24.663761 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.663747    2563 server.go:1268] "Started kubelet"
Aug 02 10:33:24.664292 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.664015    2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 02 10:33:24.664292 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.664101    2563 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 02 10:33:24.664718 ip-10-0-130-84 systemd[1]: Started Kubernetes Kubelet.
Aug 02 10:33:24.667805 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.667722    2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 02 10:33:24.668549 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.668529    2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 02 10:33:24.670547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.670527    2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-84.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 02 10:33:24.670777 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.670747    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 02 10:33:24.670912 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.670875    2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 02 10:33:24.671015 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.670988    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 02 10:33:24.672107 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.672092    2563 server.go:310] "Adding debug handlers to kubelet server"
Aug 02 10:33:24.673772 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.673755    2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 02 10:33:24.673872 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.673775    2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 02 10:33:24.673872 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.673849    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:24.674300 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674281    2563 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 02 10:33:24.674300 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674292    2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 02 10:33:24.674300 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674303    2563 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 02 10:33:24.674481 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674429    2563 reconstruct.go:97] "Volume reconstruction finished"
Aug 02 10:33:24.674481 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674438    2563 reconciler.go:29] "Reconciler: start to sync state"
Aug 02 10:33:24.674608 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674591    2563 factory.go:55] Registering systemd factory
Aug 02 10:33:24.674715 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674634    2563 factory.go:223] Registration of the systemd container factory successfully
Aug 02 10:33:24.674873 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674851    2563 factory.go:153] Registering CRI-O factory
Aug 02 10:33:24.674873 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674868    2563 factory.go:223] Registration of the crio container factory successfully
Aug 02 10:33:24.675014 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674918    2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 02 10:33:24.675014 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674937    2563 factory.go:103] Registering Raw factory
Aug 02 10:33:24.675014 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.674951    2563 manager.go:1196] Started watching for new ooms in manager
Aug 02 10:33:24.675556 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.675540    2563 manager.go:349] Starting recovery of all containers
Aug 02 10:33:24.678391 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.678373    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6cbf4"
Aug 02 10:33:24.681993 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.681967    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 02 10:33:24.682100 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.682061    2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-84.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 02 10:33:24.683300 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.681998    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-84.ec2.internal.18c7f67f7b301656  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-84.ec2.internal,UID:ip-10-0-130-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-84.ec2.internal,},FirstTimestamp:2026-08-02 10:33:24.66371951 +0000 UTC m=+0.321937091,LastTimestamp:2026-08-02 10:33:24.66371951 +0000 UTC m=+0.321937091,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-84.ec2.internal,}"
Aug 02 10:33:24.686212 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.686032    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-6cbf4"
Aug 02 10:33:24.688386 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.688371    2563 manager.go:354] Recovery completed
Aug 02 10:33:24.693542 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.693525    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.695907 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.695890    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.695970 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.695930    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.695970 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.695943    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.696455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.696443    2563 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 02 10:33:24.696455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.696454    2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 02 10:33:24.696559 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.696471    2563 state_mem.go:36] "Initialized new in-memory state store"
Aug 02 10:33:24.696559 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.696499    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.697513 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.697500    2563 policy_none.go:49] "None policy: Start"
Aug 02 10:33:24.697557 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.697519    2563 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 02 10:33:24.697557 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.697530    2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 02 10:33:24.697612 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.697573    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.697612 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.697594    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.697612 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.697603    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.698252 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.698181    2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-84.ec2.internal.18c7f67f7d1b5b09  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-84.ec2.internal,UID:ip-10-0-130-84.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-84.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-84.ec2.internal,},FirstTimestamp:2026-08-02 10:33:24.695915273 +0000 UTC m=+0.354132853,LastTimestamp:2026-08-02 10:33:24.695915273 +0000 UTC m=+0.354132853,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-84.ec2.internal,}"
Aug 02 10:33:24.698583 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.698571    2563 policy_none.go:47] "Start"
Aug 02 10:33:24.742890 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.742868    2563 manager.go:337] "Starting Device Plugin manager"
Aug 02 10:33:24.742974 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.742903    2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 02 10:33:24.742974 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.742913    2563 server.go:87] "Starting device plugin registration server"
Aug 02 10:33:24.743206 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.743187    2563 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 02 10:33:24.743315 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.743205    2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 02 10:33:24.743389 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.743376    2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 02 10:33:24.743478 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.743462    2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 02 10:33:24.743478 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.743480    2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 02 10:33:24.744036 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.744007    2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 02 10:33:24.744122 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.744062    2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:24.838636 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.838594    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 02 10:33:24.839976 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.839963    2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 02 10:33:24.840038 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.840000    2563 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 02 10:33:24.840038 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.840023    2563 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 02 10:33:24.840222 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.840059    2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 02 10:33:24.842505 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.842486    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 02 10:33:24.843976 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.843955    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.844749 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.844731    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.844840 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.844764    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.844840 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.844779    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.844840 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.844815    2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.852664 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.852621    2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.852664 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.852645    2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-84.ec2.internal\": node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:24.870201 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.870172    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:24.940777 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.940740    2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"]
Aug 02 10:33:24.940922 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.940819    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.941864 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.941848    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.941949 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.941879    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.941949 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.941893    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.943330 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.943318    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.943498 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.943485    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.943539 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.943509    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.944180 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.944164    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.944294 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.944182    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.944294 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.944197    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.944294 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.944206    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.944294 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.944211    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.944294 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.944218    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.945295 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.945281    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.945356 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.945318    2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 02 10:33:24.945986 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.945970    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientMemory"
Aug 02 10:33:24.946063 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.946003    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasNoDiskPressure"
Aug 02 10:33:24.946063 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.946019    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeHasSufficientPID"
Aug 02 10:33:24.970798 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.970778    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:24.972908 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.972892    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-84.ec2.internal\" not found" node="ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.974996 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.974977    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9d0c7f0a63bbbc66ae978aad8b1a935-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal\" (UID: \"e9d0c7f0a63bbbc66ae978aad8b1a935\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.975074 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.975007    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9d0c7f0a63bbbc66ae978aad8b1a935-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal\" (UID: \"e9d0c7f0a63bbbc66ae978aad8b1a935\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.975074 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:24.975032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/261365b1a79fe86655ad402ba8ac7bb7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-84.ec2.internal\" (UID: \"261365b1a79fe86655ad402ba8ac7bb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:24.977441 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:24.977425    2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-84.ec2.internal\" not found" node="ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.071381 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.071349    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.075643 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.075621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9d0c7f0a63bbbc66ae978aad8b1a935-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal\" (UID: \"e9d0c7f0a63bbbc66ae978aad8b1a935\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.075736 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.075657    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/261365b1a79fe86655ad402ba8ac7bb7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-84.ec2.internal\" (UID: \"261365b1a79fe86655ad402ba8ac7bb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.075736 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.075686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9d0c7f0a63bbbc66ae978aad8b1a935-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal\" (UID: \"e9d0c7f0a63bbbc66ae978aad8b1a935\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.075736 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.075721    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e9d0c7f0a63bbbc66ae978aad8b1a935-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal\" (UID: \"e9d0c7f0a63bbbc66ae978aad8b1a935\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.075845 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.075743    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e9d0c7f0a63bbbc66ae978aad8b1a935-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal\" (UID: \"e9d0c7f0a63bbbc66ae978aad8b1a935\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.075845 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.075753    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/261365b1a79fe86655ad402ba8ac7bb7-config\") pod \"kube-apiserver-proxy-ip-10-0-130-84.ec2.internal\" (UID: \"261365b1a79fe86655ad402ba8ac7bb7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.172126 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.172049    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.272608 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.272575    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.274767 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.274749    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.279502 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.279489    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:25.372886 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.372843    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.473464 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.473386    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.573880 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.573847    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.621135 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.621106    2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 02 10:33:25.621664 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.621238    2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 02 10:33:25.621664 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.621246    2563 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.130.84:36650->100.59.70.1:6443: use of closed network connection"
Aug 02 10:33:25.621664 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.621336    2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.130.84:36650->100.59.70.1:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 02 10:33:25.674334 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.674302    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.690390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.690354    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-01 10:28:24 +0000 UTC" deadline="2028-01-28 09:10:02.757545333 +0000 UTC"
Aug 02 10:33:25.690390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.690380    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13054h36m37.067167678s"
Aug 02 10:33:25.694305 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.694287    2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 02 10:33:25.774794 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.774751    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.837808 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:25.837772    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d0c7f0a63bbbc66ae978aad8b1a935.slice/crio-f12f528467eaefff72299864cce93f821fb25e665c3539422fb4c9d9d729eb19 WatchSource:0}: Error finding container f12f528467eaefff72299864cce93f821fb25e665c3539422fb4c9d9d729eb19: Status 404 returned error can't find the container with id f12f528467eaefff72299864cce93f821fb25e665c3539422fb4c9d9d729eb19
Aug 02 10:33:25.838303 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:25.838281    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod261365b1a79fe86655ad402ba8ac7bb7.slice/crio-a270cd25ef408fe820a2626ce752bf9c6ce2c9ddf746fd3fa630a0aac0c44bc7 WatchSource:0}: Error finding container a270cd25ef408fe820a2626ce752bf9c6ce2c9ddf746fd3fa630a0aac0c44bc7: Status 404 returned error can't find the container with id a270cd25ef408fe820a2626ce752bf9c6ce2c9ddf746fd3fa630a0aac0c44bc7
Aug 02 10:33:25.842635 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.842613    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 02 10:33:25.842902 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.842863    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal" event={"ID":"261365b1a79fe86655ad402ba8ac7bb7","Type":"ContainerStarted","Data":"a270cd25ef408fe820a2626ce752bf9c6ce2c9ddf746fd3fa630a0aac0c44bc7"}
Aug 02 10:33:25.844112 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:25.844090    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal" event={"ID":"e9d0c7f0a63bbbc66ae978aad8b1a935","Type":"ContainerStarted","Data":"f12f528467eaefff72299864cce93f821fb25e665c3539422fb4c9d9d729eb19"}
Aug 02 10:33:25.875396 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.875360    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:25.980283 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:25.980223    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:26.081334 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.081226    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:26.181820 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.181732    2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-84.ec2.internal\" not found"
Aug 02 10:33:26.265405 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.265371    2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 02 10:33:26.274938 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.274909    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:26.284651 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.284624    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 02 10:33:26.286420 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.286397    2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal"
Aug 02 10:33:26.297008 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.296981    2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 02 10:33:26.642198 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.642159    2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 02 10:33:26.655888 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.655857    2563 apiserver.go:52] "Watching apiserver"
Aug 02 10:33:26.665086 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.665058    2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 02 10:33:26.666871 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.666837    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal","openshift-multus/multus-ddbjw","openshift-multus/network-metrics-daemon-4sp8v","openshift-network-diagnostics/network-check-target-xtrpt","openshift-ovn-kubernetes/ovnkube-node-9xd4k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8","openshift-cluster-node-tuning-operator/tuned-wppb2","openshift-dns/node-resolver-jnpd5","openshift-image-registry/node-ca-7p68s","openshift-multus/multus-additional-cni-plugins-8b865","openshift-network-operator/iptables-alerter-j9rc4","kube-system/global-pull-secret-syncer-rgvjh","kube-system/konnectivity-agent-58tmx","kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal"]
Aug 02 10:33:26.668420 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.668400    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.669718 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.669694    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.670762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.670743    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.670868 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.670767    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.670868 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.670838    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tpp5r\""
Aug 02 10:33:26.671886 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.671859    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 02 10:33:26.671977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.671890    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4vhpp\""
Aug 02 10:33:26.672110 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.672092    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 02 10:33:26.672289 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.672219    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:26.672367 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.672290    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:26.673606 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.673452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:26.673606 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.673506    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:26.674611 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.674594    2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 02 10:33:26.675277 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.675250    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.675999 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.675977    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.677149 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677129    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8dx9b\""
Aug 02 10:33:26.677247 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677185    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 02 10:33:26.677247 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677210    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.677427 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677362    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 02 10:33:26.677673 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677654    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 02 10:33:26.677749 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677742    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.677920 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677901    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 02 10:33:26.677989 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.677975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.678145 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.678125    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.678420 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.678370    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 02 10:33:26.678579 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.678562    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-v7dmb\""
Aug 02 10:33:26.678751 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.678735    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.679427 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.679394    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.679562 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.679538    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 02 10:33:26.679666 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.679625    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.679936 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.679914    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.680021 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.679957    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5c7vk\""
Aug 02 10:33:26.682278 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.681151    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.682278 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.681547    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-z5jzw\""
Aug 02 10:33:26.682278 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.681714    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.682278 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.681975    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.682867 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.682827    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.682978 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.682959    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 02 10:33:26.683125 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.683111    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l4wzk\""
Aug 02 10:33:26.683176 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.683148    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 02 10:33:26.683382 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.683361    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.683564 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.683545    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.684196 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85284a4-96e0-4bc3-b1db-0f59837d3852-agent-certs\") pod \"konnectivity-agent-58tmx\" (UID: \"f85284a4-96e0-4bc3-b1db-0f59837d3852\") " pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.684262 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684222    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-systemd\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684262 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684246    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-sys\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684262 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684256    2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 02 10:33:26.684446 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684269    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:26.684446 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684296    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684446 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684321    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-env-overrides\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684446 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovn-node-metrics-cert\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684446 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684415    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nspgv\" (UniqueName: \"kubernetes.io/projected/45443fa7-72d8-4171-ae44-65bb57b8d25f-kube-api-access-nspgv\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684446 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684441    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovnkube-script-lib\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysconfig\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684492    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-lib-modules\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684536    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85284a4-96e0-4bc3-b1db-0f59837d3852-konnectivity-ca\") pod \"konnectivity-agent-58tmx\" (UID: \"f85284a4-96e0-4bc3-b1db-0f59837d3852\") " pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684576    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qnmmd\" (UniqueName: \"kubernetes.io/projected/71c56056-eabe-4083-aad0-4e25e7b8a0f4-kube-api-access-qnmmd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdjf\" (UniqueName: \"kubernetes.io/projected/e6b44d3c-bb78-4e23-be01-089572c40bbc-kube-api-access-dtdjf\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684639    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-systemd-units\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684661    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-run\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684682    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-etc-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684705    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-cni-bin\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684728    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-host\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.684743 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684736    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684768    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-tuned\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45443fa7-72d8-4171-ae44-65bb57b8d25f-tmp\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684815    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-systemd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684863    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-node-log\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovnkube-config\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684918    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-log-socket\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684943    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-run-netns\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.684965    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysctl-conf\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685431    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-var-lib-kubelet\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685552    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-ovn\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685579    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-cni-netd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685602    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685654    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-kubelet\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-var-lib-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685693    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685709    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-slash\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685738    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-modprobe-d\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685764    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-kubernetes\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.685901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685788    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysctl-d\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.686629 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.685916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bzd2\""
Aug 02 10:33:26.687067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.687037    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 02 10:33:26.687851 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.687278    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 02 10:33:26.687851 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.687362    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.687851 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.687428    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:26.687851 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.687518    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 02 10:33:26.688369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.688173    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cvv5t\""
Aug 02 10:33:26.706797 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.706774    2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-k8wm4"
Aug 02 10:33:26.716671 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.715476    2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-k8wm4"
Aug 02 10:33:26.775923 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.775896    2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 02 10:33:26.785978 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.785936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/17c36f37-e3e4-4221-892e-f365d1f2bc1d-serviceca\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.786105 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.785979    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-kubelet\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786105 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786009    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-slash\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786105 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786051    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-kubelet\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786105    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-os-release\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786112    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-slash\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85284a4-96e0-4bc3-b1db-0f59837d3852-agent-certs\") pod \"konnectivity-agent-58tmx\" (UID: \"f85284a4-96e0-4bc3-b1db-0f59837d3852\") " pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovnkube-script-lib\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786203    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-os-release\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786224    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-conf-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.786263 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nspgv\" (UniqueName: \"kubernetes.io/projected/45443fa7-72d8-4171-ae44-65bb57b8d25f-kube-api-access-nspgv\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786310    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-system-cni-dir\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786338    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-cni-bin\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786360    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysconfig\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786380    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-lib-modules\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85284a4-96e0-4bc3-b1db-0f59837d3852-konnectivity-ca\") pod \"konnectivity-agent-58tmx\" (UID: \"f85284a4-96e0-4bc3-b1db-0f59837d3852\") " pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsqxg\" (UniqueName: \"kubernetes.io/projected/ffd95625-32c8-44ef-8350-17d55a05a1a0-kube-api-access-vsqxg\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cnibin\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786477    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cni-binary-copy\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786501    2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786503    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-etc-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786538    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-kubelet-config\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786555    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-host\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786577    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-tuned\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786594    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45443fa7-72d8-4171-ae44-65bb57b8d25f-tmp\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786621    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-systemd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.786653 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-node-log\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786668    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovnkube-config\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8147fcc7-615f-4279-b5c4-102489a5f974-hosts-file\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786729    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786759    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-system-cni-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786784    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b618398-f69b-4390-b783-0ded6970b188-iptables-alerter-script\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786807    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-dbus\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786830    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-etc-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786837    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovnkube-script-lib\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.786833    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9tsb\" (UniqueName: \"kubernetes.io/projected/17c36f37-e3e4-4221-892e-f365d1f2bc1d-kube-api-access-r9tsb\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787001    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-lib-modules\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787073    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysconfig\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787132    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysctl-conf\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-cni-netd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787219    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787247    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-cnibin\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.787547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787272    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-k8s-cni-cncf-io\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787379    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovn-node-metrics-cert\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787406    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qnmmd\" (UniqueName: \"kubernetes.io/projected/71c56056-eabe-4083-aad0-4e25e7b8a0f4-kube-api-access-qnmmd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787434    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6snqg\" (UniqueName: \"kubernetes.io/projected/8147fcc7-615f-4279-b5c4-102489a5f974-kube-api-access-6snqg\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787465    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787527    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-var-lib-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787554    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-modprobe-d\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-kubernetes\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysctl-d\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f85284a4-96e0-4bc3-b1db-0f59837d3852-konnectivity-ca\") pod \"konnectivity-agent-58tmx\" (UID: \"f85284a4-96e0-4bc3-b1db-0f59837d3852\") " pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-socket-dir-parent\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787657    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-multus-certs\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787683    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-device-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787711    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787736    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-cni-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.788774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787763    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a192f09-2c4b-4d78-9074-31dacee6aa5b-cni-binary-copy\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787792    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787823    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-kubelet\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787854    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdjf\" (UniqueName: \"kubernetes.io/projected/e6b44d3c-bb78-4e23-be01-089572c40bbc-kube-api-access-dtdjf\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787886    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-systemd-units\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787912    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-run\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787943    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-cni-bin\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787992    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-systemd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.787994    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-cni-bin\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788089    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysctl-conf\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-cni-netd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-sysctl-d\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788530    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-kubernetes\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788571    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-var-lib-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788604    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-socket-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-modprobe-d\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.789788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788685    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8147fcc7-615f-4279-b5c4-102489a5f974-tmp-dir\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788692    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-host\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788716    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxvs4\" (UniqueName: \"kubernetes.io/projected/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-kube-api-access-cxvs4\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788739    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-systemd-units\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788746    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-netns\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788769    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovnkube-config\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788777    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788795    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-run-ovn-kubernetes\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788809    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-openvswitch\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.788874    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788911    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-registration-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-node-log\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-cni-multus\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb94j\" (UniqueName: \"kubernetes.io/projected/5a192f09-2c4b-4d78-9074-31dacee6aa5b-kube-api-access-rb94j\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.788981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-run\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jlzk\" (UniqueName: \"kubernetes.io/projected/0b618398-f69b-4390-b783-0ded6970b188-kube-api-access-8jlzk\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.789067    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:33:27.289028945 +0000 UTC m=+2.947246533 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:26.794435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789127    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-log-socket\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789167    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-sys-fs\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789194    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789207    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-log-socket\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-daemon-config\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789274    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-run-netns\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789324    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-var-lib-kubelet\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789352    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-ovn\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789369    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-host-run-netns\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17c36f37-e3e4-4221-892e-f365d1f2bc1d-host\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71c56056-eabe-4083-aad0-4e25e7b8a0f4-run-ovn\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789422    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-hostroot\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789436    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-var-lib-kubelet\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789460    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-etc-kubernetes\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789487    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b618398-f69b-4390-b783-0ded6970b188-host-slash\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789512    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-systemd\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.795413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789537    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-sys\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789564    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-env-overrides\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-systemd\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.789701    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/45443fa7-72d8-4171-ae44-65bb57b8d25f-sys\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.790211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71c56056-eabe-4083-aad0-4e25e7b8a0f4-env-overrides\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.790377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/45443fa7-72d8-4171-ae44-65bb57b8d25f-etc-tuned\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.790672    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f85284a4-96e0-4bc3-b1db-0f59837d3852-agent-certs\") pod \"konnectivity-agent-58tmx\" (UID: \"f85284a4-96e0-4bc3-b1db-0f59837d3852\") " pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.790891    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45443fa7-72d8-4171-ae44-65bb57b8d25f-tmp\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.791641    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71c56056-eabe-4083-aad0-4e25e7b8a0f4-ovn-node-metrics-cert\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.792836    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.792858    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.792872    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.792937    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:27.292920431 +0000 UTC m=+2.951138015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.795219    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nspgv\" (UniqueName: \"kubernetes.io/projected/45443fa7-72d8-4171-ae44-65bb57b8d25f-kube-api-access-nspgv\") pod \"tuned-wppb2\" (UID: \"45443fa7-72d8-4171-ae44-65bb57b8d25f\") " pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.796368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.795642    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdjf\" (UniqueName: \"kubernetes.io/projected/e6b44d3c-bb78-4e23-be01-089572c40bbc-kube-api-access-dtdjf\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:26.799564 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.799542    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qnmmd\" (UniqueName: \"kubernetes.io/projected/71c56056-eabe-4083-aad0-4e25e7b8a0f4-kube-api-access-qnmmd\") pod \"ovnkube-node-9xd4k\" (UID: \"71c56056-eabe-4083-aad0-4e25e7b8a0f4\") " pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:26.890515 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-netns\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.890515 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890519    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-registration-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890545    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-cni-multus\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890563    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb94j\" (UniqueName: \"kubernetes.io/projected/5a192f09-2c4b-4d78-9074-31dacee6aa5b-kube-api-access-rb94j\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890580    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jlzk\" (UniqueName: \"kubernetes.io/projected/0b618398-f69b-4390-b783-0ded6970b188-kube-api-access-8jlzk\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890606    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-sys-fs\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890628    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-netns\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890639    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-cni-multus\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890643    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-registration-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.890768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890766    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890812    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-sys-fs\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-daemon-config\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890852    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890885    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17c36f37-e3e4-4221-892e-f365d1f2bc1d-host\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890910    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-hostroot\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890933    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-etc-kubernetes\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890958    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b618398-f69b-4390-b783-0ded6970b188-host-slash\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.890964    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.890984    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/17c36f37-e3e4-4221-892e-f365d1f2bc1d-serviceca\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891012    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-os-release\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:26.891026    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:33:27.391010391 +0000 UTC m=+3.049227965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891053    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-os-release\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891073    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-conf-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891083    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-os-release\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891104    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-system-cni-dir\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891131    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-cni-bin\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891164    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsqxg\" (UniqueName: \"kubernetes.io/projected/ffd95625-32c8-44ef-8350-17d55a05a1a0-kube-api-access-vsqxg\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891166    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-hostroot\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891201    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-etc-kubernetes\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891232    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cnibin\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891259    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cni-binary-copy\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-kubelet-config\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891374    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-kubelet-config\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-os-release\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891453    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8147fcc7-615f-4279-b5c4-102489a5f974-hosts-file\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891421    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b618398-f69b-4390-b783-0ded6970b188-host-slash\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891478    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891471    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891511    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-system-cni-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.891573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/17c36f37-e3e4-4221-892e-f365d1f2bc1d-host\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cnibin\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891543    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b618398-f69b-4390-b783-0ded6970b188-iptables-alerter-script\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891573    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-dbus\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891573    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-conf-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-system-cni-dir\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9tsb\" (UniqueName: \"kubernetes.io/projected/17c36f37-e3e4-4221-892e-f365d1f2bc1d-kube-api-access-r9tsb\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891675    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891696    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-cnibin\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-k8s-cni-cncf-io\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6snqg\" (UniqueName: \"kubernetes.io/projected/8147fcc7-615f-4279-b5c4-102489a5f974-kube-api-access-6snqg\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891793    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-socket-dir-parent\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-dbus\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891510    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-daemon-config\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891815    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-system-cni-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-multus-certs\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-multus-certs\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891859    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-device-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891890    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891919    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-cni-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891944    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a192f09-2c4b-4d78-9074-31dacee6aa5b-cni-binary-copy\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891956    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/17c36f37-e3e4-4221-892e-f365d1f2bc1d-serviceca\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.891893    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-cni-bin\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892001    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-kubelet\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-socket-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892031    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-device-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892058    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-cni-binary-copy\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892108    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-cni-dir\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-cnibin\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892168    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-run-k8s-cni-cncf-io\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-host-var-lib-kubelet\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8147fcc7-615f-4279-b5c4-102489a5f974-hosts-file\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892325    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5a192f09-2c4b-4d78-9074-31dacee6aa5b-multus-socket-dir-parent\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.892977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892391    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892409    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b618398-f69b-4390-b783-0ded6970b188-iptables-alerter-script\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892422    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892462    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8147fcc7-615f-4279-b5c4-102489a5f974-tmp-dir\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892496    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-etc-selinux\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892509    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxvs4\" (UniqueName: \"kubernetes.io/projected/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-kube-api-access-cxvs4\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ffd95625-32c8-44ef-8350-17d55a05a1a0-socket-dir\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892723    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8147fcc7-615f-4279-b5c4-102489a5f974-tmp-dir\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.893702 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.892824    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5a192f09-2c4b-4d78-9074-31dacee6aa5b-cni-binary-copy\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.902709 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.902674    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb94j\" (UniqueName: \"kubernetes.io/projected/5a192f09-2c4b-4d78-9074-31dacee6aa5b-kube-api-access-rb94j\") pod \"multus-ddbjw\" (UID: \"5a192f09-2c4b-4d78-9074-31dacee6aa5b\") " pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:26.903149 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.903124    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jlzk\" (UniqueName: \"kubernetes.io/projected/0b618398-f69b-4390-b783-0ded6970b188-kube-api-access-8jlzk\") pod \"iptables-alerter-j9rc4\" (UID: \"0b618398-f69b-4390-b783-0ded6970b188\") " pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:26.903268 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.903194    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsqxg\" (UniqueName: \"kubernetes.io/projected/ffd95625-32c8-44ef-8350-17d55a05a1a0-kube-api-access-vsqxg\") pod \"aws-ebs-csi-driver-node-mhdx8\" (UID: \"ffd95625-32c8-44ef-8350-17d55a05a1a0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:26.903268 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.903260    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6snqg\" (UniqueName: \"kubernetes.io/projected/8147fcc7-615f-4279-b5c4-102489a5f974-kube-api-access-6snqg\") pod \"node-resolver-jnpd5\" (UID: \"8147fcc7-615f-4279-b5c4-102489a5f974\") " pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:26.903887 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.903863    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxvs4\" (UniqueName: \"kubernetes.io/projected/9ae08e3f-8fc1-437f-96b0-a914cd707ddf-kube-api-access-cxvs4\") pod \"multus-additional-cni-plugins-8b865\" (UID: \"9ae08e3f-8fc1-437f-96b0-a914cd707ddf\") " pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:26.904221 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.904202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9tsb\" (UniqueName: \"kubernetes.io/projected/17c36f37-e3e4-4221-892e-f365d1f2bc1d-kube-api-access-r9tsb\") pod \"node-ca-7p68s\" (UID: \"17c36f37-e3e4-4221-892e-f365d1f2bc1d\") " pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:26.983474 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.983432    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wppb2"
Aug 02 10:33:26.992672 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:26.992645    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:27.002055 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.002032    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:27.008880 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.008862    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8"
Aug 02 10:33:27.016537 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.016519    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7p68s"
Aug 02 10:33:27.025262 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.025241    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jnpd5"
Aug 02 10:33:27.032842 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.032824    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ddbjw"
Aug 02 10:33:27.047439 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.047418    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8b865"
Aug 02 10:33:27.055095 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.055074    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j9rc4"
Aug 02 10:33:27.295147 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.295060    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:27.295147 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.295107    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:27.295417 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.295261    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:27.295417 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.295287    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:27.295417 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.295329    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:27.295417 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.295339    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:27.295417 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.295362    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:33:28.295341366 +0000 UTC m=+3.953558939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:27.295417 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.295382    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:28.295370403 +0000 UTC m=+3.953587976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:27.343953 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.343779    2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 02 10:33:27.396179 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.396136    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:27.396403 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.396320    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:27.396478 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:27.396413    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:33:28.39639585 +0000 UTC m=+4.054613442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:27.717924 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.717846    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-01 10:28:26 +0000 UTC" deadline="2028-04-21 00:30:36.640002456 +0000 UTC"
Aug 02 10:33:27.717924 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.717876    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15061h57m8.922129503s"
Aug 02 10:33:27.789330 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.789301    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45443fa7_72d8_4171_ae44_65bb57b8d25f.slice/crio-cffd11283e02b8224d58349578cb9890504384e7fa3f62fca64be30b5f1d8d08 WatchSource:0}: Error finding container cffd11283e02b8224d58349578cb9890504384e7fa3f62fca64be30b5f1d8d08: Status 404 returned error can't find the container with id cffd11283e02b8224d58349578cb9890504384e7fa3f62fca64be30b5f1d8d08
Aug 02 10:33:27.790475 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.790434    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b618398_f69b_4390_b783_0ded6970b188.slice/crio-5759bc1ddf6d40d7be4e0072c9cfbda40c6f384a746a96f2e8204ff9166c166b WatchSource:0}: Error finding container 5759bc1ddf6d40d7be4e0072c9cfbda40c6f384a746a96f2e8204ff9166c166b: Status 404 returned error can't find the container with id 5759bc1ddf6d40d7be4e0072c9cfbda40c6f384a746a96f2e8204ff9166c166b
Aug 02 10:33:27.793646 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.793621    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffd95625_32c8_44ef_8350_17d55a05a1a0.slice/crio-a42bb3b7f5fb3bb4f6d30c93748bc1b6898a49b967fb378307e9d4ee4adb404d WatchSource:0}: Error finding container a42bb3b7f5fb3bb4f6d30c93748bc1b6898a49b967fb378307e9d4ee4adb404d: Status 404 returned error can't find the container with id a42bb3b7f5fb3bb4f6d30c93748bc1b6898a49b967fb378307e9d4ee4adb404d
Aug 02 10:33:27.795394 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.795226    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85284a4_96e0_4bc3_b1db_0f59837d3852.slice/crio-39cd6e2fb4ffd7bf3de4173aee12167d0b740f1d5f8c48d01d2c8d105a8fec77 WatchSource:0}: Error finding container 39cd6e2fb4ffd7bf3de4173aee12167d0b740f1d5f8c48d01d2c8d105a8fec77: Status 404 returned error can't find the container with id 39cd6e2fb4ffd7bf3de4173aee12167d0b740f1d5f8c48d01d2c8d105a8fec77
Aug 02 10:33:27.797005 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.796821    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ae08e3f_8fc1_437f_96b0_a914cd707ddf.slice/crio-79e3d791ee0c3d2ee4ddee50bdec762811eac923249c8341c1d546309768dbff WatchSource:0}: Error finding container 79e3d791ee0c3d2ee4ddee50bdec762811eac923249c8341c1d546309768dbff: Status 404 returned error can't find the container with id 79e3d791ee0c3d2ee4ddee50bdec762811eac923249c8341c1d546309768dbff
Aug 02 10:33:27.797785 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.797357    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c36f37_e3e4_4221_892e_f365d1f2bc1d.slice/crio-c275f873ead55adb86b36038b29dd14459197304aaa29d85024bf3c644929945 WatchSource:0}: Error finding container c275f873ead55adb86b36038b29dd14459197304aaa29d85024bf3c644929945: Status 404 returned error can't find the container with id c275f873ead55adb86b36038b29dd14459197304aaa29d85024bf3c644929945
Aug 02 10:33:27.798662 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.798638    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8147fcc7_615f_4279_b5c4_102489a5f974.slice/crio-641716db1c5fe5da506aeef85043d1258442dddca172c7ddf33e23e634aa3819 WatchSource:0}: Error finding container 641716db1c5fe5da506aeef85043d1258442dddca172c7ddf33e23e634aa3819: Status 404 returned error can't find the container with id 641716db1c5fe5da506aeef85043d1258442dddca172c7ddf33e23e634aa3819
Aug 02 10:33:27.801126 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.800331    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c56056_eabe_4083_aad0_4e25e7b8a0f4.slice/crio-c260382a93118eb6f59023c9bf6150b2e9433e4cfe3901521d21fe11b711970e WatchSource:0}: Error finding container c260382a93118eb6f59023c9bf6150b2e9433e4cfe3901521d21fe11b711970e: Status 404 returned error can't find the container with id c260382a93118eb6f59023c9bf6150b2e9433e4cfe3901521d21fe11b711970e
Aug 02 10:33:27.802140 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:33:27.802080    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a192f09_2c4b_4d78_9074_31dacee6aa5b.slice/crio-6433409fbf8933f1721b7a7c7a80ed80e60e788b854a2eb1cc8761536a8cfde5 WatchSource:0}: Error finding container 6433409fbf8933f1721b7a7c7a80ed80e60e788b854a2eb1cc8761536a8cfde5: Status 404 returned error can't find the container with id 6433409fbf8933f1721b7a7c7a80ed80e60e788b854a2eb1cc8761536a8cfde5
Aug 02 10:33:27.852037 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.851801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ddbjw" event={"ID":"5a192f09-2c4b-4d78-9074-31dacee6aa5b","Type":"ContainerStarted","Data":"6433409fbf8933f1721b7a7c7a80ed80e60e788b854a2eb1cc8761536a8cfde5"}
Aug 02 10:33:27.853509 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.853482    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerStarted","Data":"79e3d791ee0c3d2ee4ddee50bdec762811eac923249c8341c1d546309768dbff"}
Aug 02 10:33:27.854774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.854750    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"c260382a93118eb6f59023c9bf6150b2e9433e4cfe3901521d21fe11b711970e"}
Aug 02 10:33:27.856001 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.855971    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7p68s" event={"ID":"17c36f37-e3e4-4221-892e-f365d1f2bc1d","Type":"ContainerStarted","Data":"c275f873ead55adb86b36038b29dd14459197304aaa29d85024bf3c644929945"}
Aug 02 10:33:27.857372 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.857344    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wppb2" event={"ID":"45443fa7-72d8-4171-ae44-65bb57b8d25f","Type":"ContainerStarted","Data":"cffd11283e02b8224d58349578cb9890504384e7fa3f62fca64be30b5f1d8d08"}
Aug 02 10:33:27.858946 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.858924    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jnpd5" event={"ID":"8147fcc7-615f-4279-b5c4-102489a5f974","Type":"ContainerStarted","Data":"641716db1c5fe5da506aeef85043d1258442dddca172c7ddf33e23e634aa3819"}
Aug 02 10:33:27.860204 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.860172    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-58tmx" event={"ID":"f85284a4-96e0-4bc3-b1db-0f59837d3852","Type":"ContainerStarted","Data":"39cd6e2fb4ffd7bf3de4173aee12167d0b740f1d5f8c48d01d2c8d105a8fec77"}
Aug 02 10:33:27.861842 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.861812    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8" event={"ID":"ffd95625-32c8-44ef-8350-17d55a05a1a0","Type":"ContainerStarted","Data":"a42bb3b7f5fb3bb4f6d30c93748bc1b6898a49b967fb378307e9d4ee4adb404d"}
Aug 02 10:33:27.863032 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:27.863009    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9rc4" event={"ID":"0b618398-f69b-4390-b783-0ded6970b188","Type":"ContainerStarted","Data":"5759bc1ddf6d40d7be4e0072c9cfbda40c6f384a746a96f2e8204ff9166c166b"}
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.302430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.302488    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.302689    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.302709    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.302722    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.302783    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:30.302764077 +0000 UTC m=+5.960981650 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.303215    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:28.303376 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.303271    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:33:30.303254106 +0000 UTC m=+5.961471683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:28.403868 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.403710    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:28.404052 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.403914    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:28.404052 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.403987    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:33:30.403958303 +0000 UTC m=+6.062175872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:28.718271 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.718199    2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-01 10:28:26 +0000 UTC" deadline="2028-01-28 19:01:30.170134527 +0000 UTC"
Aug 02 10:33:28.718764 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.718283    2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13064h28m1.451856165s"
Aug 02 10:33:28.841465 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.841430    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:28.841636 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.841589    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:28.841960 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.841435    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:28.842072 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.842049    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:28.843632 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.843477    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:28.843632 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:28.843589    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:28.881019 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.880276    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal" event={"ID":"261365b1a79fe86655ad402ba8ac7bb7","Type":"ContainerStarted","Data":"7d42afc081a6cc54f1c07fd96d3c03557d53d7073e2a6c5105d47239dd7e56aa"}
Aug 02 10:33:28.890774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.890121    2563 generic.go:356] "Generic (PLEG): container finished" podID="e9d0c7f0a63bbbc66ae978aad8b1a935" containerID="8c1cc9a13e75b42931a28029c6be0259ec473e7694501a7cf4e932aacca077b6" exitCode=0
Aug 02 10:33:28.890774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.890168    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal" event={"ID":"e9d0c7f0a63bbbc66ae978aad8b1a935","Type":"ContainerDied","Data":"8c1cc9a13e75b42931a28029c6be0259ec473e7694501a7cf4e932aacca077b6"}
Aug 02 10:33:28.895768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:28.895714    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-84.ec2.internal" podStartSLOduration=2.895692577 podStartE2EDuration="2.895692577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:28.895241027 +0000 UTC m=+4.553458622" watchObservedRunningTime="2026-08-02 10:33:28.895692577 +0000 UTC m=+4.553910174"
Aug 02 10:33:29.904331 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:29.904294    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal" event={"ID":"e9d0c7f0a63bbbc66ae978aad8b1a935","Type":"ContainerStarted","Data":"9d613e27b63f6f67068ce94bf30c9cf11b191ac94e496f36a8f342695733a2b7"}
Aug 02 10:33:30.323439 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:30.323357    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:30.323439 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:30.323407    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:30.323675 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.323569    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:30.323675 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.323590    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:30.323675 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.323602    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:30.323675 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.323661    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:34.323640759 +0000 UTC m=+9.981858350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:30.324077 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.324057    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:30.324164 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.324112    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:33:34.32409752 +0000 UTC m=+9.982315103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:30.424115 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:30.424079    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:30.424300 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.424278    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:30.424373 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.424342    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:33:34.424323782 +0000 UTC m=+10.082541367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:30.844504 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:30.841124    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:30.844504 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.843790    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:30.844504 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:30.844177    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:30.844504 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.844304    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:30.844504 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:30.844349    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:30.844504 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:30.844441    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:32.842290 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:32.841097    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:32.842290 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:32.841248    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:32.842290 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:32.841359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:32.842290 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:32.841434    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:32.842290 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:32.841492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:32.842290 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:32.841589    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:34.362177 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:34.362139    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:34.362191    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.362334    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.362360    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.362375    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.362383    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.362415    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:33:42.36239234 +0000 UTC m=+18.020609915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:34.362654 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.362505    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:42.362446805 +0000 UTC m=+18.020664375 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:34.463589 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:34.463049    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:34.463589 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.463187    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:34.463589 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.463246    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:33:42.46322764 +0000 UTC m=+18.121445229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:34.843867 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:34.843827    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:34.844036 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.843961    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:34.844358 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:34.844329    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:34.844470 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.844442    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:34.844510 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:34.844492    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:34.844583 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:34.844558    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:36.844496 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:36.844456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:36.845025 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:36.844574    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:36.845025 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:36.844589    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:36.845025 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:36.844606    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:36.845025 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:36.844700    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:36.845025 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:36.844760    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:38.840353 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:38.840282    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:38.840353 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:38.840299    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:38.840353 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:38.840288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:38.840870 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:38.840404    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:38.840870 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:38.840468    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:38.840870 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:38.840501    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:40.841443 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:40.840940    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:40.841443 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:40.840951    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:40.841443 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:40.841070    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:40.841443 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:40.841128    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:40.841443 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:40.841211    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:40.841443 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:40.841301    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:42.422919 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:42.422883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:42.422919 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:42.422920    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:42.423546 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.423037    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:42.423546 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.423044    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:42.423546 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.423054    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:42.423546 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.423068    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:42.423546 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.423118    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:58.423104009 +0000 UTC m=+34.081321580 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:42.423546 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.423133    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:33:58.423127372 +0000 UTC m=+34.081344940 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:42.524019 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:42.523987    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:42.524158 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.524099    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:42.524158 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.524146    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:33:58.524134183 +0000 UTC m=+34.182351753 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:42.841081 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:42.840985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:42.841081 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:42.841062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:42.841081 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:42.841083    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:42.841354 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.841184    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:42.841448 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.841406    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:42.841649 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:42.841499    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:44.841570 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:44.841532    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:44.842062 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:44.841643    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:44.842062 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:44.841691    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:44.842062 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:44.841736    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:44.842062 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:44.841788    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:44.842062 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:44.841892    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:46.841794 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.841232    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:46.841794 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.841233    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:46.841794 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:46.841767    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:46.842671 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.841438    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:46.842671 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:46.841886    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:46.842671 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:46.841911    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:46.935247 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.935214    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ddbjw" event={"ID":"5a192f09-2c4b-4d78-9074-31dacee6aa5b","Type":"ContainerStarted","Data":"053ff74a5d35eb469b4aa2861fb5aa5ad35706384d1f876550be0f81cf794c63"}
Aug 02 10:33:46.936962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.936938    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ae08e3f-8fc1-437f-96b0-a914cd707ddf" containerID="f3e05afaaa2e5ad17432db9348a2ebadb5cf1ff5e4e9f41db5d050424d83d22a" exitCode=0
Aug 02 10:33:46.937071 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.937023    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerDied","Data":"f3e05afaaa2e5ad17432db9348a2ebadb5cf1ff5e4e9f41db5d050424d83d22a"}
Aug 02 10:33:46.944951 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.942997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"727035b9deec8e169b2c0a9db6ceddc8b1911a939b5540b7526f1156a8092f04"}
Aug 02 10:33:46.944951 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.943133    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"a5b93afc88457075e76fd674ac21e3e14f83c8440f0208c343b199f6679d3994"}
Aug 02 10:33:46.944951 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.943210    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"26b3716fc87b39465f3304426afbe07edd0530ca1d4747b8f68e9fcd848bb211"}
Aug 02 10:33:46.944951 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.943301    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"a8674dd78b16d94dc63cfeef1dad73e9f3faebd3964e69571f0d4ace7cd511f7"}
Aug 02 10:33:46.945339 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.945304    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7p68s" event={"ID":"17c36f37-e3e4-4221-892e-f365d1f2bc1d","Type":"ContainerStarted","Data":"22ff098eccea94a59209bc6488c3b7a58553e51c538b923c34d4d719fc02118a"}
Aug 02 10:33:46.947132 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.947106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wppb2" event={"ID":"45443fa7-72d8-4171-ae44-65bb57b8d25f","Type":"ContainerStarted","Data":"98419a92259f47390e1d1d6d16d4890993417faebab5cd835d36a66facf0f557"}
Aug 02 10:33:46.948441 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.948416    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jnpd5" event={"ID":"8147fcc7-615f-4279-b5c4-102489a5f974","Type":"ContainerStarted","Data":"084ef7a58912da6d23c29a4f1ca0467cdf927979cd190232dadebb9174b9a7c5"}
Aug 02 10:33:46.949790 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.949761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-58tmx" event={"ID":"f85284a4-96e0-4bc3-b1db-0f59837d3852","Type":"ContainerStarted","Data":"295aaef5b6fe93a7cc2311171720e5d0138b78209d5cee7dff169f988862c1e8"}
Aug 02 10:33:46.950056 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.950017    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-84.ec2.internal" podStartSLOduration=20.950002286 podStartE2EDuration="20.950002286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:29.918010319 +0000 UTC m=+5.576227919" watchObservedRunningTime="2026-08-02 10:33:46.950002286 +0000 UTC m=+22.608219882"
Aug 02 10:33:46.950121 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.950091    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ddbjw" podStartSLOduration=3.216952918 podStartE2EDuration="21.950085981s" totalImagesPullingTime="18.733133063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:46.949488696 +0000 UTC m=+22.607706302" watchObservedRunningTime="2026-08-02 10:33:46.950085981 +0000 UTC m=+22.608303582"
Aug 02 10:33:46.951087 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.951070    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8" event={"ID":"ffd95625-32c8-44ef-8350-17d55a05a1a0","Type":"ContainerStarted","Data":"c29f128ebdbfff2b2e4330d9fbedc25e4a14b957e0df769ff11d7512d73d9171"}
Aug 02 10:33:46.964385 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.964350    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wppb2" podStartSLOduration=3.27775058 podStartE2EDuration="21.96433921s" totalImagesPullingTime="18.68658863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:46.963938362 +0000 UTC m=+22.622155963" watchObservedRunningTime="2026-08-02 10:33:46.96433921 +0000 UTC m=+22.622556799"
Aug 02 10:33:46.976997 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:46.976934    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jnpd5" podStartSLOduration=3.30193789 podStartE2EDuration="21.976922803s" totalImagesPullingTime="18.674984913s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:46.976613094 +0000 UTC m=+22.634830684" watchObservedRunningTime="2026-08-02 10:33:46.976922803 +0000 UTC m=+22.635140393"
Aug 02 10:33:47.012935 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.012898    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7p68s" podStartSLOduration=3.33648525 podStartE2EDuration="22.012885413s" totalImagesPullingTime="18.676400163s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:46.988231436 +0000 UTC m=+22.646449027" watchObservedRunningTime="2026-08-02 10:33:47.012885413 +0000 UTC m=+22.671103003"
Aug 02 10:33:47.029830 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.029794    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-58tmx" podStartSLOduration=11.243101373 podStartE2EDuration="22.029781672s" totalImagesPullingTime="10.786680299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:47.029335847 +0000 UTC m=+22.687553439" watchObservedRunningTime="2026-08-02 10:33:47.029781672 +0000 UTC m=+22.687999261"
Aug 02 10:33:47.070420 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.070291    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:47.154335 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.154295    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:47.961596 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.960660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j9rc4" event={"ID":"0b618398-f69b-4390-b783-0ded6970b188","Type":"ContainerStarted","Data":"b4b826bc0cc190d241cd5cfe0caf5ab4a8d5dba2697167b33f41493696350dd0"}
Aug 02 10:33:47.962602 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.962584    2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 02 10:33:47.964706 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.964683    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"6e5c577823629f922d0838f517974177d44747b83ab777d5f967037df01072f2"}
Aug 02 10:33:47.964824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.964744    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"d5e21e816413eded925c188dcdd6ff93975654a8e27248b411d9f35fe4de8873"}
Aug 02 10:33:47.973962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:47.973924    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j9rc4" podStartSLOduration=4.290959436 podStartE2EDuration="22.973911742s" totalImagesPullingTime="18.682952306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:47.973511521 +0000 UTC m=+23.631729131" watchObservedRunningTime="2026-08-02 10:33:47.973911742 +0000 UTC m=+23.632129331"
Aug 02 10:33:48.092364 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.092280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:48.148419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.148376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:48.677164 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.677061    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:48.677874 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.677851    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:48.754950 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.754751    2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-02T10:33:47.962598439Z","UUID":"3783f4ec-2354-4e9c-a4ee-817792e78175","Handler":null,"Name":"","Endpoint":""}
Aug 02 10:33:48.756640 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.756609    2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 02 10:33:48.756777 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.756654    2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 02 10:33:48.841129 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.841099    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:48.841391 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:48.841235    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:48.841652 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.841633    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:48.841744 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:48.841728    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:48.841872 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.841859    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:48.841965 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:48.841950    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:48.969290 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.969181    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8" event={"ID":"ffd95625-32c8-44ef-8350-17d55a05a1a0","Type":"ContainerStarted","Data":"d620567d18fe4330780a96b17e7d4295e7abd555221e9a4b42300c660c5175ce"}
Aug 02 10:33:48.969822 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.969473    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:48.969971 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:48.969952    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-58tmx"
Aug 02 10:33:49.036320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:49.036248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:49.974837 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:49.974509    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8" event={"ID":"ffd95625-32c8-44ef-8350-17d55a05a1a0","Type":"ContainerStarted","Data":"44b5f36c0daa64836a2580826ee230c612f3b34aa51a2bbf9dad103ff00ec255"}
Aug 02 10:33:49.978257 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:49.978231    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"076f6be4973f7432c49e1c4137364057b22e54a7e003bcc73afc0d0a18413bb9"}
Aug 02 10:33:49.991912 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:49.991865    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mhdx8" podStartSLOduration=4.136231159 podStartE2EDuration="24.991843827s" totalImagesPullingTime="20.855612668s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:49.991186187 +0000 UTC m=+25.649403803" watchObservedRunningTime="2026-08-02 10:33:49.991843827 +0000 UTC m=+25.650061426"
Aug 02 10:33:50.136039 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.136000    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:50.222067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.222035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:50.659647 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.659618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:50.718027 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.717281    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:50.841299 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.841252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:50.841480 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:50.841380    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:50.841480 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.841252    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:50.841480 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:50.841407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:50.841480 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:50.841466    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:50.841675 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:50.841532    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:51.989199 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:51.989019    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ae08e3f-8fc1-437f-96b0-a914cd707ddf" containerID="ade6806fea359b8c1ed11b1cd7e2bf5812ac80d0d79b25dcf2ce44fee9360791" exitCode=0
Aug 02 10:33:51.990003 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:51.989100    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerDied","Data":"ade6806fea359b8c1ed11b1cd7e2bf5812ac80d0d79b25dcf2ce44fee9360791"}
Aug 02 10:33:51.993136 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:51.993110    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" event={"ID":"71c56056-eabe-4083-aad0-4e25e7b8a0f4","Type":"ContainerStarted","Data":"aafd53214ba1837b67279293078ae23b140ba11fdd74c4ba7877ce0b4c2cfae1"}
Aug 02 10:33:51.993381 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:51.993365    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:51.993460 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:51.993416    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:52.009237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.009208    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:52.031838 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.031803    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k" podStartSLOduration=8.274555281 podStartE2EDuration="27.031791014s" totalImagesPullingTime="18.757235733s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:33:52.030817538 +0000 UTC m=+27.689035140" watchObservedRunningTime="2026-08-02 10:33:52.031791014 +0000 UTC m=+27.690008604"
Aug 02 10:33:52.841667 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.841640    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:52.841824 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:52.841744    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:52.842042 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.842027    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:52.842120 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:52.842105    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:52.842180 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.842154    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:52.842236 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:52.842222    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:52.962179 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.962131    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:52.996568 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:52.996543    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:53.012741 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.012716    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:33:53.020548 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.020519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:53.707203 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.707174    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtrpt"]
Aug 02 10:33:53.707531 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.707317    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:53.707531 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:53.707424    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:53.710907 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.710879    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rgvjh"]
Aug 02 10:33:53.711042 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.710983    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:53.711113 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:53.711084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:53.711502 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.711479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4sp8v"]
Aug 02 10:33:53.711631 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:53.711595    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:53.711721 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:53.711702    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:54.000665 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:54.000631    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ae08e3f-8fc1-437f-96b0-a914cd707ddf" containerID="83b5bf069eae10fc05f95200301290cbb9f2590b06d61ffb8441e7a53b2d12ae" exitCode=0
Aug 02 10:33:54.001087 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:54.000679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerDied","Data":"83b5bf069eae10fc05f95200301290cbb9f2590b06d61ffb8441e7a53b2d12ae"}
Aug 02 10:33:54.574344 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:54.574143    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:54.675151 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:54.675123    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:55.841063 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:55.840990    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:55.841429 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:55.841081    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:55.841429 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:55.841084    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:55.841429 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:55.841220    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:55.841429 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:55.841288    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:55.841429 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:55.841365    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:56.010551 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:56.010518    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ae08e3f-8fc1-437f-96b0-a914cd707ddf" containerID="53ac5c607c050a87248c024aba8ce3ffb1fc8d237d13475e6f3674d4abeb6931" exitCode=0
Aug 02 10:33:56.010684 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:56.010591    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerDied","Data":"53ac5c607c050a87248c024aba8ce3ffb1fc8d237d13475e6f3674d4abeb6931"}
Aug 02 10:33:57.221605 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.221565    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:57.340115 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.340084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:57.393974 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.393941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:57.451117 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.451083    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:57.840231 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.840196    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:57.840432 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.840324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:57.840432 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:57.840341    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rgvjh" podUID="284b4fad-3427-46a8-b7ad-fd052a5d4e8c"
Aug 02 10:33:57.840432 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:57.840359    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:57.840578 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:57.840445    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xtrpt" podUID="1e943018-6179-46eb-b458-2a61e3190bf1"
Aug 02 10:33:57.840637 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:57.840569    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:33:58.444102 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:58.444063    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:58.444605 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:58.444163    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:58.444605 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.444234    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 02 10:33:58.444605 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.444590    2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 02 10:33:58.444605 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.444595    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:58.444605 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.444606    2563 projected.go:196] Error preparing data for projected volume kube-api-access-rvvd5 for pod openshift-network-diagnostics/network-check-target-xtrpt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:58.444855 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.444678    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:34:30.444657243 +0000 UTC m=+66.102874823 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 02 10:33:58.444915 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.444864    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5 podName:1e943018-6179-46eb-b458-2a61e3190bf1 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:30.444844444 +0000 UTC m=+66.103062016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rvvd5" (UniqueName: "kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5") pod "network-check-target-xtrpt" (UID: "1e943018-6179-46eb-b458-2a61e3190bf1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 02 10:33:58.544907 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:58.544871    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:58.545061 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.544987    2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:58.545061 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:58.545045    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret podName:284b4fad-3427-46a8-b7ad-fd052a5d4e8c nodeName:}" failed. No retries permitted until 2026-08-02 10:34:30.545027001 +0000 UTC m=+66.203244571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret") pod "global-pull-secret-syncer-rgvjh" (UID: "284b4fad-3427-46a8-b7ad-fd052a5d4e8c") : object "kube-system"/"original-pull-secret" not registered
Aug 02 10:33:59.139649 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.139618    2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-84.ec2.internal" event="NodeReady"
Aug 02 10:33:59.139806 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.139780    2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 02 10:33:59.181307 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.181255    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-c5lkm"]
Aug 02 10:33:59.183981 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.183958    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-945wh"]
Aug 02 10:33:59.184115 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.184089    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.185928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.185898    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.186044 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.185992    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 02 10:33:59.186120 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.186097    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 02 10:33:59.186254 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.186239    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nv7kc\""
Aug 02 10:33:59.188174 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.187980    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 02 10:33:59.188174 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.188089    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wbhqw\""
Aug 02 10:33:59.188404 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.188389    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 02 10:33:59.188591 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.188574    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 02 10:33:59.193590 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.193572    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c5lkm"]
Aug 02 10:33:59.197989 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.197970    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-945wh"]
Aug 02 10:33:59.302415 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.302331    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:59.353194 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.353161    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15f239f4-4548-4481-8d55-82fdaace39b0-tmp-dir\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.353390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.353215    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.353390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.353242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rcpx\" (UniqueName: \"kubernetes.io/projected/15f239f4-4548-4481-8d55-82fdaace39b0-kube-api-access-5rcpx\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.353390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.353281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38cdf496-b973-4b1b-8921-109274790533-cert\") pod \"ingress-canary-945wh\" (UID: \"38cdf496-b973-4b1b-8921-109274790533\") " pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.353390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.353309    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15f239f4-4548-4481-8d55-82fdaace39b0-config-volume\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.353390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.353342    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd8xh\" (UniqueName: \"kubernetes.io/projected/38cdf496-b973-4b1b-8921-109274790533-kube-api-access-jd8xh\") pod \"ingress-canary-945wh\" (UID: \"38cdf496-b973-4b1b-8921-109274790533\") " pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.360148 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.360112    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:33:59.454297 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd8xh\" (UniqueName: \"kubernetes.io/projected/38cdf496-b973-4b1b-8921-109274790533-kube-api-access-jd8xh\") pod \"ingress-canary-945wh\" (UID: \"38cdf496-b973-4b1b-8921-109274790533\") " pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15f239f4-4548-4481-8d55-82fdaace39b0-tmp-dir\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454409    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454431    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rcpx\" (UniqueName: \"kubernetes.io/projected/15f239f4-4548-4481-8d55-82fdaace39b0-kube-api-access-5rcpx\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38cdf496-b973-4b1b-8921-109274790533-cert\") pod \"ingress-canary-945wh\" (UID: \"38cdf496-b973-4b1b-8921-109274790533\") " pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:59.454526    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:59.454590    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:33:59.954569118 +0000 UTC m=+35.612786705 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15f239f4-4548-4481-8d55-82fdaace39b0-config-volume\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.454929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.454757    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/15f239f4-4548-4481-8d55-82fdaace39b0-tmp-dir\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.455285 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.455122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/15f239f4-4548-4481-8d55-82fdaace39b0-config-volume\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.459313 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.459287    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38cdf496-b973-4b1b-8921-109274790533-cert\") pod \"ingress-canary-945wh\" (UID: \"38cdf496-b973-4b1b-8921-109274790533\") " pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.465637 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.465618    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd8xh\" (UniqueName: \"kubernetes.io/projected/38cdf496-b973-4b1b-8921-109274790533-kube-api-access-jd8xh\") pod \"ingress-canary-945wh\" (UID: \"38cdf496-b973-4b1b-8921-109274790533\") " pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.465637 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.465614    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rcpx\" (UniqueName: \"kubernetes.io/projected/15f239f4-4548-4481-8d55-82fdaace39b0-kube-api-access-5rcpx\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.504630 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.504601    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-945wh"
Aug 02 10:33:59.840725 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.840692    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:33:59.840903 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.840708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:33:59.840903 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.840708    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:33:59.843479 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.843455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9bgf\""
Aug 02 10:33:59.843610 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.843455    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 02 10:33:59.843840 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.843819    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 02 10:33:59.843963 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.843833    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 02 10:33:59.843963 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.843883    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 02 10:33:59.843963 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.843829    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dvcgg\""
Aug 02 10:33:59.958401 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:33:59.958366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:33:59.958577 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:59.958526    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:33:59.958639 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:33:59.958598    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:00.958582095 +0000 UTC m=+36.616799663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:34:00.140899 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:00.140689    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-945wh"]
Aug 02 10:34:00.145869 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:34:00.145839    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38cdf496_b973_4b1b_8921_109274790533.slice/crio-56827ae36d29076e3871c0f69486cdc8fa92aabb46d5a4ee0c98604053d33011 WatchSource:0}: Error finding container 56827ae36d29076e3871c0f69486cdc8fa92aabb46d5a4ee0c98604053d33011: Status 404 returned error can't find the container with id 56827ae36d29076e3871c0f69486cdc8fa92aabb46d5a4ee0c98604053d33011
Aug 02 10:34:00.965918 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:00.965881    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:34:00.966398 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:00.966012    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:34:00.966398 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:00.966081    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:02.966062977 +0000 UTC m=+38.624280551 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:34:01.029145 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:01.029115    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ae08e3f-8fc1-437f-96b0-a914cd707ddf" containerID="8d9738c516550760c9e09917d442cb245f0605b8ba8b858f0540e9ae6cd4aca5" exitCode=0
Aug 02 10:34:01.029333 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:01.029206    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerDied","Data":"8d9738c516550760c9e09917d442cb245f0605b8ba8b858f0540e9ae6cd4aca5"}
Aug 02 10:34:01.030673 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:01.030648    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-945wh" event={"ID":"38cdf496-b973-4b1b-8921-109274790533","Type":"ContainerStarted","Data":"56827ae36d29076e3871c0f69486cdc8fa92aabb46d5a4ee0c98604053d33011"}
Aug 02 10:34:02.037240 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:02.037204    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ae08e3f-8fc1-437f-96b0-a914cd707ddf" containerID="11a0d46079486a5321bbdf407ad9b6b55f0fff9300edc8e4e2c2f5d680cf1962" exitCode=0
Aug 02 10:34:02.037698 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:02.037251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerDied","Data":"11a0d46079486a5321bbdf407ad9b6b55f0fff9300edc8e4e2c2f5d680cf1962"}
Aug 02 10:34:02.982810 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:02.982627    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:34:02.982985 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:02.982776    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:34:02.982985 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:02.982891    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:06.982877504 +0000 UTC m=+42.641095071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:34:03.041384 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:03.041348    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-945wh" event={"ID":"38cdf496-b973-4b1b-8921-109274790533","Type":"ContainerStarted","Data":"05ddb7ee22ecb37dac4fca648b13374fb8b504953d056c2132948316d80822d4"}
Aug 02 10:34:03.044488 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:03.044464    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8b865" event={"ID":"9ae08e3f-8fc1-437f-96b0-a914cd707ddf","Type":"ContainerStarted","Data":"185cc4181b0519b9ebb0bb4127c34817196f69b6135c070ac83e9c4161c40a09"}
Aug 02 10:34:03.057569 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:03.057525    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-945wh" podStartSLOduration=1.7570333439999999 podStartE2EDuration="4.05751289s" totalImagesPullingTime="2.300479546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:03.056920145 +0000 UTC m=+38.715137734" watchObservedRunningTime="2026-08-02 10:34:03.05751289 +0000 UTC m=+38.715730480"
Aug 02 10:34:03.076600 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:03.076557    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8b865" podStartSLOduration=8.736095535 podStartE2EDuration="38.076539297s" totalImagesPullingTime="29.340443762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:03.075152754 +0000 UTC m=+38.733370362" watchObservedRunningTime="2026-08-02 10:34:03.076539297 +0000 UTC m=+38.734756887"
Aug 02 10:34:03.197747 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:03.197704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:03.258589 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:03.258520    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:04.195157 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:04.195116    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:04.251713 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:04.251684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:07.010688 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:07.010652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:34:07.011053 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:07.010809    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:34:07.011053 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:07.010882    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:15.010861387 +0000 UTC m=+50.669078974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:34:12.140711 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:12.140679    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:12.195900 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:12.195873    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:15.064395 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:15.064341    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:34:15.064787 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:15.064503    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:34:15.064787 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:15.064568    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:34:31.064551768 +0000 UTC m=+66.722769338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:34:19.361375 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:19.361336    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:19.419142 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:19.419103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:25.023636 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:25.023602    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9xd4k"
Aug 02 10:34:25.141916 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:25.141886    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:25.208750 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:25.208715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:30.466785 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.466750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:34:30.466785 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.466788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:34:30.469076 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.469060    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 02 10:34:30.469132 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.469105    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 02 10:34:30.477632 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:30.477606    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 02 10:34:30.477744 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:30.477668    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:35:34.477652842 +0000 UTC m=+130.135870409 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : secret "metrics-daemon-secret" not found
Aug 02 10:34:30.479362 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.479346    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 02 10:34:30.492529 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.492506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvvd5\" (UniqueName: \"kubernetes.io/projected/1e943018-6179-46eb-b458-2a61e3190bf1-kube-api-access-rvvd5\") pod \"network-check-target-xtrpt\" (UID: \"1e943018-6179-46eb-b458-2a61e3190bf1\") " pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:34:30.567586 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.567553    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:34:30.570075 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.570060    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 02 10:34:30.580777 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.580758    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/284b4fad-3427-46a8-b7ad-fd052a5d4e8c-original-pull-secret\") pod \"global-pull-secret-syncer-rgvjh\" (UID: \"284b4fad-3427-46a8-b7ad-fd052a5d4e8c\") " pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:34:30.754395 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.754315    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-q9bgf\""
Aug 02 10:34:30.758859 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.758839    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rgvjh"
Aug 02 10:34:30.762980 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.762964    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:34:30.909147 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.909115    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rgvjh"]
Aug 02 10:34:30.912912 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:34:30.912888    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod284b4fad_3427_46a8_b7ad_fd052a5d4e8c.slice/crio-9f98109451f1053daa3bfc909c9d28c41fe785da3edb1cd6b89a4eef707f359b WatchSource:0}: Error finding container 9f98109451f1053daa3bfc909c9d28c41fe785da3edb1cd6b89a4eef707f359b: Status 404 returned error can't find the container with id 9f98109451f1053daa3bfc909c9d28c41fe785da3edb1cd6b89a4eef707f359b
Aug 02 10:34:30.931871 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:30.931850    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xtrpt"]
Aug 02 10:34:30.934384 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:34:30.934361    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e943018_6179_46eb_b458_2a61e3190bf1.slice/crio-787c68f5b7f0fb11420f4104083f55c36b5aac111fc94ec216372d20869e5796 WatchSource:0}: Error finding container 787c68f5b7f0fb11420f4104083f55c36b5aac111fc94ec216372d20869e5796: Status 404 returned error can't find the container with id 787c68f5b7f0fb11420f4104083f55c36b5aac111fc94ec216372d20869e5796
Aug 02 10:34:31.071692 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:31.071612    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:34:31.071834 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:31.071719    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:34:31.071834 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:34:31.071780    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:35:03.071766412 +0000 UTC m=+98.729983980 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:34:31.114290 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:31.114245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtrpt" event={"ID":"1e943018-6179-46eb-b458-2a61e3190bf1","Type":"ContainerStarted","Data":"787c68f5b7f0fb11420f4104083f55c36b5aac111fc94ec216372d20869e5796"}
Aug 02 10:34:31.115321 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:31.115298    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rgvjh" event={"ID":"284b4fad-3427-46a8-b7ad-fd052a5d4e8c","Type":"ContainerStarted","Data":"9f98109451f1053daa3bfc909c9d28c41fe785da3edb1cd6b89a4eef707f359b"}
Aug 02 10:34:36.129600 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:36.129559    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rgvjh" event={"ID":"284b4fad-3427-46a8-b7ad-fd052a5d4e8c","Type":"ContainerStarted","Data":"bbd6f3d0cf141c3788928024ecb8c169bda629ea04cf5951fbfdd1fdeccf2979"}
Aug 02 10:34:36.131034 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:36.131005    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xtrpt" event={"ID":"1e943018-6179-46eb-b458-2a61e3190bf1","Type":"ContainerStarted","Data":"32ee1f0a40d49fd01e8d8a0906d3d750072fff77c8eacaa430ec4587581dc285"}
Aug 02 10:34:36.131146 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:36.131128    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:34:36.149471 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:36.149420    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rgvjh" podStartSLOduration=66.692647659 podStartE2EDuration="1m11.149406742s" totalImagesPullingTime="4.456759083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:36.148495783 +0000 UTC m=+71.806713373" watchObservedRunningTime="2026-08-02 10:34:36.149406742 +0000 UTC m=+71.807624321"
Aug 02 10:34:36.163727 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:36.163681    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xtrpt" podStartSLOduration=66.730659692 podStartE2EDuration="1m11.16366396s" totalImagesPullingTime="4.433004268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:34:36.163167488 +0000 UTC m=+71.821385092" watchObservedRunningTime="2026-08-02 10:34:36.16366396 +0000 UTC m=+71.821881551"
Aug 02 10:34:50.542278 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:50.542124    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:34:50.604534 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:34:50.604502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:35:03.079240 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:35:03.079205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:35:03.079665 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:35:03.079320    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:35:03.079665 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:35:03.079372    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:36:07.079358653 +0000 UTC m=+162.737576221 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:35:07.136076 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:35:07.136045    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xtrpt"
Aug 02 10:35:34.492312 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:35:34.492248    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:35:34.492737 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:35:34.492401    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 02 10:35:34.492737 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:35:34.492473    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:36.492453982 +0000 UTC m=+252.150671550 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : secret "metrics-daemon-secret" not found
Aug 02 10:36:02.198095 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:36:02.198054    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-c5lkm" podUID="15f239f4-4548-4481-8d55-82fdaace39b0"
Aug 02 10:36:02.329915 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:36:02.329886    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:36:02.864185 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:36:02.864151    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:36:07.106621 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:36:07.106561    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:36:07.107032 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:36:07.106723    2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 02 10:36:07.107032 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:36:07.106790    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls podName:15f239f4-4548-4481-8d55-82fdaace39b0 nodeName:}" failed. No retries permitted until 2026-08-02 10:38:09.106773861 +0000 UTC m=+284.764991430 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls") pod "dns-default-c5lkm" (UID: "15f239f4-4548-4481-8d55-82fdaace39b0") : secret "dns-default-metrics-tls" not found
Aug 02 10:36:14.841933 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:36:14.841891    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:37:03.320636 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:03.320603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:33.267312 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.267254    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"]
Aug 02 10:37:33.268948 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.268933    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.270155 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.270100    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"]
Aug 02 10:37:33.271421 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.271400    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 02 10:37:33.271711 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.271692    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-hdkvd"]
Aug 02 10:37:33.271816 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.271798    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.271922 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.271878    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-kxtgz\""
Aug 02 10:37:33.272118 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.271943    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 02 10:37:33.272257 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.271949    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 02 10:37:33.273229 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.273211    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 02 10:37:33.273442 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.273424    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.273950 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.273935    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 02 10:37:33.274452 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.274437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9fm26\""
Aug 02 10:37:33.274526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.274439    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 02 10:37:33.274876 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.274862    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Aug 02 10:37:33.274988 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.274929    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Aug 02 10:37:33.275365 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.275152    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 02 10:37:33.275365 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.275162    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 02 10:37:33.275365 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.275205    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 02 10:37:33.275365 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.275209    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 02 10:37:33.275365 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.275173    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-wqvb8\""
Aug 02 10:37:33.281742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.281724    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 02 10:37:33.290039 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.290019    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"]
Aug 02 10:37:33.293127 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.293080    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-hdkvd"]
Aug 02 10:37:33.294126 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.294109    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"]
Aug 02 10:37:33.376036 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376008    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94831f8f-b1d0-4340-a018-c9529199471f-serving-cert\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.376237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376059    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlftg\" (UniqueName: \"kubernetes.io/projected/55c02df8-b088-4351-ba1f-f1b9650de225-kube-api-access-hlftg\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.376237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376079    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55c02df8-b088-4351-ba1f-f1b9650de225-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.376237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94831f8f-b1d0-4340-a018-c9529199471f-config\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.376237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376174    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55c02df8-b088-4351-ba1f-f1b9650de225-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.376237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376207    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmgk5\" (UniqueName: \"kubernetes.io/projected/94831f8f-b1d0-4340-a018-c9529199471f-kube-api-access-jmgk5\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.376455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376236    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.376455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376281    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt92j\" (UniqueName: \"kubernetes.io/projected/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-kube-api-access-dt92j\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.376455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376313    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94831f8f-b1d0-4340-a018-c9529199471f-trusted-ca\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.376455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.376328    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.466391 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.466359    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"]
Aug 02 10:37:33.468293 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.468278    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:33.470087 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.470064    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 02 10:37:33.470211 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.470087    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 02 10:37:33.470211 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.470101    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-phg8k\""
Aug 02 10:37:33.476724 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.476705    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94831f8f-b1d0-4340-a018-c9529199471f-config\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.476823 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.476733    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55c02df8-b088-4351-ba1f-f1b9650de225-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.476823 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.476770    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmgk5\" (UniqueName: \"kubernetes.io/projected/94831f8f-b1d0-4340-a018-c9529199471f-kube-api-access-jmgk5\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.476823 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.476795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.477081 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:33.476874    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:33.477081 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:33.476925    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls podName:e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:33.976908188 +0000 UTC m=+249.635125755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x7ncw" (UID: "e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6") : secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:33.477207 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477090    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt92j\" (UniqueName: \"kubernetes.io/projected/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-kube-api-access-dt92j\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.477207 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477156    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94831f8f-b1d0-4340-a018-c9529199471f-trusted-ca\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.477207 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.477381 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477216    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94831f8f-b1d0-4340-a018-c9529199471f-serving-cert\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.477381 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477279    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlftg\" (UniqueName: \"kubernetes.io/projected/55c02df8-b088-4351-ba1f-f1b9650de225-kube-api-access-hlftg\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.477381 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477311    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55c02df8-b088-4351-ba1f-f1b9650de225-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.477675 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477650    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/94831f8f-b1d0-4340-a018-c9529199471f-config\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.477801 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.477785    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/55c02df8-b088-4351-ba1f-f1b9650de225-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.478065 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.478035    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-telemetry-config\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.478545 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.478506    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/94831f8f-b1d0-4340-a018-c9529199471f-trusted-ca\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.478775 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.478755    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"]
Aug 02 10:37:33.479464 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.479443    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/55c02df8-b088-4351-ba1f-f1b9650de225-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.480363 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.480343    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/94831f8f-b1d0-4340-a018-c9529199471f-serving-cert\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.490420 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.490401    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlftg\" (UniqueName: \"kubernetes.io/projected/55c02df8-b088-4351-ba1f-f1b9650de225-kube-api-access-hlftg\") pod \"kube-storage-version-migrator-operator-7878f4b88c-n6rmv\" (UID: \"55c02df8-b088-4351-ba1f-f1b9650de225\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.490521 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.490501    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmgk5\" (UniqueName: \"kubernetes.io/projected/94831f8f-b1d0-4340-a018-c9529199471f-kube-api-access-jmgk5\") pod \"console-operator-5ccd6b445f-hdkvd\" (UID: \"94831f8f-b1d0-4340-a018-c9529199471f\") " pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.490669 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.490654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt92j\" (UniqueName: \"kubernetes.io/projected/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-kube-api-access-dt92j\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.516802 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.516774    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:33.578670 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.578590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:33.578670 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.578631    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:33.580573 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.580557    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"
Aug 02 10:37:33.592035 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.592010    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:33.618927 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.618898    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:33.680724 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.680025    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:33.680724 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.680086    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:33.680724 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:33.680286    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 02 10:37:33.680724 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:33.680362    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert podName:b72e01bd-c8e2-4f38-8ec6-8be071a9b88a nodeName:}" failed. No retries permitted until 2026-08-02 10:37:34.180340022 +0000 UTC m=+249.838557613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-gj5n6" (UID: "b72e01bd-c8e2-4f38-8ec6-8be071a9b88a") : secret "networking-console-plugin-cert" not found
Aug 02 10:37:33.681414 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.681387    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:33.711789 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.711735    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv"]
Aug 02 10:37:33.715232 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:37:33.715206    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c02df8_b088_4351_ba1f_f1b9650de225.slice/crio-3a3b11b1addd62933fafe56982c030fb71c7b6d7357df87db3d468067259a92c WatchSource:0}: Error finding container 3a3b11b1addd62933fafe56982c030fb71c7b6d7357df87db3d468067259a92c: Status 404 returned error can't find the container with id 3a3b11b1addd62933fafe56982c030fb71c7b6d7357df87db3d468067259a92c
Aug 02 10:37:33.727025 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.726997    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-hdkvd"]
Aug 02 10:37:33.730059 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:37:33.730033    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94831f8f_b1d0_4340_a018_c9529199471f.slice/crio-469b3773ba91e37b568b4288a0d5397e97378cd6d63325e0a890b45023e53788 WatchSource:0}: Error finding container 469b3773ba91e37b568b4288a0d5397e97378cd6d63325e0a890b45023e53788: Status 404 returned error can't find the container with id 469b3773ba91e37b568b4288a0d5397e97378cd6d63325e0a890b45023e53788
Aug 02 10:37:33.981942 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:33.981899    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:33.982122 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:33.982025    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:33.982122 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:33.982086    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls podName:e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:34.982067297 +0000 UTC m=+250.640284885 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x7ncw" (UID: "e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6") : secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:34.183497 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:34.183458    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:34.183671 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:34.183614    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 02 10:37:34.183717 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:34.183677    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert podName:b72e01bd-c8e2-4f38-8ec6-8be071a9b88a nodeName:}" failed. No retries permitted until 2026-08-02 10:37:35.18366042 +0000 UTC m=+250.841877988 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-gj5n6" (UID: "b72e01bd-c8e2-4f38-8ec6-8be071a9b88a") : secret "networking-console-plugin-cert" not found
Aug 02 10:37:34.552755 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:34.552717    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" event={"ID":"94831f8f-b1d0-4340-a018-c9529199471f","Type":"ContainerStarted","Data":"469b3773ba91e37b568b4288a0d5397e97378cd6d63325e0a890b45023e53788"}
Aug 02 10:37:34.554356 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:34.554296    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv" event={"ID":"55c02df8-b088-4351-ba1f-f1b9650de225","Type":"ContainerStarted","Data":"3a3b11b1addd62933fafe56982c030fb71c7b6d7357df87db3d468067259a92c"}
Aug 02 10:37:34.991803 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:34.991759    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:34.992009 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:34.991904    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:34.992009 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:34.991978    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls podName:e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:36.991957116 +0000 UTC m=+252.650174700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x7ncw" (UID: "e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6") : secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:35.192680 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:35.192648    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:35.192873 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:35.192802    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 02 10:37:35.192937 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:35.192882    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert podName:b72e01bd-c8e2-4f38-8ec6-8be071a9b88a nodeName:}" failed. No retries permitted until 2026-08-02 10:37:37.192865982 +0000 UTC m=+252.851083550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-gj5n6" (UID: "b72e01bd-c8e2-4f38-8ec6-8be071a9b88a") : secret "networking-console-plugin-cert" not found
Aug 02 10:37:35.905283 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:35.905231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:35.970626 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:35.970592    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:36.502443 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.502398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:37:36.502633 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:36.502552    2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Aug 02 10:37:36.502633 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:36.502615    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs podName:e6b44d3c-bb78-4e23-be01-089572c40bbc nodeName:}" failed. No retries permitted until 2026-08-02 10:39:38.502601265 +0000 UTC m=+374.160818834 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs") pod "network-metrics-daemon-4sp8v" (UID: "e6b44d3c-bb78-4e23-be01-089572c40bbc") : secret "metrics-daemon-secret" not found
Aug 02 10:37:36.561494 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.561471    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/0.log"
Aug 02 10:37:36.561625 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.561508    2563 generic.go:356] "Generic (PLEG): container finished" podID="94831f8f-b1d0-4340-a018-c9529199471f" containerID="70beaa81084a7f8954a1bf7d79f583e7cea10bd76d86605b1ca0ae22d2787885" exitCode=255
Aug 02 10:37:36.561625 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.561569    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" event={"ID":"94831f8f-b1d0-4340-a018-c9529199471f","Type":"ContainerDied","Data":"70beaa81084a7f8954a1bf7d79f583e7cea10bd76d86605b1ca0ae22d2787885"}
Aug 02 10:37:36.561822 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.561807    2563 scope.go:117] "RemoveContainer" containerID="70beaa81084a7f8954a1bf7d79f583e7cea10bd76d86605b1ca0ae22d2787885"
Aug 02 10:37:36.563171 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.563143    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv" event={"ID":"55c02df8-b088-4351-ba1f-f1b9650de225","Type":"ContainerStarted","Data":"d293757d47346e0180526d06e8ce48f5c988a65a54f846d3e7da704d6f4319a9"}
Aug 02 10:37:36.594874 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.594830    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv" podStartSLOduration=1.28655728 podStartE2EDuration="3.594814886s" totalImagesPullingTime="2.308257606s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:36.593655448 +0000 UTC m=+252.251873037" watchObservedRunningTime="2026-08-02 10:37:36.594814886 +0000 UTC m=+252.253032476"
Aug 02 10:37:36.872033 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.871953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:36.886031 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.886000    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"]
Aug 02 10:37:36.888840 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.888822    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"
Aug 02 10:37:36.890626 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.890604    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-z7klh\""
Aug 02 10:37:36.890883 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.890863    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Aug 02 10:37:36.890989 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.890960    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Aug 02 10:37:36.899175 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.899154    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"]
Aug 02 10:37:36.963424 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:36.963394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:37.007638 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.007603    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:37.007638 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.007640    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c46z\" (UniqueName: \"kubernetes.io/projected/f92f8f8b-c652-447c-97ca-968422d0fb4a-kube-api-access-2c46z\") pod \"migrator-68bc745d87-w8mnq\" (UID: \"f92f8f8b-c652-447c-97ca-968422d0fb4a\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"
Aug 02 10:37:37.007859 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.007752    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:37.007859 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.007821    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls podName:e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.007805475 +0000 UTC m=+256.666023042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x7ncw" (UID: "e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6") : secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:37.064386 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.064353    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:37.108346 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.108318    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c46z\" (UniqueName: \"kubernetes.io/projected/f92f8f8b-c652-447c-97ca-968422d0fb4a-kube-api-access-2c46z\") pod \"migrator-68bc745d87-w8mnq\" (UID: \"f92f8f8b-c652-447c-97ca-968422d0fb4a\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"
Aug 02 10:37:37.116714 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.116686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c46z\" (UniqueName: \"kubernetes.io/projected/f92f8f8b-c652-447c-97ca-968422d0fb4a-kube-api-access-2c46z\") pod \"migrator-68bc745d87-w8mnq\" (UID: \"f92f8f8b-c652-447c-97ca-968422d0fb4a\") " pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"
Aug 02 10:37:37.197874 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.197844    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"
Aug 02 10:37:37.208820 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.208795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:37.208956 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.208940    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 02 10:37:37.209017 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.209009    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert podName:b72e01bd-c8e2-4f38-8ec6-8be071a9b88a nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.208990508 +0000 UTC m=+256.867208076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-gj5n6" (UID: "b72e01bd-c8e2-4f38-8ec6-8be071a9b88a") : secret "networking-console-plugin-cert" not found
Aug 02 10:37:37.326863 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.326826    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq"]
Aug 02 10:37:37.330678 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:37:37.330644    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf92f8f8b_c652_447c_97ca_968422d0fb4a.slice/crio-069c1de1d4c30b051b3f7794572623ca047ec9692dfc1856d22cc765f599e01b WatchSource:0}: Error finding container 069c1de1d4c30b051b3f7794572623ca047ec9692dfc1856d22cc765f599e01b: Status 404 returned error can't find the container with id 069c1de1d4c30b051b3f7794572623ca047ec9692dfc1856d22cc765f599e01b
Aug 02 10:37:37.384765 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.384739    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2wtvz"]
Aug 02 10:37:37.388875 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.388857    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.391327 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.391049    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 02 10:37:37.391327 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.391204    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 02 10:37:37.392321 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.392063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:37.392321 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.392148    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 02 10:37:37.392321 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.392161    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-94g6g\""
Aug 02 10:37:37.392321 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.392200    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 02 10:37:37.398370 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.398350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wtvz"]
Aug 02 10:37:37.452088 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.451995    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:37.511363 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.511324    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw8vx\" (UniqueName: \"kubernetes.io/projected/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-api-access-fw8vx\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.511516 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.511375    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.511516 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.511505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdca932d-8f2e-43d2-8120-67746b8b8adc-data-volume\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.511605 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.511533    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdca932d-8f2e-43d2-8120-67746b8b8adc-crio-socket\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.511605 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.511554    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.567681 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.567656    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/1.log"
Aug 02 10:37:37.568088 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.568070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/0.log"
Aug 02 10:37:37.568187 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.568112    2563 generic.go:356] "Generic (PLEG): container finished" podID="94831f8f-b1d0-4340-a018-c9529199471f" containerID="2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197" exitCode=255
Aug 02 10:37:37.568187 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.568163    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" event={"ID":"94831f8f-b1d0-4340-a018-c9529199471f","Type":"ContainerDied","Data":"2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197"}
Aug 02 10:37:37.568327 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.568225    2563 scope.go:117] "RemoveContainer" containerID="70beaa81084a7f8954a1bf7d79f583e7cea10bd76d86605b1ca0ae22d2787885"
Aug 02 10:37:37.568458 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.568419    2563 scope.go:117] "RemoveContainer" containerID="2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197"
Aug 02 10:37:37.568630 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.568611    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hdkvd_openshift-console-operator(94831f8f-b1d0-4340-a018-c9529199471f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podUID="94831f8f-b1d0-4340-a018-c9529199471f"
Aug 02 10:37:37.569408 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.569357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq" event={"ID":"f92f8f8b-c652-447c-97ca-968422d0fb4a","Type":"ContainerStarted","Data":"069c1de1d4c30b051b3f7794572623ca047ec9692dfc1856d22cc765f599e01b"}
Aug 02 10:37:37.612815 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.612783    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.612943 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.612903    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 02 10:37:37.613006 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.612964    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:38.112943642 +0000 UTC m=+253.771161209 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : configmap "kube-rbac-proxy" not found
Aug 02 10:37:37.613006 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.612902    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdca932d-8f2e-43d2-8120-67746b8b8adc-data-volume\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.613116 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.613042    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdca932d-8f2e-43d2-8120-67746b8b8adc-crio-socket\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.613116 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.613076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.613220 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.613196    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fdca932d-8f2e-43d2-8120-67746b8b8adc-crio-socket\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.613220 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.613199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw8vx\" (UniqueName: \"kubernetes.io/projected/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-api-access-fw8vx\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.613335 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.613234    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:37.613335 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.613232    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fdca932d-8f2e-43d2-8120-67746b8b8adc-data-volume\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:37.613335 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:37.613322    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:38.113305251 +0000 UTC m=+253.771522830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:37.624984 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:37.624960    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw8vx\" (UniqueName: \"kubernetes.io/projected/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-api-access-fw8vx\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:38.091457 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.091421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:38.117232 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.117199    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:38.117429 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.117306    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:38.117429 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:38.117344    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 02 10:37:38.117429 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:38.117408    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:39.117390189 +0000 UTC m=+254.775607759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : configmap "kube-rbac-proxy" not found
Aug 02 10:37:38.117574 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:38.117461    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:38.117574 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:38.117537    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:39.117519441 +0000 UTC m=+254.775737023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:38.193309 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.193280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:38.317158 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.317128    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:38.419234 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.419202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:38.574168 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.574139    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/1.log"
Aug 02 10:37:38.574588 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.574569    2563 scope.go:117] "RemoveContainer" containerID="2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197"
Aug 02 10:37:38.574790 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:38.574764    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hdkvd_openshift-console-operator(94831f8f-b1d0-4340-a018-c9529199471f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podUID="94831f8f-b1d0-4340-a018-c9529199471f"
Aug 02 10:37:38.820092 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.820061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:38.903828 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:38.903797    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:39.124390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.124293    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:39.124772 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.124398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:39.124772 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:39.124448    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:39.124772 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:39.124483    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 02 10:37:39.124772 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:39.124520    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.124500964 +0000 UTC m=+256.782718532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:39.124772 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:39.124537    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:41.124529697 +0000 UTC m=+256.782747265 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : configmap "kube-rbac-proxy" not found
Aug 02 10:37:39.578187 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.578150    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq" event={"ID":"f92f8f8b-c652-447c-97ca-968422d0fb4a","Type":"ContainerStarted","Data":"9dce1e2297256e7459e9d8c7306884cc926e329cb21e70903f8f97be8e6ad538"}
Aug 02 10:37:39.578369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.578211    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq" event={"ID":"f92f8f8b-c652-447c-97ca-968422d0fb4a","Type":"ContainerStarted","Data":"ab64eddc74f604dab2951e4f2ed05174c7e2f581b72bcfbfed1da1dce58ccd32"}
Aug 02 10:37:39.592973 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.592927    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-68bc745d87-w8mnq" podStartSLOduration=2.287107499 podStartE2EDuration="3.592909639s" totalImagesPullingTime="1.30580214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:37:39.592604002 +0000 UTC m=+255.250821592" watchObservedRunningTime="2026-08-02 10:37:39.592909639 +0000 UTC m=+255.251127229"
Aug 02 10:37:39.667938 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.667908    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:39.941864 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:39.941838    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnpd5_8147fcc7-615f-4279-b5c4-102489a5f974/dns-node-resolver/0.log"
Aug 02 10:37:40.424955 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:40.424919    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:40.476779 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:40.476750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:40.941785 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:40.941757    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7p68s_17c36f37-e3e4-4221-892e-f365d1f2bc1d/node-ca/0.log"
Aug 02 10:37:41.038992 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:41.038955    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:41.039171 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.039110    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:41.039215 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.039176    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls podName:e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6 nodeName:}" failed. No retries permitted until 2026-08-02 10:37:49.039160923 +0000 UTC m=+264.697378492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x7ncw" (UID: "e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6") : secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:41.140198 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:41.140146    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:41.140381 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:41.140255    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:41.140381 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.140291    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 02 10:37:41.140498 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.140391    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:45.14035005 +0000 UTC m=+260.798567621 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : configmap "kube-rbac-proxy" not found
Aug 02 10:37:41.140498 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.140392    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:41.140498 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.140440    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:45.140428277 +0000 UTC m=+260.798645844 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:41.241618 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:41.241535    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:41.241797 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.241678    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 02 10:37:41.241797 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:41.241752    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert podName:b72e01bd-c8e2-4f38-8ec6-8be071a9b88a nodeName:}" failed. No retries permitted until 2026-08-02 10:37:49.241736083 +0000 UTC m=+264.899953651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-gj5n6" (UID: "b72e01bd-c8e2-4f38-8ec6-8be071a9b88a") : secret "networking-console-plugin-cert" not found
Aug 02 10:37:41.361498 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:41.361469    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:41.941755 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:41.941731    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-945wh_38cdf496-b973-4b1b-8921-109274790533/serve-healthcheck-canary/0.log"
Aug 02 10:37:42.342723 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:42.342645    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-w8mnq_f92f8f8b-c652-447c-97ca-968422d0fb4a/migrator/0.log"
Aug 02 10:37:42.541937 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:42.541908    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-w8mnq_f92f8f8b-c652-447c-97ca-968422d0fb4a/graceful-termination/0.log"
Aug 02 10:37:42.743497 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:42.743466    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-n6rmv_55c02df8-b088-4351-ba1f-f1b9650de225/kube-storage-version-migrator-operator/0.log"
Aug 02 10:37:43.592628 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:43.592599    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:43.592990 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:43.592642    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:37:43.592990 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:43.592959    2563 scope.go:117] "RemoveContainer" containerID="2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197"
Aug 02 10:37:43.593114 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:43.593096    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hdkvd_openshift-console-operator(94831f8f-b1d0-4340-a018-c9529199471f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podUID="94831f8f-b1d0-4340-a018-c9529199471f"
Aug 02 10:37:44.505482 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:44.505450    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:44.605828 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:44.605798    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:44.862549 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:44.862471    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:45.005721 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.005690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:45.106397 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.106365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:45.171244 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.171215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:45.171421 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.171299    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:45.171421 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:45.171344    2563 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 02 10:37:45.171421 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:45.171407    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:53.171391751 +0000 UTC m=+268.829609326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : configmap "kube-rbac-proxy" not found
Aug 02 10:37:45.171421 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:45.171409    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:45.171560 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:45.171452    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:37:53.171441792 +0000 UTC m=+268.829659360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:45.207566 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.207534    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:45.308483 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.308451    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:45.411413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.411385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:45.659326 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:45.659298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:46.661640 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:46.661596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:46.856565 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:46.856538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:47.062918 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:47.062833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:47.458938 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:47.458901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:47.790824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:47.790741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:48.054763 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:48.054680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:48.658882 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:48.658854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:48.714914 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:48.714887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:48.856108 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:48.856078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:49.057749 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:49.057636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:49.101930 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:49.101884    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:37:49.102126 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:49.102051    2563 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:49.102187 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:49.102140    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls podName:e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6 nodeName:}" failed. No retries permitted until 2026-08-02 10:38:05.102120304 +0000 UTC m=+280.760337873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6f55c4f58d-x7ncw" (UID: "e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6") : secret "cluster-monitoring-operator-tls" not found
Aug 02 10:37:49.255167 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:49.255133    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:49.303316 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:49.303252    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:37:49.303464 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:49.303360    2563 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 02 10:37:49.303464 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:49.303428    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert podName:b72e01bd-c8e2-4f38-8ec6-8be071a9b88a nodeName:}" failed. No retries permitted until 2026-08-02 10:38:05.303412814 +0000 UTC m=+280.961630387 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-gj5n6" (UID: "b72e01bd-c8e2-4f38-8ec6-8be071a9b88a") : secret "networking-console-plugin-cert" not found
Aug 02 10:37:49.839463 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:49.839426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:50.062601 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:50.062567    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:50.257256 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:50.257219    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:50.464280 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:50.464244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:50.856494 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:50.856465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:51.057805 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:51.057775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:51.664327 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:51.664298    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:52.052742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:52.052661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:52.266447 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:52.266411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:52.456492 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:52.456461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:52.660409 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:52.660374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:53.065705 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:53.065669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:53.233722 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:53.233691    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:53.233931 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:53.233774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:53.233931 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:53.233854    2563 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:53.233931 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:53.233920    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls podName:fdca932d-8f2e-43d2-8120-67746b8b8adc nodeName:}" failed. No retries permitted until 2026-08-02 10:38:09.233902674 +0000 UTC m=+284.892120251 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-2wtvz" (UID: "fdca932d-8f2e-43d2-8120-67746b8b8adc") : secret "insights-runtime-extractor-tls" not found
Aug 02 10:37:53.234377 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:53.234356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fdca932d-8f2e-43d2-8120-67746b8b8adc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:37:53.858355 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:53.858320    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:54.055899 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:54.055871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:54.254837 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:54.254810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:54.573576 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:54.573500    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:54.673849 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:54.673820    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:54.728395 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:54.728368    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:55.056170 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:55.056134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:55.260074 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:55.260040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:37:55.841081 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:55.841048    2563 scope.go:117] "RemoveContainer" containerID="2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197"
Aug 02 10:37:56.626133 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:56.626097    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:37:56.626534 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:56.626470    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/1.log"
Aug 02 10:37:56.626534 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:56.626503    2563 generic.go:356] "Generic (PLEG): container finished" podID="94831f8f-b1d0-4340-a018-c9529199471f" containerID="65e6376d2561c130345e9435998c2a774211366a0b740f8bb4fe387a545de9eb" exitCode=255
Aug 02 10:37:56.626606 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:56.626552    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" event={"ID":"94831f8f-b1d0-4340-a018-c9529199471f","Type":"ContainerDied","Data":"65e6376d2561c130345e9435998c2a774211366a0b740f8bb4fe387a545de9eb"}
Aug 02 10:37:56.626640 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:56.626603    2563 scope.go:117] "RemoveContainer" containerID="2ba790554ebb62aceadb0236e73a54c914f69fa6fdd05df690e2e3d923ac3197"
Aug 02 10:37:56.626902 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:56.626884    2563 scope.go:117] "RemoveContainer" containerID="65e6376d2561c130345e9435998c2a774211366a0b740f8bb4fe387a545de9eb"
Aug 02 10:37:56.627056 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:37:56.627040    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hdkvd_openshift-console-operator(94831f8f-b1d0-4340-a018-c9529199471f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podUID="94831f8f-b1d0-4340-a018-c9529199471f"
Aug 02 10:37:57.630649 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:37:57.630624    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:38:02.883513 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.883480    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-894d47cf4-429h2"]
Aug 02 10:38:02.887526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.887511    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:02.889433 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.889410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 02 10:38:02.889544 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.889433    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 02 10:38:02.889544 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.889410    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 02 10:38:02.889732 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.889719    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-plb6r\""
Aug 02 10:38:02.895326 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.895308    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 02 10:38:02.899975 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:02.899953    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-894d47cf4-429h2"]
Aug 02 10:38:03.009914 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.009886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbtn7\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-kube-api-access-dbtn7\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.009914 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.009917    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b234bac1-1324-4977-9c8f-da1295ee4b70-ca-trust-extracted\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.010122 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.009938    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b234bac1-1324-4977-9c8f-da1295ee4b70-registry-certificates\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.010122 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.009957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-registry-tls\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.010122 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.010043    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-bound-sa-token\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.010231 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.010196    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b234bac1-1324-4977-9c8f-da1295ee4b70-trusted-ca\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.010297 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.010277    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b234bac1-1324-4977-9c8f-da1295ee4b70-installation-pull-secrets\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.010339 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.010304    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b234bac1-1324-4977-9c8f-da1295ee4b70-image-registry-private-configuration\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.011613 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.011587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:03.111104 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111070    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b234bac1-1324-4977-9c8f-da1295ee4b70-installation-pull-secrets\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111104 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111101    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b234bac1-1324-4977-9c8f-da1295ee4b70-image-registry-private-configuration\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111375 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbtn7\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-kube-api-access-dbtn7\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111375 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b234bac1-1324-4977-9c8f-da1295ee4b70-ca-trust-extracted\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111375 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111196    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b234bac1-1324-4977-9c8f-da1295ee4b70-registry-certificates\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111375 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-registry-tls\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111375 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111375    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-bound-sa-token\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111673 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b234bac1-1324-4977-9c8f-da1295ee4b70-trusted-ca\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.111673 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.111590    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b234bac1-1324-4977-9c8f-da1295ee4b70-ca-trust-extracted\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.112224 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.112200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b234bac1-1324-4977-9c8f-da1295ee4b70-trusted-ca\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.112359 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.112319    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b234bac1-1324-4977-9c8f-da1295ee4b70-registry-certificates\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.113807 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.113776    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b234bac1-1324-4977-9c8f-da1295ee4b70-image-registry-private-configuration\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.113892 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.113844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b234bac1-1324-4977-9c8f-da1295ee4b70-installation-pull-secrets\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.113931 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.113923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-registry-tls\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.119827 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.119805    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbtn7\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-kube-api-access-dbtn7\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.120090 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.120063    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b234bac1-1324-4977-9c8f-da1295ee4b70-bound-sa-token\") pod \"image-registry-894d47cf4-429h2\" (UID: \"b234bac1-1324-4977-9c8f-da1295ee4b70\") " pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.197733 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.197705    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.322801 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.322774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-894d47cf4-429h2"]
Aug 02 10:38:03.325599 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:03.325572    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb234bac1_1324_4977_9c8f_da1295ee4b70.slice/crio-3e7e18b489f1aa2a338ba6d203ed30eb9d82ce156155c781c35605498931e7c5 WatchSource:0}: Error finding container 3e7e18b489f1aa2a338ba6d203ed30eb9d82ce156155c781c35605498931e7c5: Status 404 returned error can't find the container with id 3e7e18b489f1aa2a338ba6d203ed30eb9d82ce156155c781c35605498931e7c5
Aug 02 10:38:03.592170 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.592092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:38:03.592367 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.592183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:38:03.592466 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.592453    2563 scope.go:117] "RemoveContainer" containerID="65e6376d2561c130345e9435998c2a774211366a0b740f8bb4fe387a545de9eb"
Aug 02 10:38:03.592627 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:38:03.592609    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hdkvd_openshift-console-operator(94831f8f-b1d0-4340-a018-c9529199471f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podUID="94831f8f-b1d0-4340-a018-c9529199471f"
Aug 02 10:38:03.648740 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.648703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-894d47cf4-429h2" event={"ID":"b234bac1-1324-4977-9c8f-da1295ee4b70","Type":"ContainerStarted","Data":"63c43867527bd2716ed0fbe7cc76da4a841f9062814961907006361cd13bdd99"}
Aug 02 10:38:03.648939 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.648756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-894d47cf4-429h2" event={"ID":"b234bac1-1324-4977-9c8f-da1295ee4b70","Type":"ContainerStarted","Data":"3e7e18b489f1aa2a338ba6d203ed30eb9d82ce156155c781c35605498931e7c5"}
Aug 02 10:38:03.649003 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.648979    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:03.649003 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.648995    2563 scope.go:117] "RemoveContainer" containerID="65e6376d2561c130345e9435998c2a774211366a0b740f8bb4fe387a545de9eb"
Aug 02 10:38:03.649165 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:38:03.649144    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5ccd6b445f-hdkvd_openshift-console-operator(94831f8f-b1d0-4340-a018-c9529199471f)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podUID="94831f8f-b1d0-4340-a018-c9529199471f"
Aug 02 10:38:03.669382 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:03.669330    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-894d47cf4-429h2" podStartSLOduration=1.669314873 podStartE2EDuration="1.669314873s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:03.667976012 +0000 UTC m=+279.326193615" watchObservedRunningTime="2026-08-02 10:38:03.669314873 +0000 UTC m=+279.327532463"
Aug 02 10:38:04.467436 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:04.467391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:05.125620 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.125583    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:38:05.128115 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.128085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6f55c4f58d-x7ncw\" (UID: \"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6\") " pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:38:05.327441 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.327390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:38:05.329946 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.329920    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b72e01bd-c8e2-4f38-8ec6-8be071a9b88a-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-gj5n6\" (UID: \"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:38:05.330934 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:38:05.330905    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-c5lkm" podUID="15f239f4-4548-4481-8d55-82fdaace39b0"
Aug 02 10:38:05.386169 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.386088    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"
Aug 02 10:38:05.514019 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.513978    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw"]
Aug 02 10:38:05.517466 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:05.517435    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode55d319f_9bbb_4fc8_bc0c_f7e11e83eee6.slice/crio-52d4eba930f3cbf06a58633303b435022644a25d9507b77fb1cbb882212093bf WatchSource:0}: Error finding container 52d4eba930f3cbf06a58633303b435022644a25d9507b77fb1cbb882212093bf: Status 404 returned error can't find the container with id 52d4eba930f3cbf06a58633303b435022644a25d9507b77fb1cbb882212093bf
Aug 02 10:38:05.576461 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.576431    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"
Aug 02 10:38:05.657635 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.657612    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:38:05.657751 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.657611    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw" event={"ID":"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6","Type":"ContainerStarted","Data":"52d4eba930f3cbf06a58633303b435022644a25d9507b77fb1cbb882212093bf"}
Aug 02 10:38:05.702131 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:05.702102    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6"]
Aug 02 10:38:05.705370 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:05.705345    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72e01bd_c8e2_4f38_8ec6_8be071a9b88a.slice/crio-0bb0dac22bb2dcbd582fb30a6231dcade3b890f2703b25ede860ee4952c4a08b WatchSource:0}: Error finding container 0bb0dac22bb2dcbd582fb30a6231dcade3b890f2703b25ede860ee4952c4a08b: Status 404 returned error can't find the container with id 0bb0dac22bb2dcbd582fb30a6231dcade3b890f2703b25ede860ee4952c4a08b
Aug 02 10:38:06.663456 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:06.663415    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6" event={"ID":"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a","Type":"ContainerStarted","Data":"0bb0dac22bb2dcbd582fb30a6231dcade3b890f2703b25ede860ee4952c4a08b"}
Aug 02 10:38:07.669361 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:07.669320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw" event={"ID":"e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6","Type":"ContainerStarted","Data":"b1075fc6b120ab2ec8b5f5d7c808d1ad32aee7f7a7cc351961fef0e76f901e09"}
Aug 02 10:38:07.671902 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:07.671870    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6" event={"ID":"b72e01bd-c8e2-4f38-8ec6-8be071a9b88a","Type":"ContainerStarted","Data":"df14fe06ca6161b6406659b7543c71b426176f67221d0565d45696d69bcea657"}
Aug 02 10:38:07.688093 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:07.688046    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6f55c4f58d-x7ncw" podStartSLOduration=32.6877981 podStartE2EDuration="34.688031839s" totalImagesPullingTime="2.000233739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:07.686994151 +0000 UTC m=+283.345211740" watchObservedRunningTime="2026-08-02 10:38:07.688031839 +0000 UTC m=+283.346249429"
Aug 02 10:38:07.702775 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:07.702725    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-gj5n6" podStartSLOduration=32.894591811 podStartE2EDuration="34.702707686s" totalImagesPullingTime="1.808115875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:07.701159049 +0000 UTC m=+283.359376639" watchObservedRunningTime="2026-08-02 10:38:07.702707686 +0000 UTC m=+283.360925277"
Aug 02 10:38:07.843715 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:07.843634    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:07.948271 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:07.948237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:08.038898 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:08.038868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:08.400957 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:08.400927    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:09.160101 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.160067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:38:09.162500 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.162472    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/15f239f4-4548-4481-8d55-82fdaace39b0-metrics-tls\") pod \"dns-default-c5lkm\" (UID: \"15f239f4-4548-4481-8d55-82fdaace39b0\") " pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:38:09.260608 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.260578    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nv7kc\""
Aug 02 10:38:09.260608 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.260589    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:38:09.263042 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.263013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fdca932d-8f2e-43d2-8120-67746b8b8adc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2wtvz\" (UID: \"fdca932d-8f2e-43d2-8120-67746b8b8adc\") " pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:38:09.268960 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.268942    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:38:09.394316 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.394288    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-c5lkm"]
Aug 02 10:38:09.397143 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:09.397116    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f239f4_4548_4481_8d55_82fdaace39b0.slice/crio-f9be27e387b2839015eb1defbe1ea122aa8367fac3f56bc2d19507c2247e26fd WatchSource:0}: Error finding container f9be27e387b2839015eb1defbe1ea122aa8367fac3f56bc2d19507c2247e26fd: Status 404 returned error can't find the container with id f9be27e387b2839015eb1defbe1ea122aa8367fac3f56bc2d19507c2247e26fd
Aug 02 10:38:09.501100 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.501009    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2wtvz"
Aug 02 10:38:09.627449 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.627424    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2wtvz"]
Aug 02 10:38:09.629709 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:09.629686    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdca932d_8f2e_43d2_8120_67746b8b8adc.slice/crio-7bc56fa8815211634d1804bf896c7d57e33f1c644c7dbb2cde93b95a9d5d3d96 WatchSource:0}: Error finding container 7bc56fa8815211634d1804bf896c7d57e33f1c644c7dbb2cde93b95a9d5d3d96: Status 404 returned error can't find the container with id 7bc56fa8815211634d1804bf896c7d57e33f1c644c7dbb2cde93b95a9d5d3d96
Aug 02 10:38:09.678282 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.678244    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wtvz" event={"ID":"fdca932d-8f2e-43d2-8120-67746b8b8adc","Type":"ContainerStarted","Data":"7bc56fa8815211634d1804bf896c7d57e33f1c644c7dbb2cde93b95a9d5d3d96"}
Aug 02 10:38:09.679552 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:09.679415    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5lkm" event={"ID":"15f239f4-4548-4481-8d55-82fdaace39b0","Type":"ContainerStarted","Data":"f9be27e387b2839015eb1defbe1ea122aa8367fac3f56bc2d19507c2247e26fd"}
Aug 02 10:38:10.684756 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:10.684673    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wtvz" event={"ID":"fdca932d-8f2e-43d2-8120-67746b8b8adc","Type":"ContainerStarted","Data":"6651e2676d5c1ee9146f909ec0c70bcafa6dccf27ad02f4bdec084392695d93c"}
Aug 02 10:38:11.059522 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.059487    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:11.134105 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.134029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:11.264238 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.264161    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:11.690046 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.689992    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wtvz" event={"ID":"fdca932d-8f2e-43d2-8120-67746b8b8adc","Type":"ContainerStarted","Data":"af55144f9ad7e72b38b9332df66cf9a9b62d37f60be2b9c0c13d12d2878eec41"}
Aug 02 10:38:11.691936 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.691910    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5lkm" event={"ID":"15f239f4-4548-4481-8d55-82fdaace39b0","Type":"ContainerStarted","Data":"55705b9933560423b16654d8375240215876c4a5328b738c1dcb9fae17e122d8"}
Aug 02 10:38:11.692073 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.691958    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-c5lkm" event={"ID":"15f239f4-4548-4481-8d55-82fdaace39b0","Type":"ContainerStarted","Data":"85b7960393c05bafff13da80593789a455e2ea962259c0b6bd627645c1edff42"}
Aug 02 10:38:11.692073 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.692041    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:38:11.708240 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:11.708187    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-c5lkm" podStartSLOduration=251.095535265 podStartE2EDuration="4m12.708167358s" totalImagesPullingTime="1.612632093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:11.70710027 +0000 UTC m=+287.365317861" watchObservedRunningTime="2026-08-02 10:38:11.708167358 +0000 UTC m=+287.366384952"
Aug 02 10:38:12.696853 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:12.696811    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2wtvz" event={"ID":"fdca932d-8f2e-43d2-8120-67746b8b8adc","Type":"ContainerStarted","Data":"78658b10a9c3cb6c6bf4f756b549898f2607eae565263cbd635cce71ce3685c1"}
Aug 02 10:38:12.715424 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:12.715380    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2wtvz" podStartSLOduration=33.32847944 podStartE2EDuration="35.71536429s" totalImagesPullingTime="2.38688485s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 10:37:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:12.713477638 +0000 UTC m=+288.371695228" watchObservedRunningTime="2026-08-02 10:38:12.71536429 +0000 UTC m=+288.373581880"
Aug 02 10:38:13.408092 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:13.408049    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:14.279328 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:14.279296    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:14.333279 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:14.333213    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.191954 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.191914    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.416664 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.416630    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.454499 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.454414    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pvlrf"]
Aug 02 10:38:15.457742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.457723    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.460146 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.460121    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 02 10:38:15.460286 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.460185    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7h556\""
Aug 02 10:38:15.460286 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.460235    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 02 10:38:15.460460 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.460445    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 02 10:38:15.460513 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.460472    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 02 10:38:15.496640 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.496602    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.561111 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.561076    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.606728 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606693    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-textfile\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.606879 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606733    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-sys\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.606879 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.606879 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-tls\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.606879 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfpfn\" (UniqueName: \"kubernetes.io/projected/a0b1641f-0342-49ab-8604-8ce01d6439cc-kube-api-access-qfpfn\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.607052 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606900    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-root\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.607052 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606926    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-wtmp\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.607052 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606959    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.607052 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.606985    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0b1641f-0342-49ab-8604-8ce01d6439cc-metrics-client-ca\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707501 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707423    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707501 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707457    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0b1641f-0342-49ab-8604-8ce01d6439cc-metrics-client-ca\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707699 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707590    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-textfile\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707699 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707625    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-sys\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707699 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707644    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707699 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707662    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-tls\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707699 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfpfn\" (UniqueName: \"kubernetes.io/projected/a0b1641f-0342-49ab-8604-8ce01d6439cc-kube-api-access-qfpfn\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707944 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707723    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-root\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707944 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-sys\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.707944 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707880    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-wtmp\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.708095 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.707943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-textfile\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.708095 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.708085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-wtmp\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.708162 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.708094    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a0b1641f-0342-49ab-8604-8ce01d6439cc-root\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.708162 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.708157    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0b1641f-0342-49ab-8604-8ce01d6439cc-metrics-client-ca\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.708221 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.708203    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-accelerators-collector-config\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.710507 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.710491    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.710670 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.710648    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a0b1641f-0342-49ab-8604-8ce01d6439cc-node-exporter-tls\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.719171 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.719146    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.720207 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.720190    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfpfn\" (UniqueName: \"kubernetes.io/projected/a0b1641f-0342-49ab-8604-8ce01d6439cc-kube-api-access-qfpfn\") pod \"node-exporter-pvlrf\" (UID: \"a0b1641f-0342-49ab-8604-8ce01d6439cc\") " pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.766363 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.766329    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pvlrf"
Aug 02 10:38:15.777493 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:15.777463    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0b1641f_0342_49ab_8604_8ce01d6439cc.slice/crio-53e9d302139735f3e09f1990a32a8b944f7cd7019346ea960842cb9f59d2507f WatchSource:0}: Error finding container 53e9d302139735f3e09f1990a32a8b944f7cd7019346ea960842cb9f59d2507f: Status 404 returned error can't find the container with id 53e9d302139735f3e09f1990a32a8b944f7cd7019346ea960842cb9f59d2507f
Aug 02 10:38:15.812793 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.812756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:15.880328 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:15.880256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.319943 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.319911    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.426111 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.426082    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.518301 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.518251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.594863 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.594785    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.654419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.654385    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.712178 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.712142    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvlrf" event={"ID":"a0b1641f-0342-49ab-8604-8ce01d6439cc","Type":"ContainerStarted","Data":"53e9d302139735f3e09f1990a32a8b944f7cd7019346ea960842cb9f59d2507f"}
Aug 02 10:38:16.841071 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.841054    2563 scope.go:117] "RemoveContainer" containerID="65e6376d2561c130345e9435998c2a774211366a0b740f8bb4fe387a545de9eb"
Aug 02 10:38:16.854887 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.854865    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:16.953730 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:16.953687    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:17.006556 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.006522    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:17.718936 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.718910    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:38:17.719423 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.719015    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" event={"ID":"94831f8f-b1d0-4340-a018-c9529199471f","Type":"ContainerStarted","Data":"ea036abfed9d07f25e8b1e1c14c716dd23312aab3cc476a7b0671f2b966497ee"}
Aug 02 10:38:17.719423 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.719410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:38:17.720948 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.720917    2563 generic.go:356] "Generic (PLEG): container finished" podID="a0b1641f-0342-49ab-8604-8ce01d6439cc" containerID="434e64d9b100db951f4a6c3b0abf1d0843f235ba258db17279dbcec2b0549e51" exitCode=0
Aug 02 10:38:17.721095 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.720975    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvlrf" event={"ID":"a0b1641f-0342-49ab-8604-8ce01d6439cc","Type":"ContainerDied","Data":"434e64d9b100db951f4a6c3b0abf1d0843f235ba258db17279dbcec2b0549e51"}
Aug 02 10:38:17.725223 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.725193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd"
Aug 02 10:38:17.749081 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.749038    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-hdkvd" podStartSLOduration=42.452686629 podStartE2EDuration="44.749024036s" totalImagesPullingTime="2.296337407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:37:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:17.748115911 +0000 UTC m=+293.406333520" watchObservedRunningTime="2026-08-02 10:38:17.749024036 +0000 UTC m=+293.407241626"
Aug 02 10:38:17.771058 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.771036    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-77c974ffcf-xm4gh"]
Aug 02 10:38:17.775228 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.775206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:17.777469 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.777445    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9hzl4\""
Aug 02 10:38:17.777574 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.777557    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 02 10:38:17.777873 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.777857    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 02 10:38:17.789644 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.789618    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-xm4gh"]
Aug 02 10:38:17.790021 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.789991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:17.843255 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:38:17.843223    2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4sp8v" podUID="e6b44d3c-bb78-4e23-be01-089572c40bbc"
Aug 02 10:38:17.862424 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.862401    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:17.923650 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.923614    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvg4\" (UniqueName: \"kubernetes.io/projected/b83f20a3-4faa-47a6-a783-c94b00781f8d-kube-api-access-jfvg4\") pod \"downloads-77c974ffcf-xm4gh\" (UID: \"b83f20a3-4faa-47a6-a783-c94b00781f8d\") " pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:17.926362 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:17.926339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.024603 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.024522    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvg4\" (UniqueName: \"kubernetes.io/projected/b83f20a3-4faa-47a6-a783-c94b00781f8d-kube-api-access-jfvg4\") pod \"downloads-77c974ffcf-xm4gh\" (UID: \"b83f20a3-4faa-47a6-a783-c94b00781f8d\") " pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:18.032770 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.032748    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvg4\" (UniqueName: \"kubernetes.io/projected/b83f20a3-4faa-47a6-a783-c94b00781f8d-kube-api-access-jfvg4\") pod \"downloads-77c974ffcf-xm4gh\" (UID: \"b83f20a3-4faa-47a6-a783-c94b00781f8d\") " pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:18.070403 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.070364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.085254 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.085231    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:18.233977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.233950    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-77c974ffcf-xm4gh"]
Aug 02 10:38:18.236753 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:18.236724    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb83f20a3_4faa_47a6_a783_c94b00781f8d.slice/crio-fd1b999949dd9136b6157326879e14c69a1d20e75316f5e7d4299dc9dc1af811 WatchSource:0}: Error finding container fd1b999949dd9136b6157326879e14c69a1d20e75316f5e7d4299dc9dc1af811: Status 404 returned error can't find the container with id fd1b999949dd9136b6157326879e14c69a1d20e75316f5e7d4299dc9dc1af811
Aug 02 10:38:18.254089 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.254069    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.349007 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.348933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.449185 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.449153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.534223 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.534188    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.608975 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.608857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.705792 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.705746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.726180 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.726151    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-xm4gh" event={"ID":"b83f20a3-4faa-47a6-a783-c94b00781f8d","Type":"ContainerStarted","Data":"fd1b999949dd9136b6157326879e14c69a1d20e75316f5e7d4299dc9dc1af811"}
Aug 02 10:38:18.728688 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.728656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvlrf" event={"ID":"a0b1641f-0342-49ab-8604-8ce01d6439cc","Type":"ContainerStarted","Data":"fbc1d0443e1fc77b1a83e958f2e82f5a29b7889bc368b23ad9601b12f2b895cc"}
Aug 02 10:38:18.728847 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.728703    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pvlrf" event={"ID":"a0b1641f-0342-49ab-8604-8ce01d6439cc","Type":"ContainerStarted","Data":"a578341d8f9bb7e9f62bdd6124539418f871f9cacd732f7ed3cfa5e0dffa7559"}
Aug 02 10:38:18.747340 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.747299    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pvlrf" podStartSLOduration=2.632333041 podStartE2EDuration="3.747283845s" totalImagesPullingTime="1.037584829s" totalInitContainerRuntime="77.365975ms" isStatefulPod=true podCreationTimestamp="2026-08-02 10:38:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:18.745613628 +0000 UTC m=+294.403831233" watchObservedRunningTime="2026-08-02 10:38:18.747283845 +0000 UTC m=+294.405501433"
Aug 02 10:38:18.780239 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.780205    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:18.853012 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:18.852975    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:19.440929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:19.440901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:19.642415 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:19.642383    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:19.837001 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:19.836916    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.028237 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.028179    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.226210 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.226178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.231833 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.231807    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"]
Aug 02 10:38:20.234878 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.234854    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.236664 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.236647    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 02 10:38:20.236846 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.236828    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sstfm\""
Aug 02 10:38:20.245945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.245924    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"]
Aug 02 10:38:20.320289 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.320242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.343304 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.343274    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w76cp\" (UniqueName: \"kubernetes.io/projected/7b622317-147e-4a54-b41e-c2ff4160a1f6-kube-api-access-w76cp\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.343471 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.343355    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b622317-147e-4a54-b41e-c2ff4160a1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.444662 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.444624    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w76cp\" (UniqueName: \"kubernetes.io/projected/7b622317-147e-4a54-b41e-c2ff4160a1f6-kube-api-access-w76cp\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.444827 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.444671    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b622317-147e-4a54-b41e-c2ff4160a1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.444827 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:38:20.444796    2563 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Aug 02 10:38:20.445030 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:38:20.444846    2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b622317-147e-4a54-b41e-c2ff4160a1f6-monitoring-plugin-cert podName:7b622317-147e-4a54-b41e-c2ff4160a1f6 nodeName:}" failed. No retries permitted until 2026-08-02 10:38:20.944831353 +0000 UTC m=+296.603048921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/7b622317-147e-4a54-b41e-c2ff4160a1f6-monitoring-plugin-cert") pod "monitoring-plugin-6dffbbd67-fkd7d" (UID: "7b622317-147e-4a54-b41e-c2ff4160a1f6") : secret "monitoring-plugin-cert" not found
Aug 02 10:38:20.453148 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.453117    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w76cp\" (UniqueName: \"kubernetes.io/projected/7b622317-147e-4a54-b41e-c2ff4160a1f6-kube-api-access-w76cp\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.529680 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.529603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.659625 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.659594    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.758399 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.758369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:20.949742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.949694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b622317-147e-4a54-b41e-c2ff4160a1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:20.952692 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:20.952659    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/7b622317-147e-4a54-b41e-c2ff4160a1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-fkd7d\" (UID: \"7b622317-147e-4a54-b41e-c2ff4160a1f6\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:21.146277 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:21.146238    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:21.292520 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:21.292479    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"]
Aug 02 10:38:21.296481 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:21.296441    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b622317_147e_4a54_b41e_c2ff4160a1f6.slice/crio-18f61f8d500b5532b97a771914581736139ac46b564cd877f57068c61353b453 WatchSource:0}: Error finding container 18f61f8d500b5532b97a771914581736139ac46b564cd877f57068c61353b453: Status 404 returned error can't find the container with id 18f61f8d500b5532b97a771914581736139ac46b564cd877f57068c61353b453
Aug 02 10:38:21.700110 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:21.700082    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-c5lkm"
Aug 02 10:38:21.730977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:21.730940    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:21.741777 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:21.741715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d" event={"ID":"7b622317-147e-4a54-b41e-c2ff4160a1f6","Type":"ContainerStarted","Data":"18f61f8d500b5532b97a771914581736139ac46b564cd877f57068c61353b453"}
Aug 02 10:38:23.357893 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.357855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:23.416918 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.416887    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:23.623072 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.622996    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-9dc45dccc-q588z"]
Aug 02 10:38:23.626427 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.626402    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.628437 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.628373    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 02 10:38:23.628437 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.628412    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 02 10:38:23.628592 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.628378    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 02 10:38:23.629003 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.628881    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zzcmq\""
Aug 02 10:38:23.629003 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.628916    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 02 10:38:23.629003 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.628981    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 02 10:38:23.636656 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.636636    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9dc45dccc-q588z"]
Aug 02 10:38:23.675876 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.675849    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-oauth-config\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.676036 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.675883    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-serving-cert\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.676036 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.675933    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-config\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.676036 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.675987    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-oauth-serving-cert\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.676036 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.676019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkjxn\" (UniqueName: \"kubernetes.io/projected/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-kube-api-access-pkjxn\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.676257 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.676127    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-service-ca\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.757227 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.757187    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d" event={"ID":"7b622317-147e-4a54-b41e-c2ff4160a1f6","Type":"ContainerStarted","Data":"117b47ca04b815062eb05755115fd25a7dbd421ff7b06a2bfb66f1f5d426da80"}
Aug 02 10:38:23.757468 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.757421    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:23.763977 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.763957    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d"
Aug 02 10:38:23.774979 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.774937    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-fkd7d" podStartSLOduration=2.396836947 podStartE2EDuration="3.774922191s" totalImagesPullingTime="1.378085244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:23.773341643 +0000 UTC m=+299.431559250" watchObservedRunningTime="2026-08-02 10:38:23.774922191 +0000 UTC m=+299.433139781"
Aug 02 10:38:23.776670 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.776645    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-oauth-config\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.776779 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.776697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-serving-cert\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.776779 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.776756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-config\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.776897 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.776786    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-oauth-serving-cert\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.776897 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.776821    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkjxn\" (UniqueName: \"kubernetes.io/projected/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-kube-api-access-pkjxn\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.777004 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.776900    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-service-ca\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.777742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.777657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-oauth-serving-cert\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.777742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.777682    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-service-ca\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.777742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.777735    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-config\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.779695 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.779676    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-oauth-config\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.779931 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.779913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-serving-cert\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.791711 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.791686    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkjxn\" (UniqueName: \"kubernetes.io/projected/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-kube-api-access-pkjxn\") pod \"console-9dc45dccc-q588z\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") " pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:23.939020 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:23.938967    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:24.092336 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.092304    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-9dc45dccc-q588z"]
Aug 02 10:38:24.095410 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:38:24.095377    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96ffcf9_f0c4_4e2d_98e2_8c7608f93aca.slice/crio-e259c652eca3db6b52c5d5d952b30d5a8e1a13e1ed8af1a76a763b737387e889 WatchSource:0}: Error finding container e259c652eca3db6b52c5d5d952b30d5a8e1a13e1ed8af1a76a763b737387e889: Status 404 returned error can't find the container with id e259c652eca3db6b52c5d5d952b30d5a8e1a13e1ed8af1a76a763b737387e889
Aug 02 10:38:24.657516 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.657487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-894d47cf4-429h2"
Aug 02 10:38:24.703970 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.703942    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:38:24.704644 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.704622    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:38:24.722426 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.722400    2563 kubelet.go:1648] "Image garbage collection succeeded"
Aug 02 10:38:24.762419 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.762378    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dc45dccc-q588z" event={"ID":"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca","Type":"ContainerStarted","Data":"e259c652eca3db6b52c5d5d952b30d5a8e1a13e1ed8af1a76a763b737387e889"}
Aug 02 10:38:24.781703 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.781648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:24.923244 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:24.923145    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:25.025683 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:25.025655    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:26.825603 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:26.825506    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:27.775347 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:27.775316    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dc45dccc-q588z" event={"ID":"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca","Type":"ContainerStarted","Data":"39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25"}
Aug 02 10:38:27.791766 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:27.791704    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-9dc45dccc-q588z" podStartSLOduration=1.57681074 podStartE2EDuration="4.791685018s" totalImagesPullingTime="3.214874278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:27.79116577 +0000 UTC m=+303.449383374" watchObservedRunningTime="2026-08-02 10:38:27.791685018 +0000 UTC m=+303.449902608"
Aug 02 10:38:31.840971 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:31.840928    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:38:32.658192 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:32.658158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:32.709801 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:32.709764    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:33.939929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:33.939892    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:33.940455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:33.939992    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:33.946505 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:33.946485    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:34.804846 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:34.804820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:38:35.794940 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:35.794906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:35.806465 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:35.806392    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-77c974ffcf-xm4gh" event={"ID":"b83f20a3-4faa-47a6-a783-c94b00781f8d","Type":"ContainerStarted","Data":"0a90a32f4a884bd5ab65db19b376a7517f34ab97483de90de55ea735b345c769"}
Aug 02 10:38:35.823693 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:35.823647    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-77c974ffcf-xm4gh" podStartSLOduration=2.20810115 podStartE2EDuration="18.823628466s" totalImagesPullingTime="16.615527316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:38:35.822212366 +0000 UTC m=+311.480429977" watchObservedRunningTime="2026-08-02 10:38:35.823628466 +0000 UTC m=+311.481846059"
Aug 02 10:38:35.895103 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:35.895067    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:36.119074 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:36.118986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:36.219727 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:36.219688    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:36.319928 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:36.319892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:36.812949 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:36.812918    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:36.823848 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:36.823820    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-77c974ffcf-xm4gh"
Aug 02 10:38:39.572383 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:39.572318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:39.672531 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:39.672479    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:39.772896 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:39.772859    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:41.078547 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:41.078514    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:41.129277 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:41.129202    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:42.266792 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:42.266747    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:42.326869 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:42.326813    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:44.047117 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:44.047088    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9dc45dccc-q588z"]
Aug 02 10:38:46.850042 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:46.849960    2563 generic.go:356] "Generic (PLEG): container finished" podID="55c02df8-b088-4351-ba1f-f1b9650de225" containerID="d293757d47346e0180526d06e8ce48f5c988a65a54f846d3e7da704d6f4319a9" exitCode=0
Aug 02 10:38:46.850485 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:46.850035    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv" event={"ID":"55c02df8-b088-4351-ba1f-f1b9650de225","Type":"ContainerDied","Data":"d293757d47346e0180526d06e8ce48f5c988a65a54f846d3e7da704d6f4319a9"}
Aug 02 10:38:46.850485 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:46.850349    2563 scope.go:117] "RemoveContainer" containerID="d293757d47346e0180526d06e8ce48f5c988a65a54f846d3e7da704d6f4319a9"
Aug 02 10:38:47.080115 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:47.080080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:47.136566 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:47.136463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:47.272404 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:47.272365    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:47.374075 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:47.374024    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:47.854788 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:47.854760    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-n6rmv" event={"ID":"55c02df8-b088-4351-ba1f-f1b9650de225","Type":"ContainerStarted","Data":"efe959ddada34091a76a67b52dc834b6cf8ae1b386f9ae407d9ded4b1e6695fa"}
Aug 02 10:38:53.378388 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:53.378345    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:54.609379 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:54.609344    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:38:54.677458 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:38:54.677403    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:09.071050 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.070986    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-9dc45dccc-q588z" podUID="a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" containerName="console" containerID="cri-o://39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25" gracePeriod=15
Aug 02 10:39:09.345921 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.345852    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:39:09.465385 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465356    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-config\") pod \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") "
Aug 02 10:39:09.465385 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465391    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkjxn\" (UniqueName: \"kubernetes.io/projected/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-kube-api-access-pkjxn\") pod \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") "
Aug 02 10:39:09.465616 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465419    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-serving-cert\") pod \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") "
Aug 02 10:39:09.465616 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465466    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-oauth-config\") pod \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") "
Aug 02 10:39:09.465616 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465503    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-oauth-serving-cert\") pod \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") "
Aug 02 10:39:09.465616 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465517    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-service-ca\") pod \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\" (UID: \"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca\") "
Aug 02 10:39:09.465824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465800    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-config" (OuterVolumeSpecName: "console-config") pod "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" (UID: "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:39:09.465947 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" (UID: "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:39:09.465947 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.465931    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-service-ca" (OuterVolumeSpecName: "service-ca") pod "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" (UID: "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:39:09.467898 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.467869    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" (UID: "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 10:39:09.467988 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.467891    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" (UID: "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 10:39:09.467988 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.467909    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-kube-api-access-pkjxn" (OuterVolumeSpecName: "kube-api-access-pkjxn") pod "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" (UID: "a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca"). InnerVolumeSpecName "kube-api-access-pkjxn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 10:39:09.566960 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.566924    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-oauth-serving-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:39:09.566960 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.566954    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-service-ca\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:39:09.566960 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.566963    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-config\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:39:09.567179 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.566971    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkjxn\" (UniqueName: \"kubernetes.io/projected/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-kube-api-access-pkjxn\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:39:09.567179 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.566981    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-serving-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:39:09.567179 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.566990    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca-console-oauth-config\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:39:09.928774 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.928745    2563 generic.go:356] "Generic (PLEG): container finished" podID="a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" containerID="39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25" exitCode=0
Aug 02 10:39:09.928962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.928792    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-9dc45dccc-q588z"
Aug 02 10:39:09.928962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.928805    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dc45dccc-q588z" event={"ID":"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca","Type":"ContainerDied","Data":"39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25"}
Aug 02 10:39:09.928962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.928848    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-9dc45dccc-q588z" event={"ID":"a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca","Type":"ContainerDied","Data":"e259c652eca3db6b52c5d5d952b30d5a8e1a13e1ed8af1a76a763b737387e889"}
Aug 02 10:39:09.928962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.928867    2563 scope.go:117] "RemoveContainer" containerID="39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25"
Aug 02 10:39:09.940848 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.940826    2563 scope.go:117] "RemoveContainer" containerID="39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25"
Aug 02 10:39:09.941114 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:39:09.941094    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25\": container with ID starting with 39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25 not found: ID does not exist" containerID="39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25"
Aug 02 10:39:09.941182 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.941126    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25"} err="failed to get container status \"39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25\": rpc error: code = NotFound desc = could not find container \"39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25\": container with ID starting with 39cfe8f998c5e7800708bf0110e33612573808267e8deab4a117756108c16d25 not found: ID does not exist"
Aug 02 10:39:09.946832 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.946813    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-9dc45dccc-q588z"]
Aug 02 10:39:09.951070 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:09.951052    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-9dc45dccc-q588z"]
Aug 02 10:39:10.845333 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:10.845301    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" path="/var/lib/kubelet/pods/a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca/volumes"
Aug 02 10:39:28.154913 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:28.154840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:28.209820 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:28.209784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:34.279867 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:34.279834    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:34.341165 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:34.341134    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:34.737357 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:34.737304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:34.819893 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:34.819863    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:35.094780 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:35.094682    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:38.594251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:38.594215    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:39:38.596621 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:38.596603    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6b44d3c-bb78-4e23-be01-089572c40bbc-metrics-certs\") pod \"network-metrics-daemon-4sp8v\" (UID: \"e6b44d3c-bb78-4e23-be01-089572c40bbc\") " pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:39:38.743805 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:38.743775    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dvcgg\""
Aug 02 10:39:38.752366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:38.752346    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4sp8v"
Aug 02 10:39:38.882474 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:38.882398    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4sp8v"]
Aug 02 10:39:38.886318 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:39:38.886295    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6b44d3c_bb78_4e23_be01_089572c40bbc.slice/crio-a33bed0897674afaffc6ee45506accf3fc56da3bfe6af6cf0ef0f99817b5b69a WatchSource:0}: Error finding container a33bed0897674afaffc6ee45506accf3fc56da3bfe6af6cf0ef0f99817b5b69a: Status 404 returned error can't find the container with id a33bed0897674afaffc6ee45506accf3fc56da3bfe6af6cf0ef0f99817b5b69a
Aug 02 10:39:38.888230 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:38.888213    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 02 10:39:39.032907 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.032873    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4sp8v" event={"ID":"e6b44d3c-bb78-4e23-be01-089572c40bbc","Type":"ContainerStarted","Data":"a33bed0897674afaffc6ee45506accf3fc56da3bfe6af6cf0ef0f99817b5b69a"}
Aug 02 10:39:39.907190 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.907156    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"]
Aug 02 10:39:39.907694 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.907459    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" containerName="console"
Aug 02 10:39:39.907694 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.907472    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" containerName="console"
Aug 02 10:39:39.907694 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.907519    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a96ffcf9-f0c4-4e2d-98e2-8c7608f93aca" containerName="console"
Aug 02 10:39:39.909472 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.909452    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:39.911864 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.911278    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 02 10:39:39.911864 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.911680    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 02 10:39:39.912178 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.911905    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 02 10:39:39.912178 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.912109    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 02 10:39:39.912415 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.912342    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 02 10:39:39.912518 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.912461    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-rfjbw\""
Aug 02 10:39:39.922892 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.922868    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 02 10:39:39.922994 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:39.922928    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"]
Aug 02 10:39:40.006947 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.006860    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-federate-client-tls\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.006947 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.006898    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-secret-telemeter-client\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.006947 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.006936    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.007320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.006962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-metrics-client-ca\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.007320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.007057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-serving-certs-ca-bundle\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.007320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.007119    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-telemeter-client-tls\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.007320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.007143    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdjv2\" (UniqueName: \"kubernetes.io/projected/36e8a1ce-225a-495f-8db9-646f3f24cd3e-kube-api-access-qdjv2\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.007320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.007186    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.038461 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.038431    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4sp8v" event={"ID":"e6b44d3c-bb78-4e23-be01-089572c40bbc","Type":"ContainerStarted","Data":"6b0776e8ef8ffbfad703d43927cba8967a9c3fe9b97334c5dbdc9aa1b558c514"}
Aug 02 10:39:40.038594 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.038478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4sp8v" event={"ID":"e6b44d3c-bb78-4e23-be01-089572c40bbc","Type":"ContainerStarted","Data":"651cf4a3b756538b45203c6d543534203d1b2b67e9f76f91ab44eee276bcb891"}
Aug 02 10:39:40.054470 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.054426    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4sp8v" podStartSLOduration=374.229763475 podStartE2EDuration="6m15.054410749s" totalImagesPullingTime="824.647274ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:39:40.053247821 +0000 UTC m=+375.711465410" watchObservedRunningTime="2026-08-02 10:39:40.054410749 +0000 UTC m=+375.712628338"
Aug 02 10:39:40.108474 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108437    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108666 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108479    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-metrics-client-ca\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108666 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108541    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-serving-certs-ca-bundle\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108666 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108582    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-telemeter-client-tls\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108666 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108607    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdjv2\" (UniqueName: \"kubernetes.io/projected/36e8a1ce-225a-495f-8db9-646f3f24cd3e-kube-api-access-qdjv2\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108666 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108656    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108890 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108684    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-federate-client-tls\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.108890 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.108715    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-secret-telemeter-client\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.109764 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.109731    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-metrics-client-ca\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.109978 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.109737    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-serving-certs-ca-bundle\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.110048 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.109973    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36e8a1ce-225a-495f-8db9-646f3f24cd3e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.111654 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.111633    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-secret-telemeter-client\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.111770 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.111695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-federate-client-tls\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.111980 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.111961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.112155 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.112135    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/36e8a1ce-225a-495f-8db9-646f3f24cd3e-telemeter-client-tls\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.116488 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.116459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdjv2\" (UniqueName: \"kubernetes.io/projected/36e8a1ce-225a-495f-8db9-646f3f24cd3e-kube-api-access-qdjv2\") pod \"telemeter-client-6dc5fcff4f-s2vnm\" (UID: \"36e8a1ce-225a-495f-8db9-646f3f24cd3e\") " pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.136773 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.136749    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:40.209613 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.209579    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:40.222010 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.221985    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"
Aug 02 10:39:40.268366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.268257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:40.357082 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:40.357041    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm"]
Aug 02 10:39:40.361439 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:39:40.361411    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36e8a1ce_225a_495f_8db9_646f3f24cd3e.slice/crio-948951c275e106934752cda8886563ea8c5e3c4600a058e5c2fc0d512bc48cef WatchSource:0}: Error finding container 948951c275e106934752cda8886563ea8c5e3c4600a058e5c2fc0d512bc48cef: Status 404 returned error can't find the container with id 948951c275e106934752cda8886563ea8c5e3c4600a058e5c2fc0d512bc48cef
Aug 02 10:39:41.043802 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:41.043756    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm" event={"ID":"36e8a1ce-225a-495f-8db9-646f3f24cd3e","Type":"ContainerStarted","Data":"948951c275e106934752cda8886563ea8c5e3c4600a058e5c2fc0d512bc48cef"}
Aug 02 10:39:43.053165 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:43.053126    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm" event={"ID":"36e8a1ce-225a-495f-8db9-646f3f24cd3e","Type":"ContainerStarted","Data":"4193ad6a0933812ca553af839e7f247e9dfcff8e5f5b6cd380d44c21a9f4a5d1"}
Aug 02 10:39:44.058961 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.058926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm" event={"ID":"36e8a1ce-225a-495f-8db9-646f3f24cd3e","Type":"ContainerStarted","Data":"0800fedc86c66a61597cc036d58e539df5a3918e7780cb4e06966265c17376a5"}
Aug 02 10:39:44.059398 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.058980    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm" event={"ID":"36e8a1ce-225a-495f-8db9-646f3f24cd3e","Type":"ContainerStarted","Data":"8760982eb07bc23839ec40f7ee003d64322c4b381d92ce5f851f6946481774c3"}
Aug 02 10:39:44.081481 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.081418    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6dc5fcff4f-s2vnm" podStartSLOduration=2.156417411 podStartE2EDuration="5.081397144s" totalImagesPullingTime="2.924979733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:39:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:39:44.078840544 +0000 UTC m=+379.737058136" watchObservedRunningTime="2026-08-02 10:39:44.081397144 +0000 UTC m=+379.739614735"
Aug 02 10:39:44.166988 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.166954    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-87d4c5cbb-pltfr"]
Aug 02 10:39:44.172740 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.172715    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.175321 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.175299    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zzcmq\""
Aug 02 10:39:44.175795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.175306    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 02 10:39:44.175893 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.175362    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 02 10:39:44.176025 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.175418    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 02 10:39:44.176025 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.175507    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 02 10:39:44.176025 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.175553    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 02 10:39:44.180077 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.180054    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87d4c5cbb-pltfr"]
Aug 02 10:39:44.181099 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.181080    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 02 10:39:44.226151 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.226108    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:44.244212 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244182    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ws8k\" (UniqueName: \"kubernetes.io/projected/1bae598f-6922-49d5-ae17-58db5f774422-kube-api-access-6ws8k\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.244369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244218    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-service-ca\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.244369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244251    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-oauth-config\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.244369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-serving-cert\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.244369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244308    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-console-config\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.244369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244323    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-oauth-serving-cert\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.244369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.244341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-trusted-ca-bundle\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.326353 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.326231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:44.345295 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345253    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-oauth-config\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.345378 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345307    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-serving-cert\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.345378 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-console-config\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.345378 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-oauth-serving-cert\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.345515 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345400    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-trusted-ca-bundle\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.345515 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345451    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ws8k\" (UniqueName: \"kubernetes.io/projected/1bae598f-6922-49d5-ae17-58db5f774422-kube-api-access-6ws8k\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.345515 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.345482    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-service-ca\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.346179 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.346153    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-console-config\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.346413 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.346395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-trusted-ca-bundle\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.346485 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.346400    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-service-ca\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.346485 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.346459    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-oauth-serving-cert\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.347902 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.347881    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-serving-cert\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.348062 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.348043    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-oauth-config\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.354596 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.354572    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ws8k\" (UniqueName: \"kubernetes.io/projected/1bae598f-6922-49d5-ae17-58db5f774422-kube-api-access-6ws8k\") pod \"console-87d4c5cbb-pltfr\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") " pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.485312 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.485247    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:44.610280 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:44.610097    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-87d4c5cbb-pltfr"]
Aug 02 10:39:44.612968 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:39:44.612934    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bae598f_6922_49d5_ae17_58db5f774422.slice/crio-164f701e1e1c1eead7556d382989713071eebc054d04bf479df4c5b185e698c8 WatchSource:0}: Error finding container 164f701e1e1c1eead7556d382989713071eebc054d04bf479df4c5b185e698c8: Status 404 returned error can't find the container with id 164f701e1e1c1eead7556d382989713071eebc054d04bf479df4c5b185e698c8
Aug 02 10:39:45.064174 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:45.064130    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87d4c5cbb-pltfr" event={"ID":"1bae598f-6922-49d5-ae17-58db5f774422","Type":"ContainerStarted","Data":"fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3"}
Aug 02 10:39:45.064654 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:45.064191    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87d4c5cbb-pltfr" event={"ID":"1bae598f-6922-49d5-ae17-58db5f774422","Type":"ContainerStarted","Data":"164f701e1e1c1eead7556d382989713071eebc054d04bf479df4c5b185e698c8"}
Aug 02 10:39:45.080018 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:45.079975    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-87d4c5cbb-pltfr" podStartSLOduration=1.07995694 podStartE2EDuration="1.07995694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:39:45.078958832 +0000 UTC m=+380.737176447" watchObservedRunningTime="2026-08-02 10:39:45.07995694 +0000 UTC m=+380.738174534"
Aug 02 10:39:54.485759 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:54.485722    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:54.486215 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:54.485781    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:54.490704 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:54.490680    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:55.104242 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:55.104212    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:39:55.261943 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:55.261912    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:55.362776 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:55.362690    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:39:55.418752 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:39:55.418709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:32.837013 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:32.836976    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:32.937820 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:32.937786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:50.024731 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:50.024648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:50.078990 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:50.078958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:53.130142 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:53.130111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:53.208433 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:53.208391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:53.271251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:53.271221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:53.854920 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:53.854890    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:40:53.957795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:40:53.957767    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:01.923184 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:01.923152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:01.977876 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:01.977854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:03.538533 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:03.538492    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87d4c5cbb-pltfr"]
Aug 02 10:41:03.663894 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:03.663857    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:03.767700 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:03.767661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:03.834420 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:03.834341    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:06.624656 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:06.624618    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:09.597058 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:09.597025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:09.694328 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:09.694293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:09.947081 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:09.947052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:11.541437 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:11.541398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:11.637456 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:11.637422    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:15.101048 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:15.100991    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:15.157941 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:15.157906    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:28.562536 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.562473    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-87d4c5cbb-pltfr" podUID="1bae598f-6922-49d5-ae17-58db5f774422" containerName="console" containerID="cri-o://fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3" gracePeriod=15
Aug 02 10:41:28.795866 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.795843    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:41:28.850248 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850162    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-oauth-config\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850248 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850203    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-trusted-ca-bundle\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850248 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-service-ca\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850541 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850253    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-oauth-serving-cert\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850541 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850315    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ws8k\" (UniqueName: \"kubernetes.io/projected/1bae598f-6922-49d5-ae17-58db5f774422-kube-api-access-6ws8k\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850541 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850347    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-serving-cert\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850541 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850372    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-console-config\") pod \"1bae598f-6922-49d5-ae17-58db5f774422\" (UID: \"1bae598f-6922-49d5-ae17-58db5f774422\") "
Aug 02 10:41:28.850744 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850656    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:41:28.850744 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850666    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:41:28.850744 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850716    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:41:28.850893 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.850858    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-console-config" (OuterVolumeSpecName: "console-config") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 10:41:28.852644 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.852601    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 10:41:28.852948 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.852928    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bae598f-6922-49d5-ae17-58db5f774422-kube-api-access-6ws8k" (OuterVolumeSpecName: "kube-api-access-6ws8k") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "kube-api-access-6ws8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 10:41:28.853157 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.853141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bae598f-6922-49d5-ae17-58db5f774422" (UID: "1bae598f-6922-49d5-ae17-58db5f774422"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 10:41:28.868867 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.868844    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"]
Aug 02 10:41:28.869095 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.869084    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bae598f-6922-49d5-ae17-58db5f774422" containerName="console"
Aug 02 10:41:28.869140 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.869097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bae598f-6922-49d5-ae17-58db5f774422" containerName="console"
Aug 02 10:41:28.869173 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.869146    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bae598f-6922-49d5-ae17-58db5f774422" containerName="console"
Aug 02 10:41:28.872078 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.872062    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:28.874387 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.874349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:28.874535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.874517    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pw5js\""
Aug 02 10:41:28.874584 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.874539    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 02 10:41:28.874770 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.874759    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 02 10:41:28.875526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.875512    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Aug 02 10:41:28.875669 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.875654    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 02 10:41:28.882531 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.882489    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"]
Aug 02 10:41:28.949538 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.949505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:28.951646 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/e9084fe8-a8e3-4f0a-9848-979e1e92866d-kube-api-access-mj99x\") pod \"managed-serviceaccount-addon-agent-b74568756-xbws6\" (UID: \"e9084fe8-a8e3-4f0a-9848-979e1e92866d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:28.951714 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9084fe8-a8e3-4f0a-9848-979e1e92866d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b74568756-xbws6\" (UID: \"e9084fe8-a8e3-4f0a-9848-979e1e92866d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:28.951773 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951749    2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-oauth-serving-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.951773 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951763    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ws8k\" (UniqueName: \"kubernetes.io/projected/1bae598f-6922-49d5-ae17-58db5f774422-kube-api-access-6ws8k\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.951773 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951772    2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-serving-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.951869 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951780    2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-console-config\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.951869 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951790    2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bae598f-6922-49d5-ae17-58db5f774422-console-oauth-config\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.951869 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951805    2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-trusted-ca-bundle\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.951869 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.951815    2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bae598f-6922-49d5-ae17-58db5f774422-service-ca\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:41:28.985640 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.985604    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"]
Aug 02 10:41:28.988795 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.988775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:28.990900 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.990881    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Aug 02 10:41:28.991326 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.991305    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Aug 02 10:41:28.991326 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.991320    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Aug 02 10:41:28.991467 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:28.991367    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Aug 02 10:41:29.000151 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.000129    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"]
Aug 02 10:41:29.022351 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.022323    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:41:29.053059 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053031    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9084fe8-a8e3-4f0a-9848-979e1e92866d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b74568756-xbws6\" (UID: \"e9084fe8-a8e3-4f0a-9848-979e1e92866d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:29.053224 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053066    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.053224 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053110    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.053224 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053126    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.053224 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053147    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7nv2\" (UniqueName: \"kubernetes.io/projected/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-kube-api-access-b7nv2\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.053224 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053179    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-ca\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.053486 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/e9084fe8-a8e3-4f0a-9848-979e1e92866d-kube-api-access-mj99x\") pod \"managed-serviceaccount-addon-agent-b74568756-xbws6\" (UID: \"e9084fe8-a8e3-4f0a-9848-979e1e92866d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:29.053486 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.053299    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-hub\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.055704 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.055685    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9084fe8-a8e3-4f0a-9848-979e1e92866d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b74568756-xbws6\" (UID: \"e9084fe8-a8e3-4f0a-9848-979e1e92866d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:29.061585 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.061570    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj99x\" (UniqueName: \"kubernetes.io/projected/e9084fe8-a8e3-4f0a-9848-979e1e92866d-kube-api-access-mj99x\") pod \"managed-serviceaccount-addon-agent-b74568756-xbws6\" (UID: \"e9084fe8-a8e3-4f0a-9848-979e1e92866d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:29.154322 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.154287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.154506 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.154349    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.154506 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.154384    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.154506 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.154402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7nv2\" (UniqueName: \"kubernetes.io/projected/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-kube-api-access-b7nv2\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.154506 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.154425    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-ca\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.154506 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.154448    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-hub\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.155161 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.155130    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.156962 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.156939    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.157058 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.156974    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.157058 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.156976    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-ca\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.157058 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.156993    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-hub\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.162929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.162913    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7nv2\" (UniqueName: \"kubernetes.io/projected/860adc32-76ef-4bbe-b5bc-d4a5a17c167e-kube-api-access-b7nv2\") pod \"cluster-proxy-proxy-agent-5f56f959cb-xcv84\" (UID: \"860adc32-76ef-4bbe-b5bc-d4a5a17c167e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.189301 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.189277    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"
Aug 02 10:41:29.297376 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.297347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"
Aug 02 10:41:29.317827 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.317804    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6"]
Aug 02 10:41:29.319560 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:41:29.319529    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9084fe8_a8e3_4f0a_9848_979e1e92866d.slice/crio-994838e85baa98711de916e405066706e60a138ef72a2f740c5be332af159589 WatchSource:0}: Error finding container 994838e85baa98711de916e405066706e60a138ef72a2f740c5be332af159589: Status 404 returned error can't find the container with id 994838e85baa98711de916e405066706e60a138ef72a2f740c5be332af159589
Aug 02 10:41:29.424647 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.424567    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84"]
Aug 02 10:41:29.428042 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:41:29.428015    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod860adc32_76ef_4bbe_b5bc_d4a5a17c167e.slice/crio-b2b0e39c969199ccbf798a3abc179d95eba4e3bfda32d70e38259cec096233f6 WatchSource:0}: Error finding container b2b0e39c969199ccbf798a3abc179d95eba4e3bfda32d70e38259cec096233f6: Status 404 returned error can't find the container with id b2b0e39c969199ccbf798a3abc179d95eba4e3bfda32d70e38259cec096233f6
Aug 02 10:41:29.445023 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.444997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84" event={"ID":"860adc32-76ef-4bbe-b5bc-d4a5a17c167e","Type":"ContainerStarted","Data":"b2b0e39c969199ccbf798a3abc179d95eba4e3bfda32d70e38259cec096233f6"}
Aug 02 10:41:29.446196 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.446174    2563 generic.go:356] "Generic (PLEG): container finished" podID="1bae598f-6922-49d5-ae17-58db5f774422" containerID="fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3" exitCode=0
Aug 02 10:41:29.446307 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.446234    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-87d4c5cbb-pltfr"
Aug 02 10:41:29.446307 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.446271    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87d4c5cbb-pltfr" event={"ID":"1bae598f-6922-49d5-ae17-58db5f774422","Type":"ContainerDied","Data":"fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3"}
Aug 02 10:41:29.446464 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.446319    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-87d4c5cbb-pltfr" event={"ID":"1bae598f-6922-49d5-ae17-58db5f774422","Type":"ContainerDied","Data":"164f701e1e1c1eead7556d382989713071eebc054d04bf479df4c5b185e698c8"}
Aug 02 10:41:29.446464 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.446345    2563 scope.go:117] "RemoveContainer" containerID="fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3"
Aug 02 10:41:29.447487 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.447466    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6" event={"ID":"e9084fe8-a8e3-4f0a-9848-979e1e92866d","Type":"ContainerStarted","Data":"994838e85baa98711de916e405066706e60a138ef72a2f740c5be332af159589"}
Aug 02 10:41:29.454796 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.454781    2563 scope.go:117] "RemoveContainer" containerID="fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3"
Aug 02 10:41:29.455041 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:41:29.455022    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3\": container with ID starting with fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3 not found: ID does not exist" containerID="fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3"
Aug 02 10:41:29.455108 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.455060    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3"} err="failed to get container status \"fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3\": rpc error: code = NotFound desc = could not find container \"fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3\": container with ID starting with fa69bf193e8397d3d2276798638d5a6f836ad6689ce55b3334a0d4e1beb7cdd3 not found: ID does not exist"
Aug 02 10:41:29.466343 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.466324    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-87d4c5cbb-pltfr"]
Aug 02 10:41:29.469707 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:29.469690    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-87d4c5cbb-pltfr"]
Aug 02 10:41:30.847377 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:30.847333    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bae598f-6922-49d5-ae17-58db5f774422" path="/var/lib/kubelet/pods/1bae598f-6922-49d5-ae17-58db5f774422/volumes"
Aug 02 10:41:33.473467 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:33.473436    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84" event={"ID":"860adc32-76ef-4bbe-b5bc-d4a5a17c167e","Type":"ContainerStarted","Data":"0fa7aa3c744100976216608478d8a5f5bff937faeda06e286f7e3ea9433895ba"}
Aug 02 10:41:33.473845 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:33.473478    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84" event={"ID":"860adc32-76ef-4bbe-b5bc-d4a5a17c167e","Type":"ContainerStarted","Data":"15f43eb304ebd326b16681619e0dbee88f48105240e68e0c139e040ecce6454d"}
Aug 02 10:41:33.473845 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:33.473490    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84" event={"ID":"860adc32-76ef-4bbe-b5bc-d4a5a17c167e","Type":"ContainerStarted","Data":"929add8e87adcb2947b30fd028ab8e78975c85a81606c3184417b4c165a8f5c3"}
Aug 02 10:41:38.494320 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:38.494213    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6" event={"ID":"e9084fe8-a8e3-4f0a-9848-979e1e92866d","Type":"ContainerStarted","Data":"aac7bd101f59cea6d4b1a2d7936d39996bb7ea5d890d902c2ff44fd6859570cc"}
Aug 02 10:41:38.510691 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:38.510639    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b74568756-xbws6" podStartSLOduration=1.587019862 podStartE2EDuration="10.510622641s" totalImagesPullingTime="8.923602779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:41:38.509823683 +0000 UTC m=+494.168041273" watchObservedRunningTime="2026-08-02 10:41:38.510622641 +0000 UTC m=+494.168840231"
Aug 02 10:41:38.510945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:41:38.510926    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5f56f959cb-xcv84" podStartSLOduration=7.227927047 podStartE2EDuration="10.510920567s" totalImagesPullingTime="3.28299352s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:41:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:41:33.495029594 +0000 UTC m=+489.153247183" watchObservedRunningTime="2026-08-02 10:41:38.510920567 +0000 UTC m=+494.169138170"
Aug 02 10:42:02.703273 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:02.703239    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:02.800216 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:02.800181    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:24.630670 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:24.630590    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:25.626211 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:25.626178    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:28.239807 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:28.239776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:28.338975 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:28.338941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:30.149905 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:30.149871    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:30.264435 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:30.264406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:30.473390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:30.473318    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:32.615308 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:32.615249    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:32.829802 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:32.829770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:35.232823 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:35.232789    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:35.347546 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:35.347511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:39.828067 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:39.828025    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:41.055737 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:41.055709    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:41.150552 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:41.150517    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:47.576546 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:47.576511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:47.681828 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:47.681795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:49.263695 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:49.263661    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:42:58.243578 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:42:58.243547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:01.459251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:01.459220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:01.555636 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:01.555606    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:02.086751 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.086719    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:02.415189 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.415157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:02.511978 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.511947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:02.581427 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.581394    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"]
Aug 02 10:43:02.584540 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.584524    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.586819 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.586798    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 02 10:43:02.586963 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.586878    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 02 10:43:02.587475 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.587459    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 02 10:43:02.587558 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.587504    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-64kwn\""
Aug 02 10:43:02.587964 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.587949    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 02 10:43:02.604451 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.604431    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"]
Aug 02 10:43:02.681366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.681282    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.681366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.681329    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9vm7\" (UniqueName: \"kubernetes.io/projected/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-kube-api-access-q9vm7\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.681366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.681359    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-tmp\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.681571 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.681440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.681571 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.681472    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-manifests\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.684688 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.684667    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:02.781945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.781908    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.781945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.781951    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-manifests\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.782133 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.782078    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.782133 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.782112    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9vm7\" (UniqueName: \"kubernetes.io/projected/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-kube-api-access-q9vm7\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.782208 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.782149    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-tmp\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.782396 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.782377    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-manifests\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.784501 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.784475    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-tmp\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.784625 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.784576    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.784759 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.784740    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.785455 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.785433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:02.789662 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.789640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9vm7\" (UniqueName: \"kubernetes.io/projected/ae18dfe4-042c-4cae-8c6d-eda5ef65095f-kube-api-access-q9vm7\") pod \"opendatahub-operator-controller-manager-7f6ffbd656-kwdsv\" (UID: \"ae18dfe4-042c-4cae-8c6d-eda5ef65095f\") " pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.894579 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.894534    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:02.897457 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:02.897430    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:03.003503 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.003476    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:03.036092 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.036064    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"]
Aug 02 10:43:03.039634 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:43:03.039603    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae18dfe4_042c_4cae_8c6d_eda5ef65095f.slice/crio-dca777c9b6de1430af398f56b176e1128b5f08a8d9295327b4fe90ffb027982a WatchSource:0}: Error finding container dca777c9b6de1430af398f56b176e1128b5f08a8d9295327b4fe90ffb027982a: Status 404 returned error can't find the container with id dca777c9b6de1430af398f56b176e1128b5f08a8d9295327b4fe90ffb027982a
Aug 02 10:43:03.084965 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.084941    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:03.181625 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.181587    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:03.633767 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.633721    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:03.732809 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.732746    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:03.806766 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:03.806732    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv" event={"ID":"ae18dfe4-042c-4cae-8c6d-eda5ef65095f","Type":"ContainerStarted","Data":"dca777c9b6de1430af398f56b176e1128b5f08a8d9295327b4fe90ffb027982a"}
Aug 02 10:43:06.819811 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:06.819779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv" event={"ID":"ae18dfe4-042c-4cae-8c6d-eda5ef65095f","Type":"ContainerStarted","Data":"fec56cd0e01a73dd8d4e0dbadff28bec6903913ae6716bc387bf3b0560bdb25f"}
Aug 02 10:43:07.825545 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:07.825508    2563 generic.go:356] "Generic (PLEG): container finished" podID="ae18dfe4-042c-4cae-8c6d-eda5ef65095f" containerID="fec56cd0e01a73dd8d4e0dbadff28bec6903913ae6716bc387bf3b0560bdb25f" exitCode=0
Aug 02 10:43:07.825936 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:07.825567    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv" event={"ID":"ae18dfe4-042c-4cae-8c6d-eda5ef65095f","Type":"ContainerDied","Data":"fec56cd0e01a73dd8d4e0dbadff28bec6903913ae6716bc387bf3b0560bdb25f"}
Aug 02 10:43:08.831570 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:08.831528    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv" event={"ID":"ae18dfe4-042c-4cae-8c6d-eda5ef65095f","Type":"ContainerStarted","Data":"7ab1234272f9399306fac28f679d894235214f638edb272751eab8d45690282b"}
Aug 02 10:43:08.831983 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:08.831654    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:08.870759 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:08.870709    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv" podStartSLOduration=2.699989847 podStartE2EDuration="6.87069453s" totalImagesPullingTime="3.117109493s" totalInitContainerRuntime="1.05359519s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:08.869193535 +0000 UTC m=+584.527411125" watchObservedRunningTime="2026-08-02 10:43:08.87069453 +0000 UTC m=+584.528912119"
Aug 02 10:43:19.837736 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:19.837708    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f6ffbd656-kwdsv"
Aug 02 10:43:21.563473 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:21.563433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:22.866118 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:22.866084    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:24.742800 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:24.742771    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:43:24.742800 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:24.742801    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:43:25.808183 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:25.808148    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:25.882448 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:25.882413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:25.952577 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:25.952548    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:26.544434 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:26.544406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:26.608106 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:26.608068    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:32.448488 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.448459    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:32.525283 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.525232    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"]
Aug 02 10:43:32.527481 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.527461    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.530208 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.530183    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 02 10:43:32.530208 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.530193    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 02 10:43:32.530819 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.530798    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 02 10:43:32.530916 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.530801    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 02 10:43:32.530916 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.530839    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-j96wz\""
Aug 02 10:43:32.546629 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.546605    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"]
Aug 02 10:43:32.588097 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.588074    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:32.630407 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.630379    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af8c5597-9f42-4d33-a525-3fc396315309-tmp\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.630514 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.630408    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hknv\" (UniqueName: \"kubernetes.io/projected/af8c5597-9f42-4d33-a525-3fc396315309-kube-api-access-7hknv\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.630514 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.630436    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af8c5597-9f42-4d33-a525-3fc396315309-tls-certs\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.697901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.697868    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:32.731005 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.730936    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af8c5597-9f42-4d33-a525-3fc396315309-tmp\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.731005 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.730964    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hknv\" (UniqueName: \"kubernetes.io/projected/af8c5597-9f42-4d33-a525-3fc396315309-kube-api-access-7hknv\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.731005 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.731003    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af8c5597-9f42-4d33-a525-3fc396315309-tls-certs\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.733399 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.733372    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af8c5597-9f42-4d33-a525-3fc396315309-tmp\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.733676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.733657    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af8c5597-9f42-4d33-a525-3fc396315309-tls-certs\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.738828 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.738806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hknv\" (UniqueName: \"kubernetes.io/projected/af8c5597-9f42-4d33-a525-3fc396315309-kube-api-access-7hknv\") pod \"kube-auth-proxy-7c47d49594-xc85k\" (UID: \"af8c5597-9f42-4d33-a525-3fc396315309\") " pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.766436 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.766413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:32.837923 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.837889    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"
Aug 02 10:43:32.971083 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:32.971058    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c47d49594-xc85k"]
Aug 02 10:43:32.973598 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:43:32.973570    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf8c5597_9f42_4d33_a525_3fc396315309.slice/crio-628ed518252dad9b6c20c148e95a53794c69aeea02124b191f19905d97262063 WatchSource:0}: Error finding container 628ed518252dad9b6c20c148e95a53794c69aeea02124b191f19905d97262063: Status 404 returned error can't find the container with id 628ed518252dad9b6c20c148e95a53794c69aeea02124b191f19905d97262063
Aug 02 10:43:33.321808 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:33.321775    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:33.445220 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:33.445187    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:33.536582 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:33.536522    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:33.869642 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:33.869584    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:33.936347 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:33.936308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k" event={"ID":"af8c5597-9f42-4d33-a525-3fc396315309","Type":"ContainerStarted","Data":"628ed518252dad9b6c20c148e95a53794c69aeea02124b191f19905d97262063"}
Aug 02 10:43:33.969561 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:33.969512    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:35.402732 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:35.402676    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:35.946823 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:35.946739    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k" event={"ID":"af8c5597-9f42-4d33-a525-3fc396315309","Type":"ContainerStarted","Data":"288b04d9b8af313c1e98ab102a129ca07a9c08bf7e9c45af8b582785c82610c8"}
Aug 02 10:43:35.967425 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:35.967378    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c47d49594-xc85k" podStartSLOduration=1.307872663 podStartE2EDuration="3.967362768s" totalImagesPullingTime="2.659490105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:35.966532585 +0000 UTC m=+611.624750176" watchObservedRunningTime="2026-08-02 10:43:35.967362768 +0000 UTC m=+611.625580359"
Aug 02 10:43:36.408405 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:36.408372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:36.509402 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:36.509370    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:36.631246 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:36.631215    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:39.778563 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:39.778529    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:39.891089 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:39.891055    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:40.099020 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.098947    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"]
Aug 02 10:43:40.102210 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.102194    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.104827 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.104805    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 02 10:43:40.105251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.105237    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-9jmn5\""
Aug 02 10:43:40.117825 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.117802    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"]
Aug 02 10:43:40.151410 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.151381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:40.195461 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195575 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195466    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195575 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195505    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195575 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195560    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195671 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195585    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195671 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195608    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195671 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj4rx\" (UniqueName: \"kubernetes.io/projected/1358d3dd-cb4f-485a-bf07-2df43fbfe196-kube-api-access-gj4rx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195699    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.195762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.195727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296693 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296664    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296693 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296880 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296717    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296880 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296757    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj4rx\" (UniqueName: \"kubernetes.io/projected/1358d3dd-cb4f-485a-bf07-2df43fbfe196-kube-api-access-gj4rx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296880 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296792    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296880 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296819    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.296880 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296868    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297092 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296892    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297092 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.296934    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297286 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.297239    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297388 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.297356    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297447 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.297412    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297609 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.297466    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.297716 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.297640    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.299282 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.299244    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.299423 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.299406    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.312656 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.312636    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj4rx\" (UniqueName: \"kubernetes.io/projected/1358d3dd-cb4f-485a-bf07-2df43fbfe196-kube-api-access-gj4rx\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.313348 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.313333    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1358d3dd-cb4f-485a-bf07-2df43fbfe196-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt\" (UID: \"1358d3dd-cb4f-485a-bf07-2df43fbfe196\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.412779 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.412748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:40.564256 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.564226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:40.622038 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.622014    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"]
Aug 02 10:43:40.623989 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:43:40.623967    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1358d3dd_cb4f_485a_bf07_2df43fbfe196.slice/crio-30b4759bf663d9d54524d75c1ae7244bddade1bbaa58e12145ddd9827733db59 WatchSource:0}: Error finding container 30b4759bf663d9d54524d75c1ae7244bddade1bbaa58e12145ddd9827733db59: Status 404 returned error can't find the container with id 30b4759bf663d9d54524d75c1ae7244bddade1bbaa58e12145ddd9827733db59
Aug 02 10:43:40.772466 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.772389    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:40.860737 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.860708    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"]
Aug 02 10:43:40.865018 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.865003    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:40.868223 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.868203    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 02 10:43:40.868535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.868522    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 02 10:43:40.868602 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.868569    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 02 10:43:40.868850 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.868836    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-54cq6\""
Aug 02 10:43:40.868905 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.868863    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 02 10:43:40.869310 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.869295    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 02 10:43:40.874920 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.874901    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"]
Aug 02 10:43:40.901957 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.901931    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf57j\" (UniqueName: \"kubernetes.io/projected/a56cd232-9093-4c45-9259-c2a39d1ad3eb-kube-api-access-sf57j\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:40.902094 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.901976    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a56cd232-9093-4c45-9259-c2a39d1ad3eb-cert\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:40.902094 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.901996    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a56cd232-9093-4c45-9259-c2a39d1ad3eb-metrics-cert\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:40.902094 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.902063    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a56cd232-9093-4c45-9259-c2a39d1ad3eb-manager-config\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:40.969901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:40.969869    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt" event={"ID":"1358d3dd-cb4f-485a-bf07-2df43fbfe196","Type":"ContainerStarted","Data":"30b4759bf663d9d54524d75c1ae7244bddade1bbaa58e12145ddd9827733db59"}
Aug 02 10:43:41.003363 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.003329    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf57j\" (UniqueName: \"kubernetes.io/projected/a56cd232-9093-4c45-9259-c2a39d1ad3eb-kube-api-access-sf57j\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.003517 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.003383    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a56cd232-9093-4c45-9259-c2a39d1ad3eb-cert\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.003517 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.003402    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a56cd232-9093-4c45-9259-c2a39d1ad3eb-metrics-cert\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.003517 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.003435    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a56cd232-9093-4c45-9259-c2a39d1ad3eb-manager-config\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.004212 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.004136    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/a56cd232-9093-4c45-9259-c2a39d1ad3eb-manager-config\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.005959 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.005937    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/a56cd232-9093-4c45-9259-c2a39d1ad3eb-metrics-cert\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.006039 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.005999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a56cd232-9093-4c45-9259-c2a39d1ad3eb-cert\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.022316 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.022294    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf57j\" (UniqueName: \"kubernetes.io/projected/a56cd232-9093-4c45-9259-c2a39d1ad3eb-kube-api-access-sf57j\") pod \"lws-controller-manager-669466dd64-lr9k9\" (UID: \"a56cd232-9093-4c45-9259-c2a39d1ad3eb\") " pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.175170 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.175141    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:41.308492 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.308458    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"]
Aug 02 10:43:41.311641 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:43:41.311617    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda56cd232_9093_4c45_9259_c2a39d1ad3eb.slice/crio-3524e38a264e5896278bc4b857899e4483911c006c1b8a878baac03dda1abf10 WatchSource:0}: Error finding container 3524e38a264e5896278bc4b857899e4483911c006c1b8a878baac03dda1abf10: Status 404 returned error can't find the container with id 3524e38a264e5896278bc4b857899e4483911c006c1b8a878baac03dda1abf10
Aug 02 10:43:41.976661 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:41.976625    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9" event={"ID":"a56cd232-9093-4c45-9259-c2a39d1ad3eb","Type":"ContainerStarted","Data":"3524e38a264e5896278bc4b857899e4483911c006c1b8a878baac03dda1abf10"}
Aug 02 10:43:43.675529 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:43.675410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:43.806569 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:43.806525    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:43.949159 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:43.949080    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:44.077393 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.077360    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:44.584433 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.584393    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 10:43:44.584526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.584463    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 10:43:44.584526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.584489    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 10:43:44.993037 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.992999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt" event={"ID":"1358d3dd-cb4f-485a-bf07-2df43fbfe196","Type":"ContainerStarted","Data":"388e26a6a40e1b38a8e79f439927eb8906c131492f0545cf30989320505f2ea0"}
Aug 02 10:43:44.994541 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.994512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9" event={"ID":"a56cd232-9093-4c45-9259-c2a39d1ad3eb","Type":"ContainerStarted","Data":"7533bce042bfc0482bf36bb6e994a5a9ce0e13fda07898cb8cb21266d7f1802e"}
Aug 02 10:43:44.994662 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:44.994564    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:45.020338 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.020289    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt" podStartSLOduration=1.062065196 podStartE2EDuration="5.020254112s" totalImagesPullingTime="3.958188916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:45.01911867 +0000 UTC m=+620.677336285" watchObservedRunningTime="2026-08-02 10:43:45.020254112 +0000 UTC m=+620.678471703"
Aug 02 10:43:45.032313 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.032280    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:45.041255 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.041217    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9" podStartSLOduration=1.7123429350000001 podStartE2EDuration="5.04120373s" totalImagesPullingTime="3.328860795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:43:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:43:45.039964199 +0000 UTC m=+620.698181789" watchObservedRunningTime="2026-08-02 10:43:45.04120373 +0000 UTC m=+620.699421320"
Aug 02 10:43:45.112362 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.112328    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:45.413612 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.413581    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:45.418208 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.418183    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:45.999313 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:45.999257    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:46.000207 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:46.000193    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt"
Aug 02 10:43:55.084819 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:55.084783    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:56.001374 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:56.001340    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-669466dd64-lr9k9"
Aug 02 10:43:56.838641 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:56.838605    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:43:56.939727 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:43:56.939692    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:03.144958 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:03.144922    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:03.212713 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:03.212684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:23.325548 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:23.325505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:23.420834 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:23.420799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:35.834430 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:35.834391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:36.627373 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:36.627334    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:37.435232 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:37.435204    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:39.699277 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:39.699237    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:39.867604 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:39.867574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:40.636451 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:40.636421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:41.030923 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:41.030884    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:41.424764 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:41.424729    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:43.658995 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:43.658962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:43.767332 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:43.767300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:45.885507 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:45.885470    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:46.125018 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:46.124980    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:47.810203 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:47.810171    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:47.984915 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:47.984878    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:50.644516 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:50.644481    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:50.711167 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:50.711135    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:51.038860 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:51.038781    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:51.095405 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:51.095372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:51.439462 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:51.439433    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:51.508497 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:51.508460    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:59.497248 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:59.497218    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:44:59.596465 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:44:59.596436    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:02.515132 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:02.515097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:02.642875 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:02.642842    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:04.903771 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:04.903735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:05.004875 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:05.004845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:11.965537 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:11.965504    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:12.065086 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:12.065048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:12.265549 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:12.265461    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:12.361056 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:12.361028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:12.459412 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:12.459381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:12.561650 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:12.561569    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:17.768030 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:17.767936    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:21.273502 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:21.273468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:21.373093 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:21.373061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:24.271015 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:24.270978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:24.373930 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:24.373901    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:26.706787 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:26.706748    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:26.805516 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:26.805477    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:28.013014 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:28.012985    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:28.165889 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:28.165852    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:30.053127 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:30.053092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:30.156939 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:30.156902    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:32.789062 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:32.789015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:32.899131 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:32.899098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:32.999599 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:32.999554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:33.744773 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.744736    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-zkgmp"]
Aug 02 10:45:33.747898 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.747877    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:33.749891 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.749861    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 02 10:45:33.750534 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.750495    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 02 10:45:33.750654 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.750576    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jq9l6\""
Aug 02 10:45:33.760119 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.760098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-zkgmp"]
Aug 02 10:45:33.784618 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.784593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:33.851185 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.851160    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv7pp\" (UniqueName: \"kubernetes.io/projected/9427aa0d-8f02-4c58-959f-f21193f66663-kube-api-access-hv7pp\") pod \"authorino-b54df94b4-zkgmp\" (UID: \"9427aa0d-8f02-4c58-959f-f21193f66663\") " pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:33.867460 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.867434    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:33.952396 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.952361    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv7pp\" (UniqueName: \"kubernetes.io/projected/9427aa0d-8f02-4c58-959f-f21193f66663-kube-api-access-hv7pp\") pod \"authorino-b54df94b4-zkgmp\" (UID: \"9427aa0d-8f02-4c58-959f-f21193f66663\") " pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:33.960677 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:33.960645    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv7pp\" (UniqueName: \"kubernetes.io/projected/9427aa0d-8f02-4c58-959f-f21193f66663-kube-api-access-hv7pp\") pod \"authorino-b54df94b4-zkgmp\" (UID: \"9427aa0d-8f02-4c58-959f-f21193f66663\") " pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:34.056436 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:34.056346    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:34.187657 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:34.187633    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-zkgmp"]
Aug 02 10:45:34.190230 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:45:34.190204    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9427aa0d_8f02_4c58_959f_f21193f66663.slice/crio-d30c3518787d8b9407d2b8aaf6bf76169bb41e6351ffb451e0e943c0dc16a2a3 WatchSource:0}: Error finding container d30c3518787d8b9407d2b8aaf6bf76169bb41e6351ffb451e0e943c0dc16a2a3: Status 404 returned error can't find the container with id d30c3518787d8b9407d2b8aaf6bf76169bb41e6351ffb451e0e943c0dc16a2a3
Aug 02 10:45:34.191584 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:34.191564    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 02 10:45:34.450215 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:34.450184    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-zkgmp" event={"ID":"9427aa0d-8f02-4c58-959f-f21193f66663","Type":"ContainerStarted","Data":"d30c3518787d8b9407d2b8aaf6bf76169bb41e6351ffb451e0e943c0dc16a2a3"}
Aug 02 10:45:36.881028 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:36.880993    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-zkgmp"]
Aug 02 10:45:37.465984 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:37.465948    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-zkgmp" event={"ID":"9427aa0d-8f02-4c58-959f-f21193f66663","Type":"ContainerStarted","Data":"47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89"}
Aug 02 10:45:37.481899 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:37.481855    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-zkgmp" podStartSLOduration=1.937252467 podStartE2EDuration="4.481840848s" totalImagesPullingTime="2.544588381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:45:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:45:37.481610463 +0000 UTC m=+733.139828053" watchObservedRunningTime="2026-08-02 10:45:37.481840848 +0000 UTC m=+733.140058453"
Aug 02 10:45:38.470302 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:38.470246    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-zkgmp" podUID="9427aa0d-8f02-4c58-959f-f21193f66663" containerName="authorino" containerID="cri-o://47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89" gracePeriod=30
Aug 02 10:45:38.704688 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:38.704667    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:38.797892 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:38.797813    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hv7pp\" (UniqueName: \"kubernetes.io/projected/9427aa0d-8f02-4c58-959f-f21193f66663-kube-api-access-hv7pp\") pod \"9427aa0d-8f02-4c58-959f-f21193f66663\" (UID: \"9427aa0d-8f02-4c58-959f-f21193f66663\") "
Aug 02 10:45:38.800073 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:38.800046    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9427aa0d-8f02-4c58-959f-f21193f66663-kube-api-access-hv7pp" (OuterVolumeSpecName: "kube-api-access-hv7pp") pod "9427aa0d-8f02-4c58-959f-f21193f66663" (UID: "9427aa0d-8f02-4c58-959f-f21193f66663"). InnerVolumeSpecName "kube-api-access-hv7pp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 10:45:38.899187 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:38.899154    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hv7pp\" (UniqueName: \"kubernetes.io/projected/9427aa0d-8f02-4c58-959f-f21193f66663-kube-api-access-hv7pp\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:45:39.475350 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.475313    2563 generic.go:356] "Generic (PLEG): container finished" podID="9427aa0d-8f02-4c58-959f-f21193f66663" containerID="47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89" exitCode=0
Aug 02 10:45:39.475824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.475356    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-zkgmp"
Aug 02 10:45:39.475824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.475364    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-zkgmp" event={"ID":"9427aa0d-8f02-4c58-959f-f21193f66663","Type":"ContainerDied","Data":"47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89"}
Aug 02 10:45:39.475824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.475404    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-zkgmp" event={"ID":"9427aa0d-8f02-4c58-959f-f21193f66663","Type":"ContainerDied","Data":"d30c3518787d8b9407d2b8aaf6bf76169bb41e6351ffb451e0e943c0dc16a2a3"}
Aug 02 10:45:39.475824 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.475426    2563 scope.go:117] "RemoveContainer" containerID="47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89"
Aug 02 10:45:39.483817 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.483797    2563 scope.go:117] "RemoveContainer" containerID="47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89"
Aug 02 10:45:39.484070 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:45:39.484050    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89\": container with ID starting with 47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89 not found: ID does not exist" containerID="47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89"
Aug 02 10:45:39.484116 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.484078    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89"} err="failed to get container status \"47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89\": rpc error: code = NotFound desc = could not find container \"47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89\": container with ID starting with 47ba49499e65a2f419e9f796429b30d124e395c9d30928f25b14d4340a075f89 not found: ID does not exist"
Aug 02 10:45:39.489680 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.489659    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-zkgmp"]
Aug 02 10:45:39.493529 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:39.493511    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-zkgmp"]
Aug 02 10:45:40.846141 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:40.846104    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9427aa0d-8f02-4c58-959f-f21193f66663" path="/var/lib/kubelet/pods/9427aa0d-8f02-4c58-959f-f21193f66663/volumes"
Aug 02 10:45:45.390665 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:45.390636    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:48.943790 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:48.943750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:49.064526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:49.064494    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:45:49.414037 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:45:49.414003    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:01.291792 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.291755    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:01.511425 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.511394    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-8rk6g"]
Aug 02 10:46:01.511736 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.511721    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9427aa0d-8f02-4c58-959f-f21193f66663" containerName="authorino"
Aug 02 10:46:01.511783 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.511739    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9427aa0d-8f02-4c58-959f-f21193f66663" containerName="authorino"
Aug 02 10:46:01.511819 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.511798    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9427aa0d-8f02-4c58-959f-f21193f66663" containerName="authorino"
Aug 02 10:46:01.514471 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.514456    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:01.516376 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.516355    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 02 10:46:01.516842 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.516827    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jq9l6\""
Aug 02 10:46:01.516842 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.516836    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 02 10:46:01.521577 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.521331    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-8rk6g"]
Aug 02 10:46:01.590059 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.589967    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvk49\" (UniqueName: \"kubernetes.io/projected/74e3dca3-2652-44cb-947a-68aa0cb9d3b7-kube-api-access-vvk49\") pod \"authorino-5dc7ccb5f-8rk6g\" (UID: \"74e3dca3-2652-44cb-947a-68aa0cb9d3b7\") " pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:01.667016 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.666983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:01.691099 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.691071    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvk49\" (UniqueName: \"kubernetes.io/projected/74e3dca3-2652-44cb-947a-68aa0cb9d3b7-kube-api-access-vvk49\") pod \"authorino-5dc7ccb5f-8rk6g\" (UID: \"74e3dca3-2652-44cb-947a-68aa0cb9d3b7\") " pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:01.700972 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.700943    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvk49\" (UniqueName: \"kubernetes.io/projected/74e3dca3-2652-44cb-947a-68aa0cb9d3b7-kube-api-access-vvk49\") pod \"authorino-5dc7ccb5f-8rk6g\" (UID: \"74e3dca3-2652-44cb-947a-68aa0cb9d3b7\") " pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:01.742945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.742916    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-8rk6g"]
Aug 02 10:46:01.743178 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.743165    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:01.840502 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.840435    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f44cb5c46-krf2n"]
Aug 02 10:46:01.843791 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.843775    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:01.845954 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.845929    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 02 10:46:01.852148 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.852123    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f44cb5c46-krf2n"]
Aug 02 10:46:01.880729 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.880577    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-8rk6g"]
Aug 02 10:46:01.883344 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:46:01.883318    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74e3dca3_2652_44cb_947a_68aa0cb9d3b7.slice/crio-ccfa9296fff1e2a4f6a5ee953623281616c143724c8871e42a2bdc41b4b53a05 WatchSource:0}: Error finding container ccfa9296fff1e2a4f6a5ee953623281616c143724c8871e42a2bdc41b4b53a05: Status 404 returned error can't find the container with id ccfa9296fff1e2a4f6a5ee953623281616c143724c8871e42a2bdc41b4b53a05
Aug 02 10:46:01.892491 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.892469    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de897b2c-4969-46cd-852a-6f47abdd1edd-tls-cert\") pod \"authorino-7f44cb5c46-krf2n\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") " pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:01.892580 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.892535    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg9sp\" (UniqueName: \"kubernetes.io/projected/de897b2c-4969-46cd-852a-6f47abdd1edd-kube-api-access-lg9sp\") pod \"authorino-7f44cb5c46-krf2n\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") " pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:01.993240 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.993208    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de897b2c-4969-46cd-852a-6f47abdd1edd-tls-cert\") pod \"authorino-7f44cb5c46-krf2n\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") " pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:01.993426 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.993333    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg9sp\" (UniqueName: \"kubernetes.io/projected/de897b2c-4969-46cd-852a-6f47abdd1edd-kube-api-access-lg9sp\") pod \"authorino-7f44cb5c46-krf2n\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") " pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:01.996051 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:01.996023    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de897b2c-4969-46cd-852a-6f47abdd1edd-tls-cert\") pod \"authorino-7f44cb5c46-krf2n\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") " pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:02.001958 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.001931    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg9sp\" (UniqueName: \"kubernetes.io/projected/de897b2c-4969-46cd-852a-6f47abdd1edd-kube-api-access-lg9sp\") pod \"authorino-7f44cb5c46-krf2n\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") " pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:02.156437 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.156406    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:46:02.286890 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.286857    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f44cb5c46-krf2n"]
Aug 02 10:46:02.288699 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:46:02.288674    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde897b2c_4969_46cd_852a_6f47abdd1edd.slice/crio-4a16522100be67ccb1250ceed4d9ed7b468784195c1ece489b25b0a51543ddbd WatchSource:0}: Error finding container 4a16522100be67ccb1250ceed4d9ed7b468784195c1ece489b25b0a51543ddbd: Status 404 returned error can't find the container with id 4a16522100be67ccb1250ceed4d9ed7b468784195c1ece489b25b0a51543ddbd
Aug 02 10:46:02.576366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.576330    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g" event={"ID":"74e3dca3-2652-44cb-947a-68aa0cb9d3b7","Type":"ContainerStarted","Data":"15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296"}
Aug 02 10:46:02.576366 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.576374    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g" event={"ID":"74e3dca3-2652-44cb-947a-68aa0cb9d3b7","Type":"ContainerStarted","Data":"ccfa9296fff1e2a4f6a5ee953623281616c143724c8871e42a2bdc41b4b53a05"}
Aug 02 10:46:02.576932 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.576382    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g" podUID="74e3dca3-2652-44cb-947a-68aa0cb9d3b7" containerName="authorino" containerID="cri-o://15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296" gracePeriod=30
Aug 02 10:46:02.577757 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.577724    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f44cb5c46-krf2n" event={"ID":"de897b2c-4969-46cd-852a-6f47abdd1edd","Type":"ContainerStarted","Data":"4a16522100be67ccb1250ceed4d9ed7b468784195c1ece489b25b0a51543ddbd"}
Aug 02 10:46:02.590811 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.590771    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g" podStartSLOduration=1.049657121 podStartE2EDuration="1.590755877s" totalImagesPullingTime="541.098756ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:46:02.590195444 +0000 UTC m=+758.248413035" watchObservedRunningTime="2026-08-02 10:46:02.590755877 +0000 UTC m=+758.248973466"
Aug 02 10:46:02.821153 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.821128    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:02.900042 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.900015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvk49\" (UniqueName: \"kubernetes.io/projected/74e3dca3-2652-44cb-947a-68aa0cb9d3b7-kube-api-access-vvk49\") pod \"74e3dca3-2652-44cb-947a-68aa0cb9d3b7\" (UID: \"74e3dca3-2652-44cb-947a-68aa0cb9d3b7\") "
Aug 02 10:46:02.902257 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:02.902237    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74e3dca3-2652-44cb-947a-68aa0cb9d3b7-kube-api-access-vvk49" (OuterVolumeSpecName: "kube-api-access-vvk49") pod "74e3dca3-2652-44cb-947a-68aa0cb9d3b7" (UID: "74e3dca3-2652-44cb-947a-68aa0cb9d3b7"). InnerVolumeSpecName "kube-api-access-vvk49". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 10:46:03.000535 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.000456    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvk49\" (UniqueName: \"kubernetes.io/projected/74e3dca3-2652-44cb-947a-68aa0cb9d3b7-kube-api-access-vvk49\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:46:03.582968 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.582934    2563 generic.go:356] "Generic (PLEG): container finished" podID="74e3dca3-2652-44cb-947a-68aa0cb9d3b7" containerID="15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296" exitCode=0
Aug 02 10:46:03.583425 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.582979    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g"
Aug 02 10:46:03.583425 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.583025    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g" event={"ID":"74e3dca3-2652-44cb-947a-68aa0cb9d3b7","Type":"ContainerDied","Data":"15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296"}
Aug 02 10:46:03.583425 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.583063    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5dc7ccb5f-8rk6g" event={"ID":"74e3dca3-2652-44cb-947a-68aa0cb9d3b7","Type":"ContainerDied","Data":"ccfa9296fff1e2a4f6a5ee953623281616c143724c8871e42a2bdc41b4b53a05"}
Aug 02 10:46:03.583425 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.583081    2563 scope.go:117] "RemoveContainer" containerID="15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296"
Aug 02 10:46:03.584617 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.584590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f44cb5c46-krf2n" event={"ID":"de897b2c-4969-46cd-852a-6f47abdd1edd","Type":"ContainerStarted","Data":"41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b"}
Aug 02 10:46:03.591294 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.591274    2563 scope.go:117] "RemoveContainer" containerID="15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296"
Aug 02 10:46:03.591577 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:46:03.591559    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296\": container with ID starting with 15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296 not found: ID does not exist" containerID="15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296"
Aug 02 10:46:03.591692 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.591585    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296"} err="failed to get container status \"15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296\": rpc error: code = NotFound desc = could not find container \"15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296\": container with ID starting with 15799fcf43eea5159b104ab87650bfa2e6c1e61038a4db157fbfb04931218296 not found: ID does not exist"
Aug 02 10:46:03.604198 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.604158    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f44cb5c46-krf2n" podStartSLOduration=1.8369498979999999 podStartE2EDuration="2.604146132s" totalImagesPullingTime="767.196234ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:46:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:46:03.602761116 +0000 UTC m=+759.260978706" watchObservedRunningTime="2026-08-02 10:46:03.604146132 +0000 UTC m=+759.262363721"
Aug 02 10:46:03.617766 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.617740    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-8rk6g"]
Aug 02 10:46:03.624300 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:03.624277    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-8rk6g"]
Aug 02 10:46:04.847837 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:04.847795    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74e3dca3-2652-44cb-947a-68aa0cb9d3b7" path="/var/lib/kubelet/pods/74e3dca3-2652-44cb-947a-68aa0cb9d3b7/volumes"
Aug 02 10:46:08.138205 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:08.138166    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:08.234670 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:08.234640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:08.319704 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:08.319669    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:08.532525 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:08.532440    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:10.295945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:10.295915    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:10.393395 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:10.393362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:41.989929 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:41.989896    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:42.084896 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:42.084855    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:43.597608 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:43.597580    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:43.720390 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:43.720359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:44.017245 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:44.017217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:44.101452 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:44.101423    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:44.801302 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:44.801271    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:54.280440 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:54.280354    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:46:54.384951 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:46:54.384918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:00.048667 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:00.048629    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:08.289434 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:08.289395    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:15.085289 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:15.085234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:24.566422 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:24.566374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:35.266785 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.266755    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"]
Aug 02 10:47:35.267251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.267044    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74e3dca3-2652-44cb-947a-68aa0cb9d3b7" containerName="authorino"
Aug 02 10:47:35.267251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.267054    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="74e3dca3-2652-44cb-947a-68aa0cb9d3b7" containerName="authorino"
Aug 02 10:47:35.267251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.267124    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="74e3dca3-2652-44cb-947a-68aa0cb9d3b7" containerName="authorino"
Aug 02 10:47:35.268754 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.268739    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.270980 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.270946    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fkv5b\""
Aug 02 10:47:35.270980 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.270949    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 02 10:47:35.270980 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.270946    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 02 10:47:35.271298 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.271282    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 02 10:47:35.283372 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.283350    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"]
Aug 02 10:47:35.300957 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.300933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:35.379591 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.379564    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2897a6ee-75ce-4168-9a81-4ccc78ab828c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.379762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.379611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sq5zh\" (UniqueName: \"kubernetes.io/projected/2897a6ee-75ce-4168-9a81-4ccc78ab828c-kube-api-access-sq5zh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.379762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.379672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.379762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.379707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.379762 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.379742    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.379901 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.379778    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.480790 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.480750    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.480790 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.480795    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2897a6ee-75ce-4168-9a81-4ccc78ab828c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481030 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.480837    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sq5zh\" (UniqueName: \"kubernetes.io/projected/2897a6ee-75ce-4168-9a81-4ccc78ab828c-kube-api-access-sq5zh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481030 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.480877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481030 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.480923    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481190 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.481047    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481246 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.481186    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481246 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.481213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.481386 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.481314    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.483298 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.483278    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2897a6ee-75ce-4168-9a81-4ccc78ab828c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.483502 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.483487    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2897a6ee-75ce-4168-9a81-4ccc78ab828c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.488735 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.488715    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sq5zh\" (UniqueName: \"kubernetes.io/projected/2897a6ee-75ce-4168-9a81-4ccc78ab828c-kube-api-access-sq5zh\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb\" (UID: \"2897a6ee-75ce-4168-9a81-4ccc78ab828c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.578914 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.578808    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:35.714377 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.714352    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"]
Aug 02 10:47:35.717075 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:47:35.717039    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2897a6ee_75ce_4168_9a81_4ccc78ab828c.slice/crio-17a13822e9948614340a659e7710835f139c38a3f722f951d638365336f57c14 WatchSource:0}: Error finding container 17a13822e9948614340a659e7710835f139c38a3f722f951d638365336f57c14: Status 404 returned error can't find the container with id 17a13822e9948614340a659e7710835f139c38a3f722f951d638365336f57c14
Aug 02 10:47:35.968922 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:35.968882    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb" event={"ID":"2897a6ee-75ce-4168-9a81-4ccc78ab828c","Type":"ContainerStarted","Data":"17a13822e9948614340a659e7710835f139c38a3f722f951d638365336f57c14"}
Aug 02 10:47:36.974363 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:36.974327    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb" event={"ID":"2897a6ee-75ce-4168-9a81-4ccc78ab828c","Type":"ContainerStarted","Data":"d2711dc4473daa503c3f7e3fafe68fa8d84811b6ebe49b8274ddbc8992c9a25c"}
Aug 02 10:47:36.992722 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:36.992668    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb" podStartSLOduration=1.076099301 podStartE2EDuration="1.992652624s" totalImagesPullingTime="916.553323ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:47:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:47:36.990914465 +0000 UTC m=+852.649132056" watchObservedRunningTime="2026-08-02 10:47:36.992652624 +0000 UTC m=+852.650870214"
Aug 02 10:47:41.141031 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:41.140997    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:45.579473 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:45.579418    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:45.579886 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:45.579496    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:45.592145 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:45.592109    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:46.026169 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:46.026143    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb"
Aug 02 10:47:55.939604 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.939557    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"]
Aug 02 10:47:55.941650 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.941630    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:55.943526 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.943505    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Aug 02 10:47:55.955877 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.955854    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"]
Aug 02 10:47:55.963986 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.963962    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:55.964088 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.964003    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a536afe9-d9be-4d30-a89b-343da544a931-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:55.964088 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.964019    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:55.964202 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.964133    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5b8hc\" (UniqueName: \"kubernetes.io/projected/a536afe9-d9be-4d30-a89b-343da544a931-kube-api-access-5b8hc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:55.964202 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.964173    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:55.964335 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:55.964232    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.019131 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.019097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:47:56.065125 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065095    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a536afe9-d9be-4d30-a89b-343da544a931-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065125 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065125    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5b8hc\" (UniqueName: \"kubernetes.io/projected/a536afe9-d9be-4d30-a89b-343da544a931-kube-api-access-5b8hc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065170    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065194    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065368 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065236    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065574 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065557    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065683 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065664    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.065723 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.065705    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.067576 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.067558    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a536afe9-d9be-4d30-a89b-343da544a931-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.067846 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.067827    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a536afe9-d9be-4d30-a89b-343da544a931-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.074242 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.074216    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5b8hc\" (UniqueName: \"kubernetes.io/projected/a536afe9-d9be-4d30-a89b-343da544a931-kube-api-access-5b8hc\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq\" (UID: \"a536afe9-d9be-4d30-a89b-343da544a931\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.251242 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.251140    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:47:56.383251 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:56.383216    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"]
Aug 02 10:47:56.385785 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:47:56.385757    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda536afe9_d9be_4d30_a89b_343da544a931.slice/crio-785019f90fdbf4b91a47a4efb0d50efc1c9098f78435b9c5035e22318dd49e9e WatchSource:0}: Error finding container 785019f90fdbf4b91a47a4efb0d50efc1c9098f78435b9c5035e22318dd49e9e: Status 404 returned error can't find the container with id 785019f90fdbf4b91a47a4efb0d50efc1c9098f78435b9c5035e22318dd49e9e
Aug 02 10:47:57.061310 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:57.061251    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq" event={"ID":"a536afe9-d9be-4d30-a89b-343da544a931","Type":"ContainerStarted","Data":"029cb024c55de8b516063a06bea3e869c28e012ff48bc5112d712546d937a726"}
Aug 02 10:47:57.061713 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:57.061320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq" event={"ID":"a536afe9-d9be-4d30-a89b-343da544a931","Type":"ContainerStarted","Data":"785019f90fdbf4b91a47a4efb0d50efc1c9098f78435b9c5035e22318dd49e9e"}
Aug 02 10:47:57.079221 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:47:57.079164    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq" podStartSLOduration=1.9445325919999998 podStartE2EDuration="2.079148561s" totalImagesPullingTime="134.615969ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:47:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:47:57.077599118 +0000 UTC m=+872.735816719" watchObservedRunningTime="2026-08-02 10:47:57.079148561 +0000 UTC m=+872.737366151"
Aug 02 10:48:06.251742 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:06.251712    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:48:06.252254 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:06.251971    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:48:06.264196 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:06.264167    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:48:07.117249 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:07.117220    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq"
Aug 02 10:48:24.768855 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:24.768828    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:48:24.770132 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:24.770114    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:48:44.652165 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.652128    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-785557b4c-ghpmv"]
Aug 02 10:48:44.657832 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.657812    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.662773 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.662748    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-785557b4c-ghpmv"]
Aug 02 10:48:44.690057 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.690032    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlk67\" (UniqueName: \"kubernetes.io/projected/f618dac1-b38a-4039-95fe-445f8930fa86-kube-api-access-wlk67\") pod \"authorino-785557b4c-ghpmv\" (UID: \"f618dac1-b38a-4039-95fe-445f8930fa86\") " pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.690162 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.690076    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f618dac1-b38a-4039-95fe-445f8930fa86-tls-cert\") pod \"authorino-785557b4c-ghpmv\" (UID: \"f618dac1-b38a-4039-95fe-445f8930fa86\") " pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.791369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.791332    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlk67\" (UniqueName: \"kubernetes.io/projected/f618dac1-b38a-4039-95fe-445f8930fa86-kube-api-access-wlk67\") pod \"authorino-785557b4c-ghpmv\" (UID: \"f618dac1-b38a-4039-95fe-445f8930fa86\") " pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.791518 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.791392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f618dac1-b38a-4039-95fe-445f8930fa86-tls-cert\") pod \"authorino-785557b4c-ghpmv\" (UID: \"f618dac1-b38a-4039-95fe-445f8930fa86\") " pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.793945 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.793923    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f618dac1-b38a-4039-95fe-445f8930fa86-tls-cert\") pod \"authorino-785557b4c-ghpmv\" (UID: \"f618dac1-b38a-4039-95fe-445f8930fa86\") " pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.799621 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.799602    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlk67\" (UniqueName: \"kubernetes.io/projected/f618dac1-b38a-4039-95fe-445f8930fa86-kube-api-access-wlk67\") pod \"authorino-785557b4c-ghpmv\" (UID: \"f618dac1-b38a-4039-95fe-445f8930fa86\") " pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:44.967857 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:44.967783    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785557b4c-ghpmv"
Aug 02 10:48:45.099585 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:45.099559    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-785557b4c-ghpmv"]
Aug 02 10:48:45.101787 ip-10-0-130-84 kubenswrapper[2563]: W0802 10:48:45.101755    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf618dac1_b38a_4039_95fe_445f8930fa86.slice/crio-535444e94a684f0ee2c4e24aab2061751beebbaed3f8d1bbab25b6127fd0ab6a WatchSource:0}: Error finding container 535444e94a684f0ee2c4e24aab2061751beebbaed3f8d1bbab25b6127fd0ab6a: Status 404 returned error can't find the container with id 535444e94a684f0ee2c4e24aab2061751beebbaed3f8d1bbab25b6127fd0ab6a
Aug 02 10:48:45.267187 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:45.267106    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785557b4c-ghpmv" event={"ID":"f618dac1-b38a-4039-95fe-445f8930fa86","Type":"ContainerStarted","Data":"535444e94a684f0ee2c4e24aab2061751beebbaed3f8d1bbab25b6127fd0ab6a"}
Aug 02 10:48:46.690529 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:46.690499    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:48:47.278626 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.278590    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785557b4c-ghpmv" event={"ID":"f618dac1-b38a-4039-95fe-445f8930fa86","Type":"ContainerStarted","Data":"08faaa23243b07bd4d122a819fc6761a7549ca04a703b6f25cf84fbf629d614b"}
Aug 02 10:48:47.294817 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.294766    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-785557b4c-ghpmv" podStartSLOduration=1.7600419170000001 podStartE2EDuration="3.294749533s" totalImagesPullingTime="1.534707616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 10:48:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 10:48:47.293384856 +0000 UTC m=+922.951602448" watchObservedRunningTime="2026-08-02 10:48:47.294749533 +0000 UTC m=+922.952967122"
Aug 02 10:48:47.327421 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.327387    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f44cb5c46-krf2n"]
Aug 02 10:48:47.327628 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.327580    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7f44cb5c46-krf2n" podUID="de897b2c-4969-46cd-852a-6f47abdd1edd" containerName="authorino" containerID="cri-o://41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b" gracePeriod=30
Aug 02 10:48:47.579976 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.579953    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:48:47.624641 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.624610    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg9sp\" (UniqueName: \"kubernetes.io/projected/de897b2c-4969-46cd-852a-6f47abdd1edd-kube-api-access-lg9sp\") pod \"de897b2c-4969-46cd-852a-6f47abdd1edd\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") "
Aug 02 10:48:47.624641 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.624646    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de897b2c-4969-46cd-852a-6f47abdd1edd-tls-cert\") pod \"de897b2c-4969-46cd-852a-6f47abdd1edd\" (UID: \"de897b2c-4969-46cd-852a-6f47abdd1edd\") "
Aug 02 10:48:47.626958 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.626925    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de897b2c-4969-46cd-852a-6f47abdd1edd-kube-api-access-lg9sp" (OuterVolumeSpecName: "kube-api-access-lg9sp") pod "de897b2c-4969-46cd-852a-6f47abdd1edd" (UID: "de897b2c-4969-46cd-852a-6f47abdd1edd"). InnerVolumeSpecName "kube-api-access-lg9sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 10:48:47.635650 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.635614    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de897b2c-4969-46cd-852a-6f47abdd1edd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "de897b2c-4969-46cd-852a-6f47abdd1edd" (UID: "de897b2c-4969-46cd-852a-6f47abdd1edd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 10:48:47.726089 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.726057    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg9sp\" (UniqueName: \"kubernetes.io/projected/de897b2c-4969-46cd-852a-6f47abdd1edd-kube-api-access-lg9sp\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:48:47.726089 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:47.726085    2563 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/de897b2c-4969-46cd-852a-6f47abdd1edd-tls-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 10:48:48.073667 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.073633    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:48:48.284464 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.284430    2563 generic.go:356] "Generic (PLEG): container finished" podID="de897b2c-4969-46cd-852a-6f47abdd1edd" containerID="41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b" exitCode=0
Aug 02 10:48:48.284665 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.284480    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f44cb5c46-krf2n"
Aug 02 10:48:48.284665 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.284513    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f44cb5c46-krf2n" event={"ID":"de897b2c-4969-46cd-852a-6f47abdd1edd","Type":"ContainerDied","Data":"41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b"}
Aug 02 10:48:48.284665 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.284563    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f44cb5c46-krf2n" event={"ID":"de897b2c-4969-46cd-852a-6f47abdd1edd","Type":"ContainerDied","Data":"4a16522100be67ccb1250ceed4d9ed7b468784195c1ece489b25b0a51543ddbd"}
Aug 02 10:48:48.284665 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.284588    2563 scope.go:117] "RemoveContainer" containerID="41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b"
Aug 02 10:48:48.294771 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.294735    2563 scope.go:117] "RemoveContainer" containerID="41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b"
Aug 02 10:48:48.295151 ip-10-0-130-84 kubenswrapper[2563]: E0802 10:48:48.295120    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b\": container with ID starting with 41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b not found: ID does not exist" containerID="41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b"
Aug 02 10:48:48.295244 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.295169    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b"} err="failed to get container status \"41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b\": rpc error: code = NotFound desc = could not find container \"41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b\": container with ID starting with 41a542254b9164299c48e70f6815ffe4a892ed3ac75782b17eb75852d20d1a4b not found: ID does not exist"
Aug 02 10:48:48.306454 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.306432    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7f44cb5c46-krf2n"]
Aug 02 10:48:48.315891 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.315867    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7f44cb5c46-krf2n"]
Aug 02 10:48:48.846073 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.846039    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de897b2c-4969-46cd-852a-6f47abdd1edd" path="/var/lib/kubelet/pods/de897b2c-4969-46cd-852a-6f47abdd1edd/volumes"
Aug 02 10:48:48.954369 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:48.954338    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:48:49.036044 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:48:49.036013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:49:21.655018 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:49:21.654984    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:49:29.406740 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:49:29.406705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:49:29.506845 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:49:29.506805    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:49:41.691873 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:49:41.691833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:49:41.791957 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:49:41.791920    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:50:53.137328 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:50:53.137293    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:50:54.354650 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:50:54.354616    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:51:25.968733 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:51:25.968647    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:51:26.069753 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:51:26.069722    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:51:55.423460 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:51:55.423427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:51:55.528820 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:51:55.528786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:51:55.651768 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:51:55.651732    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:52:01.599453 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:52:01.599418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:52:01.701953 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:52:01.701918    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:52:01.800738 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:52:01.800704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:52:01.945397 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:52:01.945362    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:52:07.936147 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:52:07.936114    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:52:08.036439 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:52:08.036411    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:53:24.794010 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:53:24.793983    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:53:24.795733 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:53:24.795710    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:54:27.007676 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:54:27.007637    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:54:45.983569 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:54:45.983521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:56:09.953199 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:56:09.953101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 10:58:24.824662 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:58:24.824636    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 10:58:24.827178 ip-10-0-130-84 kubenswrapper[2563]: I0802 10:58:24.827140    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:00:24.047093 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:00:24.046994    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:00:25.582109 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:00:25.582078    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:01:38.753436 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.753407    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"]
Aug 02 11:01:38.753891 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.753707    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de897b2c-4969-46cd-852a-6f47abdd1edd" containerName="authorino"
Aug 02 11:01:38.753891 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.753717    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="de897b2c-4969-46cd-852a-6f47abdd1edd" containerName="authorino"
Aug 02 11:01:38.753891 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.753779    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="de897b2c-4969-46cd-852a-6f47abdd1edd" containerName="authorino"
Aug 02 11:01:38.756595 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.756573    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.758442 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.758423    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-9b8af81b-kserve-self-signed-certs\""
Aug 02 11:01:38.774393 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.774370    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"]
Aug 02 11:01:38.779381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.779356    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:01:38.786662 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.786643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-home\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.786753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.786678    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-tmp-dir\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.786753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.786697    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-model-cache\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.786753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.786740    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e42ec9-8a71-4114-b048-7b349886840d-tls-certs\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.786861 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.786793    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-dshm\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.786861 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.786828    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rvx6\" (UniqueName: \"kubernetes.io/projected/a8e42ec9-8a71-4114-b048-7b349886840d-kube-api-access-5rvx6\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887314 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887247    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-home\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887495 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887331    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-tmp-dir\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887495 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887351    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-model-cache\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887495 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887366    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e42ec9-8a71-4114-b048-7b349886840d-tls-certs\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887495 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887398    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-dshm\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887495 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887426    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rvx6\" (UniqueName: \"kubernetes.io/projected/a8e42ec9-8a71-4114-b048-7b349886840d-kube-api-access-5rvx6\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887612    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-home\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887716    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-tmp-dir\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.887754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.887725    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-model-cache\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.889896 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.889867    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-dshm\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.889994 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.889959    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e42ec9-8a71-4114-b048-7b349886840d-tls-certs\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:38.894552 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:38.894533    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rvx6\" (UniqueName: \"kubernetes.io/projected/a8e42ec9-8a71-4114-b048-7b349886840d-kube-api-access-5rvx6\") pod \"e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") " pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:39.066113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:39.066030    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:39.199692 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:39.199507    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"]
Aug 02 11:01:39.202491 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:01:39.202456    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda8e42ec9_8a71_4114_b048_7b349886840d.slice/crio-1810fe253dc6aaa0d85b4566de67bcee279f1f39489cebbaad49e7fe000c314d WatchSource:0}: Error finding container 1810fe253dc6aaa0d85b4566de67bcee279f1f39489cebbaad49e7fe000c314d: Status 404 returned error can't find the container with id 1810fe253dc6aaa0d85b4566de67bcee279f1f39489cebbaad49e7fe000c314d
Aug 02 11:01:39.570623 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:39.570595    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt" event={"ID":"a8e42ec9-8a71-4114-b048-7b349886840d","Type":"ContainerStarted","Data":"b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808"}
Aug 02 11:01:39.570801 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:39.570636    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt" event={"ID":"a8e42ec9-8a71-4114-b048-7b349886840d","Type":"ContainerStarted","Data":"1810fe253dc6aaa0d85b4566de67bcee279f1f39489cebbaad49e7fe000c314d"}
Aug 02 11:01:39.586240 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:39.586190    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt" podStartSLOduration=1.586176201 podStartE2EDuration="1.586176201s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:01:39.585090724 +0000 UTC m=+1695.243308315" watchObservedRunningTime="2026-08-02 11:01:39.586176201 +0000 UTC m=+1695.244393790"
Aug 02 11:01:48.238083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.237998    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"]
Aug 02 11:01:48.241406 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.241390    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.243337 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.243319    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-9b8af81b-kserve-self-signed-certs\""
Aug 02 11:01:48.247935 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.247888    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"]
Aug 02 11:01:48.267005 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.266974    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lspw\" (UniqueName: \"kubernetes.io/projected/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-kube-api-access-8lspw\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.267159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.267023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-home\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.267159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.267042    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-model-cache\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.267159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.267057    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tls-certs\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.267159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.267089    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-dshm\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.267159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.267120    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tmp-dir\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.343916 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.343882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:01:48.367754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.367727    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lspw\" (UniqueName: \"kubernetes.io/projected/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-kube-api-access-8lspw\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.367859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.367772    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-home\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.367859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.367790    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-model-cache\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.367859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.367813    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tls-certs\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.367859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.367850    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-dshm\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.368056 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.367903    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tmp-dir\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.368167 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.368147    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-model-cache\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.368249 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.368204    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-home\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.368249 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.368226    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tmp-dir\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.370220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.370195    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-dshm\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.370615 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.370594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tls-certs\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.375051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.375024    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lspw\" (UniqueName: \"kubernetes.io/projected/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-kube-api-access-8lspw\") pod \"e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") " pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.558192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.558106    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:48.689730 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:48.689697    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"]
Aug 02 11:01:48.692054 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:01:48.692022    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc95999fa_3ddf_44e4_a417_a2352dc5e5e9.slice/crio-1d7b17acaeeefac33922b2702a3844fd98cbd490b84e3a8a1f5f948635010b9a WatchSource:0}: Error finding container 1d7b17acaeeefac33922b2702a3844fd98cbd490b84e3a8a1f5f948635010b9a: Status 404 returned error can't find the container with id 1d7b17acaeeefac33922b2702a3844fd98cbd490b84e3a8a1f5f948635010b9a
Aug 02 11:01:49.066981 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.066946    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:49.067230 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.067209    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:49.079842 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.079822    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:49.618162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.618121    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99" event={"ID":"c95999fa-3ddf-44e4-a417-a2352dc5e5e9","Type":"ContainerStarted","Data":"6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61"}
Aug 02 11:01:49.618620 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.618171    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99" event={"ID":"c95999fa-3ddf-44e4-a417-a2352dc5e5e9","Type":"ContainerStarted","Data":"1d7b17acaeeefac33922b2702a3844fd98cbd490b84e3a8a1f5f948635010b9a"}
Aug 02 11:01:49.629249 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.629229    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:01:49.632128 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:49.632089    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99" podStartSLOduration=1.632073814 podStartE2EDuration="1.632073814s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:01:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:01:49.631400524 +0000 UTC m=+1705.289618117" watchObservedRunningTime="2026-08-02 11:01:49.632073814 +0000 UTC m=+1705.290291421"
Aug 02 11:01:58.558980 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:58.558933    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:58.559520 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:58.559245    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:58.571518 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:58.571494    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:01:58.672666 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:01:58.672639    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:02:08.188780 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:08.188743    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:02:08.290188 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:08.290152    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:02:16.078184 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:16.078151    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"]
Aug 02 11:02:16.105413 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:16.105381    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:02:17.052722 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:17.052690    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"]
Aug 02 11:02:17.072840 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:17.072810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:02:31.097507 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.097445    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt" podUID="a8e42ec9-8a71-4114-b048-7b349886840d" containerName="main" containerID="cri-o://b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808" gracePeriod=45
Aug 02 11:02:31.347742 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.347677    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:02:31.450719 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.450686    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-dshm\") pod \"a8e42ec9-8a71-4114-b048-7b349886840d\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") "
Aug 02 11:02:31.450719 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.450726    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-model-cache\") pod \"a8e42ec9-8a71-4114-b048-7b349886840d\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") "
Aug 02 11:02:31.450936 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.450772    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-home\") pod \"a8e42ec9-8a71-4114-b048-7b349886840d\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") "
Aug 02 11:02:31.450936 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.450839    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-tmp-dir\") pod \"a8e42ec9-8a71-4114-b048-7b349886840d\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") "
Aug 02 11:02:31.450936 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.450890    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rvx6\" (UniqueName: \"kubernetes.io/projected/a8e42ec9-8a71-4114-b048-7b349886840d-kube-api-access-5rvx6\") pod \"a8e42ec9-8a71-4114-b048-7b349886840d\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") "
Aug 02 11:02:31.450936 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.450932    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e42ec9-8a71-4114-b048-7b349886840d-tls-certs\") pod \"a8e42ec9-8a71-4114-b048-7b349886840d\" (UID: \"a8e42ec9-8a71-4114-b048-7b349886840d\") "
Aug 02 11:02:31.451149 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.451034    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-model-cache" (OuterVolumeSpecName: "model-cache") pod "a8e42ec9-8a71-4114-b048-7b349886840d" (UID: "a8e42ec9-8a71-4114-b048-7b349886840d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:31.451149 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.451125    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-home" (OuterVolumeSpecName: "home") pod "a8e42ec9-8a71-4114-b048-7b349886840d" (UID: "a8e42ec9-8a71-4114-b048-7b349886840d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:31.451234 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.451138    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a8e42ec9-8a71-4114-b048-7b349886840d" (UID: "a8e42ec9-8a71-4114-b048-7b349886840d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:31.451304 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.451257    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:31.451369 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.451323    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:31.451369 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.451338    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:31.453143 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.453106    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-dshm" (OuterVolumeSpecName: "dshm") pod "a8e42ec9-8a71-4114-b048-7b349886840d" (UID: "a8e42ec9-8a71-4114-b048-7b349886840d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:31.453305 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.453285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8e42ec9-8a71-4114-b048-7b349886840d-kube-api-access-5rvx6" (OuterVolumeSpecName: "kube-api-access-5rvx6") pod "a8e42ec9-8a71-4114-b048-7b349886840d" (UID: "a8e42ec9-8a71-4114-b048-7b349886840d"). InnerVolumeSpecName "kube-api-access-5rvx6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:02:31.453365 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.453316    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8e42ec9-8a71-4114-b048-7b349886840d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a8e42ec9-8a71-4114-b048-7b349886840d" (UID: "a8e42ec9-8a71-4114-b048-7b349886840d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:02:31.552468 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.552420    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a8e42ec9-8a71-4114-b048-7b349886840d-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:31.552468 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.552461    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a8e42ec9-8a71-4114-b048-7b349886840d-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:31.552468 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.552473    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rvx6\" (UniqueName: \"kubernetes.io/projected/a8e42ec9-8a71-4114-b048-7b349886840d-kube-api-access-5rvx6\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:31.811162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.811128    2563 generic.go:356] "Generic (PLEG): container finished" podID="a8e42ec9-8a71-4114-b048-7b349886840d" containerID="b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808" exitCode=0
Aug 02 11:02:31.811364 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.811170    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"
Aug 02 11:02:31.811364 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.811202    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt" event={"ID":"a8e42ec9-8a71-4114-b048-7b349886840d","Type":"ContainerDied","Data":"b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808"}
Aug 02 11:02:31.811364 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.811233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt" event={"ID":"a8e42ec9-8a71-4114-b048-7b349886840d","Type":"ContainerDied","Data":"1810fe253dc6aaa0d85b4566de67bcee279f1f39489cebbaad49e7fe000c314d"}
Aug 02 11:02:31.811364 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.811250    2563 scope.go:117] "RemoveContainer" containerID="b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808"
Aug 02 11:02:31.820493 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.820463    2563 scope.go:117] "RemoveContainer" containerID="b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808"
Aug 02 11:02:31.820724 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:02:31.820707    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808\": container with ID starting with b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808 not found: ID does not exist" containerID="b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808"
Aug 02 11:02:31.820788 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.820737    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808"} err="failed to get container status \"b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808\": rpc error: code = NotFound desc = could not find container \"b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808\": container with ID starting with b76ec8d7b06b34eaf8d48c7dd77120d2f785664ad8e0d4a2ec4f18fc5d9f1808 not found: ID does not exist"
Aug 02 11:02:31.829938 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.829907    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"]
Aug 02 11:02:31.833273 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:31.833237    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-9b8af81b-kserve-68d86cfbbc-4d4kt"]
Aug 02 11:02:32.073729 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.073634    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99" podUID="c95999fa-3ddf-44e4-a417-a2352dc5e5e9" containerName="main" containerID="cri-o://6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61" gracePeriod=45
Aug 02 11:02:32.314806 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.314776    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:02:32.461589 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461560    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tls-certs\") pod \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") "
Aug 02 11:02:32.461766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461622    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-model-cache\") pod \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") "
Aug 02 11:02:32.461766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461658    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-dshm\") pod \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") "
Aug 02 11:02:32.461766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461683    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tmp-dir\") pod \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") "
Aug 02 11:02:32.461766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461727    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lspw\" (UniqueName: \"kubernetes.io/projected/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-kube-api-access-8lspw\") pod \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") "
Aug 02 11:02:32.461766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461751    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-home\") pod \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\" (UID: \"c95999fa-3ddf-44e4-a417-a2352dc5e5e9\") "
Aug 02 11:02:32.462023 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.461954    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-model-cache" (OuterVolumeSpecName: "model-cache") pod "c95999fa-3ddf-44e4-a417-a2352dc5e5e9" (UID: "c95999fa-3ddf-44e4-a417-a2352dc5e5e9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:32.462096 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.462071    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:32.462146 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.462068    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c95999fa-3ddf-44e4-a417-a2352dc5e5e9" (UID: "c95999fa-3ddf-44e4-a417-a2352dc5e5e9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:32.462146 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.462096    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-home" (OuterVolumeSpecName: "home") pod "c95999fa-3ddf-44e4-a417-a2352dc5e5e9" (UID: "c95999fa-3ddf-44e4-a417-a2352dc5e5e9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:32.463926 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.463901    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c95999fa-3ddf-44e4-a417-a2352dc5e5e9" (UID: "c95999fa-3ddf-44e4-a417-a2352dc5e5e9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:02:32.464331 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.464314    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-kube-api-access-8lspw" (OuterVolumeSpecName: "kube-api-access-8lspw") pod "c95999fa-3ddf-44e4-a417-a2352dc5e5e9" (UID: "c95999fa-3ddf-44e4-a417-a2352dc5e5e9"). InnerVolumeSpecName "kube-api-access-8lspw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:02:32.464331 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.464318    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-dshm" (OuterVolumeSpecName: "dshm") pod "c95999fa-3ddf-44e4-a417-a2352dc5e5e9" (UID: "c95999fa-3ddf-44e4-a417-a2352dc5e5e9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:02:32.563022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.562975    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:32.563022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.563017    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:32.563022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.563026    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:32.563022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.563035    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lspw\" (UniqueName: \"kubernetes.io/projected/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-kube-api-access-8lspw\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:32.563319 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.563044    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c95999fa-3ddf-44e4-a417-a2352dc5e5e9-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:02:32.818901 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.818818    2563 generic.go:356] "Generic (PLEG): container finished" podID="c95999fa-3ddf-44e4-a417-a2352dc5e5e9" containerID="6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61" exitCode=0
Aug 02 11:02:32.818901 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.818867    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"
Aug 02 11:02:32.818901 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.818885    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99" event={"ID":"c95999fa-3ddf-44e4-a417-a2352dc5e5e9","Type":"ContainerDied","Data":"6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61"}
Aug 02 11:02:32.819125 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.818917    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99" event={"ID":"c95999fa-3ddf-44e4-a417-a2352dc5e5e9","Type":"ContainerDied","Data":"1d7b17acaeeefac33922b2702a3844fd98cbd490b84e3a8a1f5f948635010b9a"}
Aug 02 11:02:32.819125 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.818933    2563 scope.go:117] "RemoveContainer" containerID="6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61"
Aug 02 11:02:32.827693 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.827674    2563 scope.go:117] "RemoveContainer" containerID="6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61"
Aug 02 11:02:32.827931 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:02:32.827915    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61\": container with ID starting with 6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61 not found: ID does not exist" containerID="6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61"
Aug 02 11:02:32.827981 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.827939    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61"} err="failed to get container status \"6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61\": rpc error: code = NotFound desc = could not find container \"6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61\": container with ID starting with 6fdc8f4f9cf59d2c22d20946cc82944fc737af5a363d5e469fdcdaf2bf92af61 not found: ID does not exist"
Aug 02 11:02:32.837609 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.837589    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"]
Aug 02 11:02:32.846817 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.846794    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8e42ec9-8a71-4114-b048-7b349886840d" path="/var/lib/kubelet/pods/a8e42ec9-8a71-4114-b048-7b349886840d/volumes"
Aug 02 11:02:32.847046 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:32.847033    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-9b8af81b-kserve-55d4b6959-ncl99"]
Aug 02 11:02:34.851891 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:02:34.851842    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c95999fa-3ddf-44e4-a417-a2352dc5e5e9" path="/var/lib/kubelet/pods/c95999fa-3ddf-44e4-a417-a2352dc5e5e9/volumes"
Aug 02 11:03:24.851144 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:03:24.851115    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:03:24.853175 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:03:24.853154    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:05:39.388906 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:05:39.388823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:05.032591 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:05.032555    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:07.938880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:07.938845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:08.038620 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:08.038588    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:08.349606 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:08.349521    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:14.251947 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:14.251909    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:14.352169 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:14.352111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:14.468500 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:14.468468    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:14.751281 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:14.751230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:14.891507 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:14.891472    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:17.210902 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:17.210819    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:17.303342 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:17.303310    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:18.305890 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.305854    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:18.729831 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.729795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:18.858422 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.858372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:18.958972 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.958938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:18.965782 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.965755    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"]
Aug 02 11:06:18.966061 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.966049    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8e42ec9-8a71-4114-b048-7b349886840d" containerName="main"
Aug 02 11:06:18.966108 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.966063    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8e42ec9-8a71-4114-b048-7b349886840d" containerName="main"
Aug 02 11:06:18.966108 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.966073    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c95999fa-3ddf-44e4-a417-a2352dc5e5e9" containerName="main"
Aug 02 11:06:18.966108 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.966079    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c95999fa-3ddf-44e4-a417-a2352dc5e5e9" containerName="main"
Aug 02 11:06:18.966200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.966145    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8e42ec9-8a71-4114-b048-7b349886840d" containerName="main"
Aug 02 11:06:18.966200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.966151    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c95999fa-3ddf-44e4-a417-a2352dc5e5e9" containerName="main"
Aug 02 11:06:18.969069 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.969054    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:18.971088 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.971065    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-07fc5de8\""
Aug 02 11:06:18.971192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.971066    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-07fc5de8-dockercfg-khnmg\""
Aug 02 11:06:18.979178 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:18.979157    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"]
Aug 02 11:06:19.034852 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.034776    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ceac75c-0335-4be8-84a9-8cd2cb02e582-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.034998 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.034896    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67x6p\" (UniqueName: \"kubernetes.io/projected/9ceac75c-0335-4be8-84a9-8cd2cb02e582-kube-api-access-67x6p\") pod \"payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.135920 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.135877    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67x6p\" (UniqueName: \"kubernetes.io/projected/9ceac75c-0335-4be8-84a9-8cd2cb02e582-kube-api-access-67x6p\") pod \"payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.136104 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.135939    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ceac75c-0335-4be8-84a9-8cd2cb02e582-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.136657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.136638    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ceac75c-0335-4be8-84a9-8cd2cb02e582-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.142714 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.142684    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67x6p\" (UniqueName: \"kubernetes.io/projected/9ceac75c-0335-4be8-84a9-8cd2cb02e582-kube-api-access-67x6p\") pod \"payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.279792 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.279748    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:19.412027 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.411873    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"]
Aug 02 11:06:19.414761 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:06:19.414727    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ceac75c_0335_4be8_84a9_8cd2cb02e582.slice/crio-d93333eb767fb442e6bdf59d82cf9e96342a325903bba8dcbac52e541618bf40 WatchSource:0}: Error finding container d93333eb767fb442e6bdf59d82cf9e96342a325903bba8dcbac52e541618bf40: Status 404 returned error can't find the container with id d93333eb767fb442e6bdf59d82cf9e96342a325903bba8dcbac52e541618bf40
Aug 02 11:06:19.416741 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.416723    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 02 11:06:19.825982 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:19.825949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv" event={"ID":"9ceac75c-0335-4be8-84a9-8cd2cb02e582","Type":"ContainerStarted","Data":"d93333eb767fb442e6bdf59d82cf9e96342a325903bba8dcbac52e541618bf40"}
Aug 02 11:06:21.844725 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:21.844677    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv" event={"ID":"9ceac75c-0335-4be8-84a9-8cd2cb02e582","Type":"ContainerStarted","Data":"b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9"}
Aug 02 11:06:21.845076 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:21.844742    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:21.860305 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:21.860222    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv" podStartSLOduration=1.552418844 podStartE2EDuration="3.860205149s" totalImagesPullingTime="2.307786305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:06:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:06:21.859241482 +0000 UTC m=+1977.517459072" watchObservedRunningTime="2026-08-02 11:06:21.860205149 +0000 UTC m=+1977.518422744"
Aug 02 11:06:32.851302 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:32.851255    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:42.952085 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:42.952048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:42.984802 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:42.984721    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"]
Aug 02 11:06:42.984987 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:42.984962    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv" podUID="9ceac75c-0335-4be8-84a9-8cd2cb02e582" containerName="payload-pre-processing" containerID="cri-o://b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9" gracePeriod=30
Aug 02 11:06:43.052309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.052246    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.152381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.152349    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.244797 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.244774    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:43.253053 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.253030    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.345878 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.345845    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67x6p\" (UniqueName: \"kubernetes.io/projected/9ceac75c-0335-4be8-84a9-8cd2cb02e582-kube-api-access-67x6p\") pod \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") "
Aug 02 11:06:43.346072 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.345891    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ceac75c-0335-4be8-84a9-8cd2cb02e582-plugins-config-volume\") pod \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\" (UID: \"9ceac75c-0335-4be8-84a9-8cd2cb02e582\") "
Aug 02 11:06:43.346321 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.346257    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ceac75c-0335-4be8-84a9-8cd2cb02e582-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9ceac75c-0335-4be8-84a9-8cd2cb02e582" (UID: "9ceac75c-0335-4be8-84a9-8cd2cb02e582"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:06:43.348381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.348360    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ceac75c-0335-4be8-84a9-8cd2cb02e582-kube-api-access-67x6p" (OuterVolumeSpecName: "kube-api-access-67x6p") pod "9ceac75c-0335-4be8-84a9-8cd2cb02e582" (UID: "9ceac75c-0335-4be8-84a9-8cd2cb02e582"). InnerVolumeSpecName "kube-api-access-67x6p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:06:43.444186 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.444153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.447304 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.447286    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9ceac75c-0335-4be8-84a9-8cd2cb02e582-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:06:43.447389 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.447307    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67x6p\" (UniqueName: \"kubernetes.io/projected/9ceac75c-0335-4be8-84a9-8cd2cb02e582-kube-api-access-67x6p\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:06:43.675094 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.675065    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.775465 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.775419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.874786 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.874756    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:43.938137 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.938059    2563 generic.go:356] "Generic (PLEG): container finished" podID="9ceac75c-0335-4be8-84a9-8cd2cb02e582" containerID="b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9" exitCode=0
Aug 02 11:06:43.938137 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.938120    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"
Aug 02 11:06:43.938360 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.938146    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv" event={"ID":"9ceac75c-0335-4be8-84a9-8cd2cb02e582","Type":"ContainerDied","Data":"b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9"}
Aug 02 11:06:43.938360 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.938198    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv" event={"ID":"9ceac75c-0335-4be8-84a9-8cd2cb02e582","Type":"ContainerDied","Data":"d93333eb767fb442e6bdf59d82cf9e96342a325903bba8dcbac52e541618bf40"}
Aug 02 11:06:43.938360 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.938221    2563 scope.go:117] "RemoveContainer" containerID="b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9"
Aug 02 11:06:43.947517 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.947500    2563 scope.go:117] "RemoveContainer" containerID="b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9"
Aug 02 11:06:43.947781 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:06:43.947764    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9\": container with ID starting with b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9 not found: ID does not exist" containerID="b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9"
Aug 02 11:06:43.947840 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.947791    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9"} err="failed to get container status \"b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9\": rpc error: code = NotFound desc = could not find container \"b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9\": container with ID starting with b10200d04e546b7ae4b40b8d31fc5f04033e0a2ee76473f09e9570e43ed510d9 not found: ID does not exist"
Aug 02 11:06:43.957441 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.957421    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"]
Aug 02 11:06:43.962789 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:43.962767    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-07fc5de8-7c97665bdd-gp5hv"]
Aug 02 11:06:44.137359 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.137321    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"]
Aug 02 11:06:44.137781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.137767    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ceac75c-0335-4be8-84a9-8cd2cb02e582" containerName="payload-pre-processing"
Aug 02 11:06:44.137825 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.137786    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ceac75c-0335-4be8-84a9-8cd2cb02e582" containerName="payload-pre-processing"
Aug 02 11:06:44.137894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.137883    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ceac75c-0335-4be8-84a9-8cd2cb02e582" containerName="payload-pre-processing"
Aug 02 11:06:44.142209 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.142190    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.144341 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.144322    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-cc744106-gw-openshift-default-dockercfg-sfrtl\""
Aug 02 11:06:44.150362 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.150343    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"]
Aug 02 11:06:44.162585 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.162559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:44.253753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253672    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-certs\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.253753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253704    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77f922b-b4ff-4b73-a187-885b7274f8e9-istiod-ca-cert\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.253753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mllg\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-kube-api-access-2mllg\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.254050 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253819    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-data\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.254050 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253845    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-envoy\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.254050 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253870    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-socket\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.254050 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.253964    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-credential-socket\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.254050 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.254012    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-token\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.254244 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.254068    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-podinfo\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.348005 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.347971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:44.355099 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355076    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-podinfo\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355109    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-certs\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355129    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77f922b-b4ff-4b73-a187-885b7274f8e9-istiod-ca-cert\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355158    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mllg\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-kube-api-access-2mllg\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355340 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355284    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-data\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355340 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355321    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-envoy\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355437 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355346    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-socket\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355437 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355392    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-credential-socket\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355437 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355428    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-token\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355800 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355774    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-socket\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355914 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355811    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-credential-socket\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355914 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355847    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-certs\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.355914 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355904    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-data\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.356083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.355981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77f922b-b4ff-4b73-a187-885b7274f8e9-istiod-ca-cert\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.357865 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.357835    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-envoy\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.357949 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.357916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-podinfo\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.363651 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.363627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-token\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.363862 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.363840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mllg\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-kube-api-access-2mllg\") pod \"e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") " pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.454001 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.453966    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:44.593577 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.593554    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"]
Aug 02 11:06:44.596337 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:06:44.596313    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77f922b_b4ff_4b73_a187_885b7274f8e9.slice/crio-14b5824e59eaa07040ce36e93e8d1e784719a56183337030687b049d17213195 WatchSource:0}: Error finding container 14b5824e59eaa07040ce36e93e8d1e784719a56183337030687b049d17213195: Status 404 returned error can't find the container with id 14b5824e59eaa07040ce36e93e8d1e784719a56183337030687b049d17213195
Aug 02 11:06:44.598302 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.598253    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:06:44.598378 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.598341    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:06:44.598378 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.598367    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:06:44.848781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.848703    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ceac75c-0335-4be8-84a9-8cd2cb02e582" path="/var/lib/kubelet/pods/9ceac75c-0335-4be8-84a9-8cd2cb02e582/volumes"
Aug 02 11:06:44.945578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.945538    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" event={"ID":"b77f922b-b4ff-4b73-a187-885b7274f8e9","Type":"ContainerStarted","Data":"9523dd2aaae04120fd7aeab13c7f93b307319410b3202fa59be8582549dae765"}
Aug 02 11:06:44.945757 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.945597    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" event={"ID":"b77f922b-b4ff-4b73-a187-885b7274f8e9","Type":"ContainerStarted","Data":"14b5824e59eaa07040ce36e93e8d1e784719a56183337030687b049d17213195"}
Aug 02 11:06:44.963249 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:44.963197    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podStartSLOduration=0.963180854 podStartE2EDuration="963.180854ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:06:44.962638906 +0000 UTC m=+2000.620856517" watchObservedRunningTime="2026-08-02 11:06:44.963180854 +0000 UTC m=+2000.621398443"
Aug 02 11:06:45.454583 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:45.454544    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:45.459697 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:45.459672    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:45.950162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:45.950134    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:45.951201 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:45.951185    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:06:46.476393 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:46.476363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:46.673862 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:46.673833    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:47.164400 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.164367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:47.265408 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.265369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:47.270710 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.270687    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"]
Aug 02 11:06:47.273996 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.273980    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.276100 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.276078    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-cc744106\""
Aug 02 11:06:47.276185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.276171    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-cc744106-dockercfg-pgl85\""
Aug 02 11:06:47.284459 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.284438    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"]
Aug 02 11:06:47.294702 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.294682    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"]
Aug 02 11:06:47.297826 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.297792    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.309742 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.309719    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"]
Aug 02 11:06:47.365818 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.365776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:06:47.381455 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.381416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a89777b-4de0-4593-bb86-1415dab683cc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") " pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.381636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.381478    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ba8f4c9-4887-4aad-8bf1-04c02665612d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.381636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.381549    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrhc4\" (UniqueName: \"kubernetes.io/projected/2ba8f4c9-4887-4aad-8bf1-04c02665612d-kube-api-access-nrhc4\") pod \"payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.381636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.381617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c92zc\" (UniqueName: \"kubernetes.io/projected/8a89777b-4de0-4593-bb86-1415dab683cc-kube-api-access-c92zc\") pod \"payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") " pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.482389 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.482302    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrhc4\" (UniqueName: \"kubernetes.io/projected/2ba8f4c9-4887-4aad-8bf1-04c02665612d-kube-api-access-nrhc4\") pod \"payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.482389 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.482347    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c92zc\" (UniqueName: \"kubernetes.io/projected/8a89777b-4de0-4593-bb86-1415dab683cc-kube-api-access-c92zc\") pod \"payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") " pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.482389 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.482390    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a89777b-4de0-4593-bb86-1415dab683cc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") " pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.482820 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.482430    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ba8f4c9-4887-4aad-8bf1-04c02665612d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.483148 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.483127    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ba8f4c9-4887-4aad-8bf1-04c02665612d-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.483207 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.483131    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a89777b-4de0-4593-bb86-1415dab683cc-plugins-config-volume\") pod \"payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") " pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.489750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.489711    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrhc4\" (UniqueName: \"kubernetes.io/projected/2ba8f4c9-4887-4aad-8bf1-04c02665612d-kube-api-access-nrhc4\") pod \"payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.489897 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.489784    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c92zc\" (UniqueName: \"kubernetes.io/projected/8a89777b-4de0-4593-bb86-1415dab683cc-kube-api-access-c92zc\") pod \"payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") " pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.584483 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.584446    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.607746 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.607713    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.731896 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.731859    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"]
Aug 02 11:06:47.735155 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:06:47.735124    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ba8f4c9_4887_4aad_8bf1_04c02665612d.slice/crio-1a6f6631685f645865f17ad406cf1a1c94ed10c7ae6d1ec38d26a593626ba634 WatchSource:0}: Error finding container 1a6f6631685f645865f17ad406cf1a1c94ed10c7ae6d1ec38d26a593626ba634: Status 404 returned error can't find the container with id 1a6f6631685f645865f17ad406cf1a1c94ed10c7ae6d1ec38d26a593626ba634
Aug 02 11:06:47.756973 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.756948    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"]
Aug 02 11:06:47.769398 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:06:47.769371    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a89777b_4de0_4593_bb86_1415dab683cc.slice/crio-c8fff5815a73692f0a2751b5ea68715e1288cf18abdcb4b385848a5fb0992ae9 WatchSource:0}: Error finding container c8fff5815a73692f0a2751b5ea68715e1288cf18abdcb4b385848a5fb0992ae9: Status 404 returned error can't find the container with id c8fff5815a73692f0a2751b5ea68715e1288cf18abdcb4b385848a5fb0992ae9
Aug 02 11:06:47.960175 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.960144    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt" event={"ID":"2ba8f4c9-4887-4aad-8bf1-04c02665612d","Type":"ContainerStarted","Data":"6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd"}
Aug 02 11:06:47.960403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.960199    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt" event={"ID":"2ba8f4c9-4887-4aad-8bf1-04c02665612d","Type":"ContainerStarted","Data":"1a6f6631685f645865f17ad406cf1a1c94ed10c7ae6d1ec38d26a593626ba634"}
Aug 02 11:06:47.960403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.960255    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:06:47.961721 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.961691    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9" event={"ID":"8a89777b-4de0-4593-bb86-1415dab683cc","Type":"ContainerStarted","Data":"ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073"}
Aug 02 11:06:47.961842 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.961740    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9" event={"ID":"8a89777b-4de0-4593-bb86-1415dab683cc","Type":"ContainerStarted","Data":"c8fff5815a73692f0a2751b5ea68715e1288cf18abdcb4b385848a5fb0992ae9"}
Aug 02 11:06:47.961912 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.961886    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:47.974165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.974123    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt" podStartSLOduration=0.974094716 podStartE2EDuration="974.094716ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:06:47.973030673 +0000 UTC m=+2003.631248279" watchObservedRunningTime="2026-08-02 11:06:47.974094716 +0000 UTC m=+2003.632312306"
Aug 02 11:06:47.986225 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:47.986141    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9" podStartSLOduration=0.98612464 podStartE2EDuration="986.12464ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:06:47.985392133 +0000 UTC m=+2003.643609722" watchObservedRunningTime="2026-08-02 11:06:47.98612464 +0000 UTC m=+2003.644342231"
Aug 02 11:06:58.970044 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:58.970017    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:06:58.970644 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:06:58.970086    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:07:00.018278 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.018232    2563 generic.go:356] "Generic (PLEG): container finished" podID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerID="9523dd2aaae04120fd7aeab13c7f93b307319410b3202fa59be8582549dae765" exitCode=0
Aug 02 11:07:00.018723 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.018306    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" event={"ID":"b77f922b-b4ff-4b73-a187-885b7274f8e9","Type":"ContainerDied","Data":"9523dd2aaae04120fd7aeab13c7f93b307319410b3202fa59be8582549dae765"}
Aug 02 11:07:00.018723 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.018692    2563 scope.go:117] "RemoveContainer" containerID="9523dd2aaae04120fd7aeab13c7f93b307319410b3202fa59be8582549dae765"
Aug 02 11:07:00.019797 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.019765    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:07:00.019892 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.019853    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:07:00.019944 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.019895    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:07:00.950170 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:00.950123    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:01.025179 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:01.025139    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" event={"ID":"b77f922b-b4ff-4b73-a187-885b7274f8e9","Type":"ContainerStarted","Data":"e28b0944a548133147cfb1cdd496e3c2d0b780cae482ffb0877b28f7dcf36bf9"}
Aug 02 11:07:01.454468 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:01.454425    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:01.455717 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:01.455682    2563 patch_prober.go:28] interesting pod/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Aug 02 11:07:01.455841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:01.455746    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Aug 02 11:07:02.455184 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:02.455145    2563 patch_prober.go:28] interesting pod/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Aug 02 11:07:02.455629 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:02.455205    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Aug 02 11:07:03.454811 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:03.454775    2563 patch_prober.go:28] interesting pod/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Aug 02 11:07:03.455002 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:03.454850    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Aug 02 11:07:04.455369 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:04.455332    2563 patch_prober.go:28] interesting pod/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Aug 02 11:07:04.455786 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:04.455390    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Aug 02 11:07:05.455289 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:05.455230    2563 patch_prober.go:28] interesting pod/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Aug 02 11:07:05.455493 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:05.455321    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Aug 02 11:07:06.459083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:06.459055    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:06.459574 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:06.459335    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:06.460016 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:06.460000    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:11.627713 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.627681    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:11.654569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.654526    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"]
Aug 02 11:07:11.654798 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.654775    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9" podUID="8a89777b-4de0-4593-bb86-1415dab683cc" containerName="payload-processing" containerID="cri-o://ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073" gracePeriod=30
Aug 02 11:07:11.661419 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.661391    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"]
Aug 02 11:07:11.661647 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.661623    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt" podUID="2ba8f4c9-4887-4aad-8bf1-04c02665612d" containerName="payload-pre-processing" containerID="cri-o://6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd" gracePeriod=30
Aug 02 11:07:11.686104 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.686079    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:11.744250 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.744221    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:11.846665 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.846626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:11.906469 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.905210    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"]
Aug 02 11:07:11.906469 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.905476    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy" containerID="cri-o://e28b0944a548133147cfb1cdd496e3c2d0b780cae482ffb0877b28f7dcf36bf9" gracePeriod=30
Aug 02 11:07:11.921029 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.920998    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:11.926354 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.926330    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:07:11.954996 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:11.954961    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:07:12.016603 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.016573    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a89777b-4de0-4593-bb86-1415dab683cc-plugins-config-volume\") pod \"8a89777b-4de0-4593-bb86-1415dab683cc\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") "
Aug 02 11:07:12.016773 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.016706    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c92zc\" (UniqueName: \"kubernetes.io/projected/8a89777b-4de0-4593-bb86-1415dab683cc-kube-api-access-c92zc\") pod \"8a89777b-4de0-4593-bb86-1415dab683cc\" (UID: \"8a89777b-4de0-4593-bb86-1415dab683cc\") "
Aug 02 11:07:12.017038 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.017011    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a89777b-4de0-4593-bb86-1415dab683cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8a89777b-4de0-4593-bb86-1415dab683cc" (UID: "8a89777b-4de0-4593-bb86-1415dab683cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:07:12.018900 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.018877    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a89777b-4de0-4593-bb86-1415dab683cc-kube-api-access-c92zc" (OuterVolumeSpecName: "kube-api-access-c92zc") pod "8a89777b-4de0-4593-bb86-1415dab683cc" (UID: "8a89777b-4de0-4593-bb86-1415dab683cc"). InnerVolumeSpecName "kube-api-access-c92zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:07:12.091775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.091733    2563 generic.go:356] "Generic (PLEG): container finished" podID="8a89777b-4de0-4593-bb86-1415dab683cc" containerID="ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073" exitCode=0
Aug 02 11:07:12.091953 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.091779    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"
Aug 02 11:07:12.091953 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.091795    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9" event={"ID":"8a89777b-4de0-4593-bb86-1415dab683cc","Type":"ContainerDied","Data":"ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073"}
Aug 02 11:07:12.091953 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.091857    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9" event={"ID":"8a89777b-4de0-4593-bb86-1415dab683cc","Type":"ContainerDied","Data":"c8fff5815a73692f0a2751b5ea68715e1288cf18abdcb4b385848a5fb0992ae9"}
Aug 02 11:07:12.091953 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.091887    2563 scope.go:117] "RemoveContainer" containerID="ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073"
Aug 02 11:07:12.093296 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.093251    2563 generic.go:356] "Generic (PLEG): container finished" podID="2ba8f4c9-4887-4aad-8bf1-04c02665612d" containerID="6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd" exitCode=0
Aug 02 11:07:12.093412 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.093308    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt" event={"ID":"2ba8f4c9-4887-4aad-8bf1-04c02665612d","Type":"ContainerDied","Data":"6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd"}
Aug 02 11:07:12.093412 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.093319    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"
Aug 02 11:07:12.093412 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.093340    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt" event={"ID":"2ba8f4c9-4887-4aad-8bf1-04c02665612d","Type":"ContainerDied","Data":"1a6f6631685f645865f17ad406cf1a1c94ed10c7ae6d1ec38d26a593626ba634"}
Aug 02 11:07:12.100985 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.100969    2563 scope.go:117] "RemoveContainer" containerID="ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073"
Aug 02 11:07:12.101244 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:07:12.101220    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073\": container with ID starting with ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073 not found: ID does not exist" containerID="ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073"
Aug 02 11:07:12.101360 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.101250    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073"} err="failed to get container status \"ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073\": rpc error: code = NotFound desc = could not find container \"ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073\": container with ID starting with ae84d5f1cf8ad335fb43bdcb27ac51c25d9d61cf7d8ee651081e059f8b082073 not found: ID does not exist"
Aug 02 11:07:12.101420 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.101362    2563 scope.go:117] "RemoveContainer" containerID="6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd"
Aug 02 11:07:12.108789 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.108773    2563 scope.go:117] "RemoveContainer" containerID="6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd"
Aug 02 11:07:12.109037 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:07:12.109020    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd\": container with ID starting with 6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd not found: ID does not exist" containerID="6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd"
Aug 02 11:07:12.109085 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.109043    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd"} err="failed to get container status \"6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd\": rpc error: code = NotFound desc = could not find container \"6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd\": container with ID starting with 6fab1c6f82ab4663f25d2bd0dc737ab0de06f3585664d2ca55054cf2aa02a1cd not found: ID does not exist"
Aug 02 11:07:12.117361 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.117343    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrhc4\" (UniqueName: \"kubernetes.io/projected/2ba8f4c9-4887-4aad-8bf1-04c02665612d-kube-api-access-nrhc4\") pod \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") "
Aug 02 11:07:12.117459 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.117434    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ba8f4c9-4887-4aad-8bf1-04c02665612d-plugins-config-volume\") pod \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\" (UID: \"2ba8f4c9-4887-4aad-8bf1-04c02665612d\") "
Aug 02 11:07:12.117670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.117651    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c92zc\" (UniqueName: \"kubernetes.io/projected/8a89777b-4de0-4593-bb86-1415dab683cc-kube-api-access-c92zc\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:12.117670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.117671    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8a89777b-4de0-4593-bb86-1415dab683cc-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:12.117969 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.117944    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ba8f4c9-4887-4aad-8bf1-04c02665612d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ba8f4c9-4887-4aad-8bf1-04c02665612d" (UID: "2ba8f4c9-4887-4aad-8bf1-04c02665612d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:07:12.119178 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.119157    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"]
Aug 02 11:07:12.119650 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.119629    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba8f4c9-4887-4aad-8bf1-04c02665612d-kube-api-access-nrhc4" (OuterVolumeSpecName: "kube-api-access-nrhc4") pod "2ba8f4c9-4887-4aad-8bf1-04c02665612d" (UID: "2ba8f4c9-4887-4aad-8bf1-04c02665612d"). InnerVolumeSpecName "kube-api-access-nrhc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:07:12.123330 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.123309    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-cc744106-548b659c4f-pkrq9"]
Aug 02 11:07:12.160409 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.160326    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:12.218246 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.218210    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ba8f4c9-4887-4aad-8bf1-04c02665612d-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:12.218246 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.218238    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrhc4\" (UniqueName: \"kubernetes.io/projected/2ba8f4c9-4887-4aad-8bf1-04c02665612d-kube-api-access-nrhc4\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:12.352355 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.352325    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:12.414081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.414004    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"]
Aug 02 11:07:12.418477 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.418453    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-cc744106-7f4cc4dfd4-cbmpt"]
Aug 02 11:07:12.651457 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.651426    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:12.811455 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.811419    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:12.846725 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.846692    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ba8f4c9-4887-4aad-8bf1-04c02665612d" path="/var/lib/kubelet/pods/2ba8f4c9-4887-4aad-8bf1-04c02665612d/volumes"
Aug 02 11:07:12.847058 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:12.847044    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a89777b-4de0-4593-bb86-1415dab683cc" path="/var/lib/kubelet/pods/8a89777b-4de0-4593-bb86-1415dab683cc/volumes"
Aug 02 11:07:15.479429 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:15.479392    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:15.578064 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:15.578029    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:16.591638 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:16.591607    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:16.725329 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:16.725289    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:17.072423 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.072391    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:17.121521 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.121490    2563 generic.go:356] "Generic (PLEG): container finished" podID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerID="e28b0944a548133147cfb1cdd496e3c2d0b780cae482ffb0877b28f7dcf36bf9" exitCode=0
Aug 02 11:07:17.121667 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.121549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" event={"ID":"b77f922b-b4ff-4b73-a187-885b7274f8e9","Type":"ContainerDied","Data":"e28b0944a548133147cfb1cdd496e3c2d0b780cae482ffb0877b28f7dcf36bf9"}
Aug 02 11:07:17.121667 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.121630    2563 scope.go:117] "RemoveContainer" containerID="9523dd2aaae04120fd7aeab13c7f93b307319410b3202fa59be8582549dae765"
Aug 02 11:07:17.159235 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.159213    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:17.173719 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.173696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:17.264524 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264437    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mllg\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-kube-api-access-2mllg\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264524 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264501    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-certs\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264542    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77f922b-b4ff-4b73-a187-885b7274f8e9-istiod-ca-cert\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264559    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-envoy\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264578    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-podinfo\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264597    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-data\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264628    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-socket\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-token\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.264973 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.264785    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-credential-socket\") pod \"b77f922b-b4ff-4b73-a187-885b7274f8e9\" (UID: \"b77f922b-b4ff-4b73-a187-885b7274f8e9\") "
Aug 02 11:07:17.265950 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.265595    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:07:17.265950 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.265660    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:07:17.265950 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.265802    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77f922b-b4ff-4b73-a187-885b7274f8e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:07:17.265950 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.265810    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:07:17.265950 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.265872    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:07:17.267467 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.267441    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-kube-api-access-2mllg" (OuterVolumeSpecName: "kube-api-access-2mllg") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "kube-api-access-2mllg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:07:17.267606 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.267561    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:07:17.267979 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.267962    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:07:17.268065 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.268041    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b77f922b-b4ff-4b73-a187-885b7274f8e9" (UID: "b77f922b-b4ff-4b73-a187-885b7274f8e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:07:17.365941 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365907    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mllg\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-kube-api-access-2mllg\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.365941 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365937    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.365941 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365950    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77f922b-b4ff-4b73-a187-885b7274f8e9-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.366228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365958    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.366228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365970    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.366228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365981    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.366228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365991    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.366228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.365998    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77f922b-b4ff-4b73-a187-885b7274f8e9-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:17.366228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:17.366007    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77f922b-b4ff-4b73-a187-885b7274f8e9-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:07:18.127916 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:18.127887    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"
Aug 02 11:07:18.127916 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:18.127896    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz" event={"ID":"b77f922b-b4ff-4b73-a187-885b7274f8e9","Type":"ContainerDied","Data":"14b5824e59eaa07040ce36e93e8d1e784719a56183337030687b049d17213195"}
Aug 02 11:07:18.128456 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:18.127959    2563 scope.go:117] "RemoveContainer" containerID="e28b0944a548133147cfb1cdd496e3c2d0b780cae482ffb0877b28f7dcf36bf9"
Aug 02 11:07:18.147153 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:18.147129    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"]
Aug 02 11:07:18.152781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:18.152758    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-cc744106-gw-openshift-default-64c8d7c688-6z9bz"]
Aug 02 11:07:18.846159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:18.846125    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" path="/var/lib/kubelet/pods/b77f922b-b4ff-4b73-a187-885b7274f8e9/volumes"
Aug 02 11:07:35.474733 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:35.474701    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:41.511595 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:41.511551    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:41.578859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:41.578829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:41.638072 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:41.638037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:41.739086 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:41.739056    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:42.760866 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:42.760824    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:42.979496 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:42.979463    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:43.191565 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.191524    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:43.454114 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454042    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"]
Aug 02 11:07:43.454374 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454361    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ba8f4c9-4887-4aad-8bf1-04c02665612d" containerName="payload-pre-processing"
Aug 02 11:07:43.454374 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454375    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ba8f4c9-4887-4aad-8bf1-04c02665612d" containerName="payload-pre-processing"
Aug 02 11:07:43.454475 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454388    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a89777b-4de0-4593-bb86-1415dab683cc" containerName="payload-processing"
Aug 02 11:07:43.454475 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454394    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a89777b-4de0-4593-bb86-1415dab683cc" containerName="payload-processing"
Aug 02 11:07:43.454475 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454407    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy"
Aug 02 11:07:43.454475 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454413    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy"
Aug 02 11:07:43.454475 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454422    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy"
Aug 02 11:07:43.454475 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454427    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy"
Aug 02 11:07:43.454691 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454479    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy"
Aug 02 11:07:43.454691 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454488    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ba8f4c9-4887-4aad-8bf1-04c02665612d" containerName="payload-pre-processing"
Aug 02 11:07:43.454691 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.454497    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a89777b-4de0-4593-bb86-1415dab683cc" containerName="payload-processing"
Aug 02 11:07:43.457392 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.457375    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.459300 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.459278    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-75b9be26-openshift-default-dockercfg-dtrnz\""
Aug 02 11:07:43.469556 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.469534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"]
Aug 02 11:07:43.478039 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.478015    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:43.589698 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589663    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fprrn\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-kube-api-access-fprrn\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.589913 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589707    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-data\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.589913 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589727    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-token\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.589913 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589790    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istiod-ca-cert\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.589913 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589840    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-envoy\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.590132 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589915    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-credential-socket\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.590132 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589945    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-certs\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.590132 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.589975    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-podinfo\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.590132 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.590002    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-socket\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.690689 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690652    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-data\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.690689 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-token\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.690955 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690712    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istiod-ca-cert\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.690955 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690742    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-envoy\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.690955 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690814    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-credential-socket\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691155 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690947    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-certs\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691155 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.690988    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-podinfo\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691155 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691016    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-socket\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691155 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691099    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fprrn\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-kube-api-access-fprrn\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691422 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691211    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-credential-socket\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691422 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-data\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691555 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691414    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-certs\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691555 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691504    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-socket\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.691775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.691754    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istiod-ca-cert\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.693220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.693200    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-envoy\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.693526 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.693509    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-podinfo\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.697870 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.697844    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-token\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.697987 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.697969    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fprrn\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-kube-api-access-fprrn\") pod \"e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") " pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.767917 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.767838    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:43.886855 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.886823    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:43.906524 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.906500    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"]
Aug 02 11:07:43.908455 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:07:43.908429    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3efc9a15_1420_417e_bdfb_c2f2072d0e13.slice/crio-3778b6f7ae67e91ff48a679ae913faed18dbe221d3e7fff44b43cffd893582e3 WatchSource:0}: Error finding container 3778b6f7ae67e91ff48a679ae913faed18dbe221d3e7fff44b43cffd893582e3: Status 404 returned error can't find the container with id 3778b6f7ae67e91ff48a679ae913faed18dbe221d3e7fff44b43cffd893582e3
Aug 02 11:07:43.910718 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.910688    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:07:43.910790 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.910751    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:07:43.910790 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:43.910782    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:07:44.247017 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:44.246981    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" event={"ID":"3efc9a15-1420-417e-bdfb-c2f2072d0e13","Type":"ContainerStarted","Data":"703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"}
Aug 02 11:07:44.247246 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:44.247045    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" event={"ID":"3efc9a15-1420-417e-bdfb-c2f2072d0e13","Type":"ContainerStarted","Data":"3778b6f7ae67e91ff48a679ae913faed18dbe221d3e7fff44b43cffd893582e3"}
Aug 02 11:07:44.264903 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:44.264849    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podStartSLOduration=1.264826581 podStartE2EDuration="1.264826581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:07:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:07:44.263608446 +0000 UTC m=+2059.921826056" watchObservedRunningTime="2026-08-02 11:07:44.264826581 +0000 UTC m=+2059.923044171"
Aug 02 11:07:44.768573 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:44.768529    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:44.773597 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:44.773569    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:45.251702 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:45.251670    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:45.252563 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:45.252547    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:07:45.595392 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:45.595316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:45.696191 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:45.696153    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:46.983855 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:46.983821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:47.322463 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:47.322384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:47.422678 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:47.422643    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:07:47.492736 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:07:47.492704    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:00.253598 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.253560    2563 patch_prober.go:28] interesting pod/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 02 11:08:00.254034 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.253618    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 02 11:08:00.319346 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.319316    2563 generic.go:356] "Generic (PLEG): container finished" podID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerID="703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63" exitCode=0
Aug 02 11:08:00.319507 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.319357    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" event={"ID":"3efc9a15-1420-417e-bdfb-c2f2072d0e13","Type":"ContainerDied","Data":"703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"}
Aug 02 11:08:00.319733 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.319720    2563 scope.go:117] "RemoveContainer" containerID="703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"
Aug 02 11:08:00.320769 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.320738    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:08:00.320828 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.320809    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:08:00.320868 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:00.320841    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:08:01.325433 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:01.325397    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" event={"ID":"3efc9a15-1420-417e-bdfb-c2f2072d0e13","Type":"ContainerStarted","Data":"be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414"}
Aug 02 11:08:01.769022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:01.768988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:08:01.769242 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:01.769221    2563 patch_prober.go:28] interesting pod/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 02 11:08:01.769311 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:01.769290    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 02 11:08:02.768850 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:02.768814    2563 patch_prober.go:28] interesting pod/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 02 11:08:02.769249 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:02.768872    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 02 11:08:03.768508 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:03.768475    2563 patch_prober.go:28] interesting pod/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 02 11:08:03.768681 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:03.768533    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 02 11:08:04.303768 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:04.303736    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:04.357226 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:04.357195    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:04.768676 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:04.768641    2563 patch_prober.go:28] interesting pod/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 02 11:08:04.768860 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:04.768695    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 02 11:08:05.769010 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:05.768968    2563 patch_prober.go:28] interesting pod/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Aug 02 11:08:05.769433 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:05.769026    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Aug 02 11:08:06.772101 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:06.772069    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:08:06.772607 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:06.772296    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:08:06.772978 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:06.772961    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:08:10.753856 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:10.753816    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:10.822600 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:10.822570    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:10.892664 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:10.892627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:10.990994 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:10.990962    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:11.034612 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.034525    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"]
Aug 02 11:08:11.034800 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.034770    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy" containerID="cri-o://be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414" gracePeriod=30
Aug 02 11:08:11.056012 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.055979    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:11.263478 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.263427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:11.700567 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.700533    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:11.804925 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.804893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:11.903742 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:11.903705    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:16.292761 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.292736    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:08:16.382514 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382433    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-data\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382514 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-podinfo\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382514 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382500    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istiod-ca-cert\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382774 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382518    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-credential-socket\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382774 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382544    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-socket\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382774 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382586    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fprrn\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-kube-api-access-fprrn\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382774 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382609    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-envoy\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382774 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382635    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-token\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.382774 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382690    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-certs\") pod \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\" (UID: \"3efc9a15-1420-417e-bdfb-c2f2072d0e13\") "
Aug 02 11:08:16.383081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382769    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-data" (OuterVolumeSpecName: "istio-data") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:08:16.383081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382966    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.383081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382986    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:08:16.383081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.382995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:08:16.383081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.383003    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:08:16.383377 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.383077    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:08:16.384945 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.384915    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:08:16.384945 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.384930    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-kube-api-access-fprrn" (OuterVolumeSpecName: "kube-api-access-fprrn") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "kube-api-access-fprrn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:08:16.385484 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.385455    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-token" (OuterVolumeSpecName: "istio-token") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:08:16.385484 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.385453    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3efc9a15-1420-417e-bdfb-c2f2072d0e13" (UID: "3efc9a15-1420-417e-bdfb-c2f2072d0e13"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:08:16.403397 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.403373    2563 generic.go:356] "Generic (PLEG): container finished" podID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerID="be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414" exitCode=0
Aug 02 11:08:16.403498 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.403422    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"
Aug 02 11:08:16.403498 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.403432    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" event={"ID":"3efc9a15-1420-417e-bdfb-c2f2072d0e13","Type":"ContainerDied","Data":"be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414"}
Aug 02 11:08:16.403498 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.403476    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx" event={"ID":"3efc9a15-1420-417e-bdfb-c2f2072d0e13","Type":"ContainerDied","Data":"3778b6f7ae67e91ff48a679ae913faed18dbe221d3e7fff44b43cffd893582e3"}
Aug 02 11:08:16.403498 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.403497    2563 scope.go:117] "RemoveContainer" containerID="be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414"
Aug 02 11:08:16.412229 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.412213    2563 scope.go:117] "RemoveContainer" containerID="703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"
Aug 02 11:08:16.420226 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.420211    2563 scope.go:117] "RemoveContainer" containerID="be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414"
Aug 02 11:08:16.420522 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:08:16.420502    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414\": container with ID starting with be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414 not found: ID does not exist" containerID="be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414"
Aug 02 11:08:16.420599 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.420583    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414"} err="failed to get container status \"be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414\": rpc error: code = NotFound desc = could not find container \"be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414\": container with ID starting with be9c351bf1de6503d27e59c00adc32a3672085979b3540e3c1362d8237004414 not found: ID does not exist"
Aug 02 11:08:16.420656 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.420601    2563 scope.go:117] "RemoveContainer" containerID="703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"
Aug 02 11:08:16.420856 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:08:16.420837    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63\": container with ID starting with 703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63 not found: ID does not exist" containerID="703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"
Aug 02 11:08:16.420904 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.420862    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63"} err="failed to get container status \"703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63\": rpc error: code = NotFound desc = could not find container \"703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63\": container with ID starting with 703b7008502193c90ac58a854dac8753b9526923ea4075367567eac81b9a1f63 not found: ID does not exist"
Aug 02 11:08:16.422872 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.422854    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"]
Aug 02 11:08:16.428276 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.428239    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-75b9be26-openshift-default-5cd97cb76d-tmjgx"]
Aug 02 11:08:16.484033 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484008    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484033 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484032    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484180 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484045    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484180 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484060    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484180 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484075    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fprrn\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-kube-api-access-fprrn\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484180 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484087    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484180 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484099    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3efc9a15-1420-417e-bdfb-c2f2072d0e13-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.484180 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.484110    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3efc9a15-1420-417e-bdfb-c2f2072d0e13-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:08:16.854121 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:16.854091    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" path="/var/lib/kubelet/pods/3efc9a15-1420-417e-bdfb-c2f2072d0e13/volumes"
Aug 02 11:08:19.775278 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:19.775227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:19.822062 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:19.822028    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:23.475046 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:23.475002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:24.875668 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:24.875637    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:08:24.878851 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:24.878827    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:08:30.332060 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:30.332006    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:30.433976 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:30.433923    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:30.532587 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:30.532554    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:30.631621 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:30.631530    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:30.999861 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:30.999829    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:08:56.932528 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:08:56.932489    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:03.120466 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:03.120425    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:03.178605 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:03.178574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:03.254870 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:03.254837    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:03.352461 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:03.352421    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:19.145491 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:19.145412    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:24.896376 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:24.896340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:24.997444 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:24.997415    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:25.096905 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:25.096869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:25.536459 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:25.536413    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:35.630068 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:35.630026    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:46.635972 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:46.635944    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:52.678407 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:52.678369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:52.739775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:52.739742    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:52.814017 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:52.813947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:52.906103 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:52.906073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:53.009645 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:53.009568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:53.553350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:53.553316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:53.652753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:53.652708    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:53.752983 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:53.752947    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:09:55.201215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:09:55.201176    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:01.332075 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:01.332031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:01.393273 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:01.393230    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:01.984760 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:01.984725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:08.249663 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:08.249627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:08.316966 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:08.316933    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:08.493320 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:08.493278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:08.802510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:08.802473    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:09.172427 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:09.172397    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:12.059402 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:12.059367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:12.152962 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:12.152925    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:13.280135 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.280104    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:13.594061 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.593983    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:13.692764 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.692728    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:13.756754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.756724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:13.763658 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.763633    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"]
Aug 02 11:10:13.763942 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.763930    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy"
Aug 02 11:10:13.763984 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.763943    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy"
Aug 02 11:10:13.763984 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.763957    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy"
Aug 02 11:10:13.763984 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.763963    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy"
Aug 02 11:10:13.764083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.764013    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b77f922b-b4ff-4b73-a187-885b7274f8e9" containerName="istio-proxy"
Aug 02 11:10:13.764083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.764024    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy"
Aug 02 11:10:13.764083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.764030    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="3efc9a15-1420-417e-bdfb-c2f2072d0e13" containerName="istio-proxy"
Aug 02 11:10:13.766863 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.766849    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:13.768540 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.768525    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8126169a\""
Aug 02 11:10:13.768597 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.768536    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8126169a-dockercfg-v968m\""
Aug 02 11:10:13.773635 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.773613    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"]
Aug 02 11:10:13.813585 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.813551    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:13.813788 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.813611    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zknf8\" (UniqueName: \"kubernetes.io/projected/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-kube-api-access-zknf8\") pod \"payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:13.914672 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.914640    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zknf8\" (UniqueName: \"kubernetes.io/projected/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-kube-api-access-zknf8\") pod \"payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:13.914859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.914714    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:13.915375 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.915358    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:13.922074 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:13.922040    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zknf8\" (UniqueName: \"kubernetes.io/projected/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-kube-api-access-zknf8\") pod \"payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:14.078448 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:14.078407    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:14.208610 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:14.208580    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"]
Aug 02 11:10:14.211243 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:10:14.211205    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6b74c4_2d7f_4c69_8617_d08b37f7d71a.slice/crio-15aae8222bbe9b7d48d68ec0e8088b0fafacb29a35a5d525b6d402a8b73d2ef0 WatchSource:0}: Error finding container 15aae8222bbe9b7d48d68ec0e8088b0fafacb29a35a5d525b6d402a8b73d2ef0: Status 404 returned error can't find the container with id 15aae8222bbe9b7d48d68ec0e8088b0fafacb29a35a5d525b6d402a8b73d2ef0
Aug 02 11:10:14.917698 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:14.917660    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5" event={"ID":"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a","Type":"ContainerStarted","Data":"06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca"}
Aug 02 11:10:14.918192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:14.917720    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5" event={"ID":"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a","Type":"ContainerStarted","Data":"15aae8222bbe9b7d48d68ec0e8088b0fafacb29a35a5d525b6d402a8b73d2ef0"}
Aug 02 11:10:14.918192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:14.917789    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:14.932382 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:14.932331    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5" podStartSLOduration=1.932314097 podStartE2EDuration="1.932314097s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:10:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:10:14.930533304 +0000 UTC m=+2210.588750894" watchObservedRunningTime="2026-08-02 11:10:14.932314097 +0000 UTC m=+2210.590531687"
Aug 02 11:10:25.926316 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:25.926256    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:37.014321 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:37.014284    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:37.657502 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:37.657465    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:37.757436 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:37.757402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:38.095218 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:38.095127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:43.888312 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:43.888278    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:44.572367 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.572325    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"]
Aug 02 11:10:44.572562 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.572541    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5" podUID="5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" containerName="payload-pre-processing" containerID="cri-o://06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca" gracePeriod=30
Aug 02 11:10:44.828671 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.828610    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:44.891037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.891005    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-plugins-config-volume\") pod \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") "
Aug 02 11:10:44.891483 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.891091    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zknf8\" (UniqueName: \"kubernetes.io/projected/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-kube-api-access-zknf8\") pod \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\" (UID: \"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a\") "
Aug 02 11:10:44.891483 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.891457    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" (UID: "5d6b74c4-2d7f-4c69-8617-d08b37f7d71a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:10:44.893360 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.893335    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-kube-api-access-zknf8" (OuterVolumeSpecName: "kube-api-access-zknf8") pod "5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" (UID: "5d6b74c4-2d7f-4c69-8617-d08b37f7d71a"). InnerVolumeSpecName "kube-api-access-zknf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:10:44.991896 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.991856    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zknf8\" (UniqueName: \"kubernetes.io/projected/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-kube-api-access-zknf8\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:10:44.991896 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:44.991889    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:10:45.049226 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.049192    2563 generic.go:356] "Generic (PLEG): container finished" podID="5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" containerID="06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca" exitCode=0
Aug 02 11:10:45.049438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.049235    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"
Aug 02 11:10:45.049438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.049300    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5" event={"ID":"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a","Type":"ContainerDied","Data":"06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca"}
Aug 02 11:10:45.049438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.049354    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5" event={"ID":"5d6b74c4-2d7f-4c69-8617-d08b37f7d71a","Type":"ContainerDied","Data":"15aae8222bbe9b7d48d68ec0e8088b0fafacb29a35a5d525b6d402a8b73d2ef0"}
Aug 02 11:10:45.049438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.049387    2563 scope.go:117] "RemoveContainer" containerID="06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca"
Aug 02 11:10:45.057630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.057615    2563 scope.go:117] "RemoveContainer" containerID="06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca"
Aug 02 11:10:45.057906 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:10:45.057889    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca\": container with ID starting with 06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca not found: ID does not exist" containerID="06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca"
Aug 02 11:10:45.057958 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.057917    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca"} err="failed to get container status \"06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca\": rpc error: code = NotFound desc = could not find container \"06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca\": container with ID starting with 06318b07ec08524e12e5b7159ac3050dfc96845b7f76932f56570fc903ef2bca not found: ID does not exist"
Aug 02 11:10:45.068171 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.068146    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"]
Aug 02 11:10:45.071363 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.071343    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8126169a-576b945884-wsfd5"]
Aug 02 11:10:45.135858 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:45.135776    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:46.846326 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:46.846204    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" path="/var/lib/kubelet/pods/5d6b74c4-2d7f-4c69-8617-d08b37f7d71a/volumes"
Aug 02 11:10:51.100887 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.100848    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:51.159539 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.159505    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:51.358076 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.357988    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:51.578833 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.578782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:51.704853 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.704821    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:51.794761 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.794730    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:51.915910 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:51.915877    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:57.842341 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:57.842306    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:57.956818 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:57.956782    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:58.047420 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:58.047380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:10:58.183734 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:10:58.183702    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:11:04.077106 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:11:04.077071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:11:04.178022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:11:04.177986    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:12:19.668093 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:12:19.668052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:12:53.838584 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:12:53.838547    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:06.512616 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:06.512582    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:06.820798 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:06.820711    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:07.060875 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:07.060831    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:10.096879 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:10.096845    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:10.193227 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:10.193185    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:11.221051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.221018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:11.566500 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.566410    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:11.810286 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.810233    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:11.900690 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.900650    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:11.904215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.904184    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"]
Aug 02 11:13:11.904611 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.904592    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" containerName="payload-pre-processing"
Aug 02 11:13:11.904691 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.904613    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" containerName="payload-pre-processing"
Aug 02 11:13:11.904750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.904702    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6b74c4-2d7f-4c69-8617-d08b37f7d71a" containerName="payload-pre-processing"
Aug 02 11:13:11.907367 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.907347    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:11.909220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.909198    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-a9dd0457\""
Aug 02 11:13:11.909220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.909215    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-a9dd0457-dockercfg-ftdsr\""
Aug 02 11:13:11.914191 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:11.914164    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"]
Aug 02 11:13:12.044665 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.044624    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqp47\" (UniqueName: \"kubernetes.io/projected/093c81bb-0204-428b-bf0b-845084c9c846-kube-api-access-pqp47\") pod \"payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.044849 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.044766    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c81bb-0204-428b-bf0b-845084c9c846-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.145969 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.145935    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c81bb-0204-428b-bf0b-845084c9c846-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.146144 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.145992    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqp47\" (UniqueName: \"kubernetes.io/projected/093c81bb-0204-428b-bf0b-845084c9c846-kube-api-access-pqp47\") pod \"payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.146645 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.146625    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c81bb-0204-428b-bf0b-845084c9c846-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.153204 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.153143    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqp47\" (UniqueName: \"kubernetes.io/projected/093c81bb-0204-428b-bf0b-845084c9c846-kube-api-access-pqp47\") pod \"payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.219220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.219180    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.351306 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.351278    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"]
Aug 02 11:13:12.353322 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:13:12.353294    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093c81bb_0204_428b_bf0b_845084c9c846.slice/crio-1f6d125a4fe5abd85f29c1a99ca1681aa8cc4c6827a7111ab0af192b30238316 WatchSource:0}: Error finding container 1f6d125a4fe5abd85f29c1a99ca1681aa8cc4c6827a7111ab0af192b30238316: Status 404 returned error can't find the container with id 1f6d125a4fe5abd85f29c1a99ca1681aa8cc4c6827a7111ab0af192b30238316
Aug 02 11:13:12.687158 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.687064    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4" event={"ID":"093c81bb-0204-428b-bf0b-845084c9c846","Type":"ContainerStarted","Data":"ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad"}
Aug 02 11:13:12.687158 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.687117    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4" event={"ID":"093c81bb-0204-428b-bf0b-845084c9c846","Type":"ContainerStarted","Data":"1f6d125a4fe5abd85f29c1a99ca1681aa8cc4c6827a7111ab0af192b30238316"}
Aug 02 11:13:12.687380 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.687158    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:12.702137 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:12.702086    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4" podStartSLOduration=1.702070284 podStartE2EDuration="1.702070284s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:13:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:13:12.700504024 +0000 UTC m=+2388.358721628" watchObservedRunningTime="2026-08-02 11:13:12.702070284 +0000 UTC m=+2388.360287874"
Aug 02 11:13:23.693278 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:23.693225    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:13:24.905064 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:24.905027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:13:24.908011 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:24.907985    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:13:35.074458 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:35.074424    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:52.234342 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.234242    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"]
Aug 02 11:13:52.237628 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.237613    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.239606 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.239587    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a9dd0457\"/\"kube-root-ca.crt\""
Aug 02 11:13:52.240233 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.240216    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-a9dd0457\"/\"openshift-service-ca.crt\""
Aug 02 11:13:52.240324 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.240216    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a9dd0457\"/\"default-dockercfg-8rljw\""
Aug 02 11:13:52.240415 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.240395    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-a9dd0457\"/\"e2e-lifecycle-model-a9dd0457-kserve-self-signed-certs\""
Aug 02 11:13:52.247222 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.247198    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"]
Aug 02 11:13:52.258911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.258882    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:13:52.375292 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.375230    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-tmp-dir\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.375492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.375376    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-home\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.375492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.375416    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-model-cache\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.375492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.375462    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-dshm\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.375492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.375486    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58671fb7-7a87-4e64-844d-3d05a5f136df-tls-certs\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.375670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.375511    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p255g\" (UniqueName: \"kubernetes.io/projected/58671fb7-7a87-4e64-844d-3d05a5f136df-kube-api-access-p255g\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.476684 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.476650    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-home\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.476881 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.476692    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-model-cache\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.476881 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.476716    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-dshm\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.476881 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.476737    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58671fb7-7a87-4e64-844d-3d05a5f136df-tls-certs\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.476881 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.476754    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p255g\" (UniqueName: \"kubernetes.io/projected/58671fb7-7a87-4e64-844d-3d05a5f136df-kube-api-access-p255g\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.476881 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.476791    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-tmp-dir\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.477130 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.477111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-model-cache\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.477189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.477158    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-tmp-dir\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.477189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.477172    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-home\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.479159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.479138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-dshm\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.479449 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.479430    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58671fb7-7a87-4e64-844d-3d05a5f136df-tls-certs\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.486716 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.486663    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p255g\" (UniqueName: \"kubernetes.io/projected/58671fb7-7a87-4e64-844d-3d05a5f136df-kube-api-access-p255g\") pod \"e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") " pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.547234 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.547197    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:13:52.677764 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.677713    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"]
Aug 02 11:13:52.680644 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:13:52.680622    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod58671fb7_7a87_4e64_844d_3d05a5f136df.slice/crio-8a05ee37c03154f4912b6253ca77930ba8116e307b188428e6077a4aa9ddb824 WatchSource:0}: Error finding container 8a05ee37c03154f4912b6253ca77930ba8116e307b188428e6077a4aa9ddb824: Status 404 returned error can't find the container with id 8a05ee37c03154f4912b6253ca77930ba8116e307b188428e6077a4aa9ddb824
Aug 02 11:13:52.857511 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.857422    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d" event={"ID":"58671fb7-7a87-4e64-844d-3d05a5f136df","Type":"ContainerStarted","Data":"37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6"}
Aug 02 11:13:52.857511 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.857459    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d" event={"ID":"58671fb7-7a87-4e64-844d-3d05a5f136df","Type":"ContainerStarted","Data":"8a05ee37c03154f4912b6253ca77930ba8116e307b188428e6077a4aa9ddb824"}
Aug 02 11:13:52.873598 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:13:52.873558    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d" podStartSLOduration=0.87354261 podStartE2EDuration="873.54261ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:13:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:13:52.872417386 +0000 UTC m=+2428.530634975" watchObservedRunningTime="2026-08-02 11:13:52.87354261 +0000 UTC m=+2428.531760200"
Aug 02 11:14:02.547883 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:14:02.547847    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:14:02.548416 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:14:02.547903    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:14:02.560540 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:14:02.560510    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:14:02.911943 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:14:02.911906    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:16:18.422020 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:16:18.421978    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:16:21.313412 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:16:21.313369    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:16:37.103400 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:16:37.103364    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:16:37.157966 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:16:37.157931    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:17:27.843045 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:27.842958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:17:27.865704 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:27.865661    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"]
Aug 02 11:17:27.866183 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:27.866116    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4" podUID="093c81bb-0204-428b-bf0b-845084c9c846" containerName="payload-pre-processing" containerID="cri-o://ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad" gracePeriod=30
Aug 02 11:17:27.940301 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:27.940251    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:17:28.040443 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.040405    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:17:28.118431 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.118407    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:17:28.252082 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.252041    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqp47\" (UniqueName: \"kubernetes.io/projected/093c81bb-0204-428b-bf0b-845084c9c846-kube-api-access-pqp47\") pod \"093c81bb-0204-428b-bf0b-845084c9c846\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") "
Aug 02 11:17:28.252345 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.252116    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c81bb-0204-428b-bf0b-845084c9c846-plugins-config-volume\") pod \"093c81bb-0204-428b-bf0b-845084c9c846\" (UID: \"093c81bb-0204-428b-bf0b-845084c9c846\") "
Aug 02 11:17:28.252557 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.252533    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093c81bb-0204-428b-bf0b-845084c9c846-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "093c81bb-0204-428b-bf0b-845084c9c846" (UID: "093c81bb-0204-428b-bf0b-845084c9c846"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:17:28.254394 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.254362    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093c81bb-0204-428b-bf0b-845084c9c846-kube-api-access-pqp47" (OuterVolumeSpecName: "kube-api-access-pqp47") pod "093c81bb-0204-428b-bf0b-845084c9c846" (UID: "093c81bb-0204-428b-bf0b-845084c9c846"). InnerVolumeSpecName "kube-api-access-pqp47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:17:28.353002 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.352921    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqp47\" (UniqueName: \"kubernetes.io/projected/093c81bb-0204-428b-bf0b-845084c9c846-kube-api-access-pqp47\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:28.353002 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.352948    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/093c81bb-0204-428b-bf0b-845084c9c846-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:28.370696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.370665    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:17:28.797897 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.797858    2563 generic.go:356] "Generic (PLEG): container finished" podID="093c81bb-0204-428b-bf0b-845084c9c846" containerID="ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad" exitCode=0
Aug 02 11:17:28.797897 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.797900    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"
Aug 02 11:17:28.798113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.797949    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4" event={"ID":"093c81bb-0204-428b-bf0b-845084c9c846","Type":"ContainerDied","Data":"ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad"}
Aug 02 11:17:28.798113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.798000    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4" event={"ID":"093c81bb-0204-428b-bf0b-845084c9c846","Type":"ContainerDied","Data":"1f6d125a4fe5abd85f29c1a99ca1681aa8cc4c6827a7111ab0af192b30238316"}
Aug 02 11:17:28.798113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.798023    2563 scope.go:117] "RemoveContainer" containerID="ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad"
Aug 02 11:17:28.807209 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.807190    2563 scope.go:117] "RemoveContainer" containerID="ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad"
Aug 02 11:17:28.807539 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:17:28.807517    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad\": container with ID starting with ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad not found: ID does not exist" containerID="ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad"
Aug 02 11:17:28.807603 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.807556    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad"} err="failed to get container status \"ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad\": rpc error: code = NotFound desc = could not find container \"ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad\": container with ID starting with ee4c1390fed536947b0a450fe7ce074cca0871d384e14b12433e0cf427cd84ad not found: ID does not exist"
Aug 02 11:17:28.817634 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.817611    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"]
Aug 02 11:17:28.823335 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.823314    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-a9dd0457-6c4dfd445b-qs4r4"]
Aug 02 11:17:28.846983 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:28.846953    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093c81bb-0204-428b-bf0b-845084c9c846" path="/var/lib/kubelet/pods/093c81bb-0204-428b-bf0b-845084c9c846/volumes"
Aug 02 11:17:33.359089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:33.359052    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"]
Aug 02 11:17:33.455126 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:33.455092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:17:48.378745 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.378698    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d" podUID="58671fb7-7a87-4e64-844d-3d05a5f136df" containerName="main" containerID="cri-o://37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6" gracePeriod=45
Aug 02 11:17:48.628400 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.628379    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:17:48.731407 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731376    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-dshm\") pod \"58671fb7-7a87-4e64-844d-3d05a5f136df\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") "
Aug 02 11:17:48.731407 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731422    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p255g\" (UniqueName: \"kubernetes.io/projected/58671fb7-7a87-4e64-844d-3d05a5f136df-kube-api-access-p255g\") pod \"58671fb7-7a87-4e64-844d-3d05a5f136df\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") "
Aug 02 11:17:48.731692 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731453    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-model-cache\") pod \"58671fb7-7a87-4e64-844d-3d05a5f136df\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") "
Aug 02 11:17:48.731692 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731495    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-tmp-dir\") pod \"58671fb7-7a87-4e64-844d-3d05a5f136df\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") "
Aug 02 11:17:48.731692 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731518    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-home\") pod \"58671fb7-7a87-4e64-844d-3d05a5f136df\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") "
Aug 02 11:17:48.731692 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731560    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58671fb7-7a87-4e64-844d-3d05a5f136df-tls-certs\") pod \"58671fb7-7a87-4e64-844d-3d05a5f136df\" (UID: \"58671fb7-7a87-4e64-844d-3d05a5f136df\") "
Aug 02 11:17:48.731911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731766    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-model-cache" (OuterVolumeSpecName: "model-cache") pod "58671fb7-7a87-4e64-844d-3d05a5f136df" (UID: "58671fb7-7a87-4e64-844d-3d05a5f136df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:17:48.731911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731780    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-home" (OuterVolumeSpecName: "home") pod "58671fb7-7a87-4e64-844d-3d05a5f136df" (UID: "58671fb7-7a87-4e64-844d-3d05a5f136df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:17:48.731911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.731798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "58671fb7-7a87-4e64-844d-3d05a5f136df" (UID: "58671fb7-7a87-4e64-844d-3d05a5f136df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:17:48.733815 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.733791    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58671fb7-7a87-4e64-844d-3d05a5f136df-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "58671fb7-7a87-4e64-844d-3d05a5f136df" (UID: "58671fb7-7a87-4e64-844d-3d05a5f136df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:17:48.733815 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.733799    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-dshm" (OuterVolumeSpecName: "dshm") pod "58671fb7-7a87-4e64-844d-3d05a5f136df" (UID: "58671fb7-7a87-4e64-844d-3d05a5f136df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:17:48.733948 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.733827    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58671fb7-7a87-4e64-844d-3d05a5f136df-kube-api-access-p255g" (OuterVolumeSpecName: "kube-api-access-p255g") pod "58671fb7-7a87-4e64-844d-3d05a5f136df" (UID: "58671fb7-7a87-4e64-844d-3d05a5f136df"). InnerVolumeSpecName "kube-api-access-p255g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:17:48.832563 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.832531    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:48.832563 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.832559    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p255g\" (UniqueName: \"kubernetes.io/projected/58671fb7-7a87-4e64-844d-3d05a5f136df-kube-api-access-p255g\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:48.832563 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.832572    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:48.832811 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.832601    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:48.832811 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.832609    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58671fb7-7a87-4e64-844d-3d05a5f136df-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:48.832811 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.832617    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58671fb7-7a87-4e64-844d-3d05a5f136df-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:17:48.888991 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.888958    2563 generic.go:356] "Generic (PLEG): container finished" podID="58671fb7-7a87-4e64-844d-3d05a5f136df" containerID="37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6" exitCode=0
Aug 02 11:17:48.889188 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.888997    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"
Aug 02 11:17:48.889188 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.889053    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d" event={"ID":"58671fb7-7a87-4e64-844d-3d05a5f136df","Type":"ContainerDied","Data":"37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6"}
Aug 02 11:17:48.889188 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.889094    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d" event={"ID":"58671fb7-7a87-4e64-844d-3d05a5f136df","Type":"ContainerDied","Data":"8a05ee37c03154f4912b6253ca77930ba8116e307b188428e6077a4aa9ddb824"}
Aug 02 11:17:48.889188 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.889111    2563 scope.go:117] "RemoveContainer" containerID="37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6"
Aug 02 11:17:48.897816 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.897796    2563 scope.go:117] "RemoveContainer" containerID="37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6"
Aug 02 11:17:48.898077 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:17:48.898056    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6\": container with ID starting with 37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6 not found: ID does not exist" containerID="37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6"
Aug 02 11:17:48.898158 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.898088    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6"} err="failed to get container status \"37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6\": rpc error: code = NotFound desc = could not find container \"37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6\": container with ID starting with 37e36d6d77f336fcbdadabc46d76878da0a63adad6c50bd29c563092037a67a6 not found: ID does not exist"
Aug 02 11:17:48.902806 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.902784    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"]
Aug 02 11:17:48.906184 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:48.906165    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-a9dd0457/e2e-lifecycle-model-a9dd0457-kserve-7d8945964c-phj2d"]
Aug 02 11:17:50.846387 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:17:50.846351    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58671fb7-7a87-4e64-844d-3d05a5f136df" path="/var/lib/kubelet/pods/58671fb7-7a87-4e64-844d-3d05a5f136df/volumes"
Aug 02 11:18:08.489042 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:08.488989    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:08.759844 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:08.759735    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:14.487054 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:14.487010    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:14.586660 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:14.586614    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:14.757449 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:14.757357    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:14.977072 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:14.977037    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:24.930742 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:24.930660    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:18:24.935279 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:24.935244    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:18:26.312287 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:26.312234    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:26.412094 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:26.412061    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:26.512178 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:26.512142    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:27.149780 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:27.149744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:27.259783 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:27.259750    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:28.576121 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:28.576086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:35.493577 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:35.493538    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:35.556301 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:35.556256    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:36.149159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:36.149117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:42.501610 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:42.501574    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:42.560228 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:42.560190    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:42.628178 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:42.628139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:42.728795 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:42.728760    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:53.197374 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:53.197340    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:18:53.412184 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:18:53.412147    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:14.326651 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:14.326613    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:20.555415 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:20.555376    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:20.655706 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:20.655663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:20.888306 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:20.888231    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:21.197511 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:21.197418    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:21.791403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:21.791367    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:24.234755 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:24.234725    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:24.334283 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:24.334225    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:25.341839 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.341794    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:25.499336 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.499300    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:25.827062 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.827031    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:25.942061 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.942018    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:25.957809 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.957778    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"]
Aug 02 11:19:25.958096 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.958084    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093c81bb-0204-428b-bf0b-845084c9c846" containerName="payload-pre-processing"
Aug 02 11:19:25.958141 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.958097    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="093c81bb-0204-428b-bf0b-845084c9c846" containerName="payload-pre-processing"
Aug 02 11:19:25.958141 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.958107    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58671fb7-7a87-4e64-844d-3d05a5f136df" containerName="main"
Aug 02 11:19:25.958141 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.958112    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="58671fb7-7a87-4e64-844d-3d05a5f136df" containerName="main"
Aug 02 11:19:25.958315 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.958170    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="093c81bb-0204-428b-bf0b-845084c9c846" containerName="payload-pre-processing"
Aug 02 11:19:25.958315 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.958181    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="58671fb7-7a87-4e64-844d-3d05a5f136df" containerName="main"
Aug 02 11:19:25.960542 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.960527    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:25.962809 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.962790    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-638e7f\""
Aug 02 11:19:25.963459 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.963437    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-638e7f-dockercfg-2q4rv\""
Aug 02 11:19:25.974490 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.974467    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"]
Aug 02 11:19:25.981906 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.981885    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:25.982004 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:25.981919    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpwvm\" (UniqueName: \"kubernetes.io/projected/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-kube-api-access-lpwvm\") pod \"payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:26.083237 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:26.083142    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:26.083237 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:26.083190    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lpwvm\" (UniqueName: \"kubernetes.io/projected/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-kube-api-access-lpwvm\") pod \"payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:26.083841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:26.083823    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:26.094999 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:26.094978    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpwvm\" (UniqueName: \"kubernetes.io/projected/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-kube-api-access-lpwvm\") pod \"payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:26.270890 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:26.270856    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:26.405159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:26.405133    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"]
Aug 02 11:19:26.407126 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:19:26.407096    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eab1c81_50ba_4fc9_8531_0c29a0e2d13a.slice/crio-cae11cf1a68f150d7256928d53f0111c8fe8c09c17814824132a2c5c3e150dd4 WatchSource:0}: Error finding container cae11cf1a68f150d7256928d53f0111c8fe8c09c17814824132a2c5c3e150dd4: Status 404 returned error can't find the container with id cae11cf1a68f150d7256928d53f0111c8fe8c09c17814824132a2c5c3e150dd4
Aug 02 11:19:27.315852 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:27.315816    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr" event={"ID":"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a","Type":"ContainerStarted","Data":"1e407a424681ed68e351a66f32a2421f1889d8c85d0ef551043f14ca60df1981"}
Aug 02 11:19:27.316056 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:27.315874    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr" event={"ID":"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a","Type":"ContainerStarted","Data":"cae11cf1a68f150d7256928d53f0111c8fe8c09c17814824132a2c5c3e150dd4"}
Aug 02 11:19:27.316056 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:27.315898    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:27.331873 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:27.331826    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr" podStartSLOduration=2.3318097079999998 podStartE2EDuration="2.331809708s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:19:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:19:27.329732977 +0000 UTC m=+2762.987950567" watchObservedRunningTime="2026-08-02 11:19:27.331809708 +0000 UTC m=+2762.990027298"
Aug 02 11:19:38.322872 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:38.322836    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:19:49.234288 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.234173    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:49.559802 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.559715    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:49.838157 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.838081    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"]
Aug 02 11:19:49.841493 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.841474    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.843352 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.843332    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-66e93e-openshift-default-dockercfg-gg9fm\""
Aug 02 11:19:49.851461 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.851430    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"]
Aug 02 11:19:49.861712 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.861685    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:49.998022 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.997980    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-credential-socket\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998036    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674d7490-7e59-44c6-a69a-2128ce785d04-istiod-ca-cert\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998065    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-socket\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-certs\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998114    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-envoy\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998220 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998129    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-data\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998450 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998240    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674d7490-7e59-44c6-a69a-2128ce785d04-istio-podinfo\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998450 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998303    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-istio-token\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:49.998450 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:49.998330    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bzrc\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-kube-api-access-2bzrc\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.074338 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.074304    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:50.099099 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099021    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-credential-socket\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099099 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099067    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674d7490-7e59-44c6-a69a-2128ce785d04-istiod-ca-cert\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099099 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099096    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-socket\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099386 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099117    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-certs\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099386 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099137    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-envoy\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099386 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099161    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-data\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099386 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674d7490-7e59-44c6-a69a-2128ce785d04-istio-podinfo\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099386 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099310    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-istio-token\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099386 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099348    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bzrc\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-kube-api-access-2bzrc\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099714 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099522    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-credential-socket\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099714 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099704    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-socket\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099822 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099773    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-certs\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.099822 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.099804    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-data\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.100284 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.100233    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674d7490-7e59-44c6-a69a-2128ce785d04-istiod-ca-cert\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.101899 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.101868    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-envoy\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.102059 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.102039    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674d7490-7e59-44c6-a69a-2128ce785d04-istio-podinfo\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.106483 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.106463    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-istio-token\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.106644 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.106627    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bzrc\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-kube-api-access-2bzrc\") pod \"e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") " pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.151837 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.151802    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:50.293123 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.293098    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"]
Aug 02 11:19:50.295488 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:19:50.295458    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod674d7490_7e59_44c6_a69a_2128ce785d04.slice/crio-2bebbf0f7c1e61ab977a8635737b2c84d6da59302d8221dae0f7fc91d18cd455 WatchSource:0}: Error finding container 2bebbf0f7c1e61ab977a8635737b2c84d6da59302d8221dae0f7fc91d18cd455: Status 404 returned error can't find the container with id 2bebbf0f7c1e61ab977a8635737b2c84d6da59302d8221dae0f7fc91d18cd455
Aug 02 11:19:50.297652 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.297618    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:19:50.297754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.297704    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:19:50.297754 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.297746    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:19:50.425496 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.425454    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" event={"ID":"674d7490-7e59-44c6-a69a-2128ce785d04","Type":"ContainerStarted","Data":"3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"}
Aug 02 11:19:50.425694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.425545    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" event={"ID":"674d7490-7e59-44c6-a69a-2128ce785d04","Type":"ContainerStarted","Data":"2bebbf0f7c1e61ab977a8635737b2c84d6da59302d8221dae0f7fc91d18cd455"}
Aug 02 11:19:50.446641 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:50.446582    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podStartSLOduration=1.446560549 podStartE2EDuration="1.446560549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:19:50.443965267 +0000 UTC m=+2786.102182859" watchObservedRunningTime="2026-08-02 11:19:50.446560549 +0000 UTC m=+2786.104778139"
Aug 02 11:19:51.152923 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:51.152891    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:51.158484 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:51.158460    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:51.429349 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:51.429251    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:51.430307 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:51.430283    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:19:52.355135 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:52.355097    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:52.457994 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:52.457958    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:53.471966 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:53.471930    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:53.687190 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:53.687130    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:53.941730 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:53.941696    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:19:54.042127 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:19:54.042086    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:20:06.430737 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.430701    2563 patch_prober.go:28] interesting pod/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 02 11:20:06.431151 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.430759    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 02 11:20:06.497273 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.497239    2563 generic.go:356] "Generic (PLEG): container finished" podID="674d7490-7e59-44c6-a69a-2128ce785d04" containerID="3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0" exitCode=0
Aug 02 11:20:06.497453 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.497320    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" event={"ID":"674d7490-7e59-44c6-a69a-2128ce785d04","Type":"ContainerDied","Data":"3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"}
Aug 02 11:20:06.497715 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.497703    2563 scope.go:117] "RemoveContainer" containerID="3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"
Aug 02 11:20:06.498736 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.498712    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:20:06.498798 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.498778    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:20:06.498833 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:06.498809    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:20:07.502849 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:07.502809    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" event={"ID":"674d7490-7e59-44c6-a69a-2128ce785d04","Type":"ContainerStarted","Data":"981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7"}
Aug 02 11:20:08.152725 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:08.152686    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:20:08.153076 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:08.153051    2563 patch_prober.go:28] interesting pod/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 02 11:20:08.153139 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:08.153121    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 02 11:20:09.152718 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:09.152682    2563 patch_prober.go:28] interesting pod/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 02 11:20:09.153119 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:09.152756    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 02 11:20:10.152208 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:10.152167    2563 patch_prober.go:28] interesting pod/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 02 11:20:10.152449 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:10.152228    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 02 11:20:11.153147 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:11.153111    2563 patch_prober.go:28] interesting pod/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 02 11:20:11.153581 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:11.153185    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 02 11:20:12.152740 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:12.152701    2563 patch_prober.go:28] interesting pod/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Aug 02 11:20:12.152962 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:12.152759    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Aug 02 11:20:13.156569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:13.156539    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:20:13.156941 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:13.156912    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:20:13.157582 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:13.157568    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:20:17.314135 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:17.314091    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:20:24.344880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.344849    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"]
Aug 02 11:20:24.347199 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.347182    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.349223 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.349201    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-638e7f\"/\"kube-root-ca.crt\""
Aug 02 11:20:24.349651 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.349630    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-638e7f\"/\"openshift-service-ca.crt\""
Aug 02 11:20:24.349740 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.349668    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-638e7f\"/\"test-model-638e7f-kserve-self-signed-certs\""
Aug 02 11:20:24.349740 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.349726    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-638e7f\"/\"default-dockercfg-mvb4k\""
Aug 02 11:20:24.358697 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.358674    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"]
Aug 02 11:20:24.366467 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.366447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:20:24.418334 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.418295    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxzkc\" (UniqueName: \"kubernetes.io/projected/73700390-59d2-488a-b1f1-949fd467433d-kube-api-access-sxzkc\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.418510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.418393    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73700390-59d2-488a-b1f1-949fd467433d-tls-certs\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.418510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.418452    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-home\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.418510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.418468    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-model-cache\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.418510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.418489    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-tmp-dir\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.418651 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.418546    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-dshm\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519013 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.518978    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-dshm\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519196 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519033    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxzkc\" (UniqueName: \"kubernetes.io/projected/73700390-59d2-488a-b1f1-949fd467433d-kube-api-access-sxzkc\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519196 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519083    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73700390-59d2-488a-b1f1-949fd467433d-tls-certs\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519300 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519217    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-home\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519300 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519249    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-model-cache\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519459 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519433    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-tmp-dir\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519609 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519596    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-model-cache\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.519684 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.519635    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-home\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.520035 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.520014    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-tmp-dir\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.521609 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.521577    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-dshm\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.521780 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.521762    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73700390-59d2-488a-b1f1-949fd467433d-tls-certs\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.526507 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.526482    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxzkc\" (UniqueName: \"kubernetes.io/projected/73700390-59d2-488a-b1f1-949fd467433d-kube-api-access-sxzkc\") pod \"test-model-638e7f-kserve-7c79ff8b7-j7qsm\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") " pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.656503 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.656453    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:24.794836 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:24.794810    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"]
Aug 02 11:20:24.797524 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:20:24.797479    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73700390_59d2_488a_b1f1_949fd467433d.slice/crio-e2b5478f26151aa68a5fbd765afd91d3cdbd378307fb47513797644f90238227 WatchSource:0}: Error finding container e2b5478f26151aa68a5fbd765afd91d3cdbd378307fb47513797644f90238227: Status 404 returned error can't find the container with id e2b5478f26151aa68a5fbd765afd91d3cdbd378307fb47513797644f90238227
Aug 02 11:20:25.587775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:25.587742    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm" event={"ID":"73700390-59d2-488a-b1f1-949fd467433d","Type":"ContainerStarted","Data":"9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713"}
Aug 02 11:20:25.587775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:25.587780    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm" event={"ID":"73700390-59d2-488a-b1f1-949fd467433d","Type":"ContainerStarted","Data":"e2b5478f26151aa68a5fbd765afd91d3cdbd378307fb47513797644f90238227"}
Aug 02 11:20:25.602447 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:25.602393    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm" podStartSLOduration=1.602378003 podStartE2EDuration="1.602378003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:20:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:20:25.601889058 +0000 UTC m=+2821.260106648" watchObservedRunningTime="2026-08-02 11:20:25.602378003 +0000 UTC m=+2821.260595593"
Aug 02 11:20:34.656663 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:34.656630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:34.657149 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:34.656691    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:34.669305 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:34.669254    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:20:35.643055 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:20:35.643028    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:21:02.345783 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.345749    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"]
Aug 02 11:21:02.348968 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.348953    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.351397 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.351377    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-66e93e\"/\"default-dockercfg-sjtqn\""
Aug 02 11:21:02.351397 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.351385    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-66e93e\"/\"openshift-service-ca.crt\""
Aug 02 11:21:02.351569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.351407    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-66e93e\"/\"kube-root-ca.crt\""
Aug 02 11:21:02.351569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.351438    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-66e93e\"/\"test-model-66e93e-kserve-self-signed-certs\""
Aug 02 11:21:02.365374 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.359226    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"]
Aug 02 11:21:02.372309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.372257    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:21:02.467320 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.467242    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-dshm\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.467320 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.467333    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t6fh\" (UniqueName: \"kubernetes.io/projected/5ec08b4d-07aa-47cf-a311-506500f95731-kube-api-access-5t6fh\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.467588 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.467395    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-home\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.467588 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.467417    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-tmp-dir\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.467588 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.467433    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ec08b4d-07aa-47cf-a311-506500f95731-tls-certs\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.467588 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.467457    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-model-cache\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.568535 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568483    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-home\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.568535 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568547    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-tmp-dir\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.568783 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568574    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ec08b4d-07aa-47cf-a311-506500f95731-tls-certs\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.568783 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568605    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-model-cache\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.568783 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568694    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-dshm\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.568783 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568725    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t6fh\" (UniqueName: \"kubernetes.io/projected/5ec08b4d-07aa-47cf-a311-506500f95731-kube-api-access-5t6fh\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.569005 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.568961    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-home\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.569062 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.569002    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-tmp-dir\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.569102 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.569064    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-model-cache\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.571020 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.570981    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-dshm\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.571162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.571140    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ec08b4d-07aa-47cf-a311-506500f95731-tls-certs\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.575676 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.575654    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t6fh\" (UniqueName: \"kubernetes.io/projected/5ec08b4d-07aa-47cf-a311-506500f95731-kube-api-access-5t6fh\") pod \"test-model-66e93e-kserve-5795db95f7-q4l6v\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") " pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.666242 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.666206    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:02.798496 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:02.798466    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"]
Aug 02 11:21:02.801766 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:21:02.801738    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ec08b4d_07aa_47cf_a311_506500f95731.slice/crio-d7d3e96d54cd3cbe7e23e11a68e24df93f16eda37c973d822fb334a62e720a2b WatchSource:0}: Error finding container d7d3e96d54cd3cbe7e23e11a68e24df93f16eda37c973d822fb334a62e720a2b: Status 404 returned error can't find the container with id d7d3e96d54cd3cbe7e23e11a68e24df93f16eda37c973d822fb334a62e720a2b
Aug 02 11:21:03.754885 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:03.754852    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v" event={"ID":"5ec08b4d-07aa-47cf-a311-506500f95731","Type":"ContainerStarted","Data":"c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64"}
Aug 02 11:21:03.754885 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:03.754893    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v" event={"ID":"5ec08b4d-07aa-47cf-a311-506500f95731","Type":"ContainerStarted","Data":"d7d3e96d54cd3cbe7e23e11a68e24df93f16eda37c973d822fb334a62e720a2b"}
Aug 02 11:21:03.768998 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:03.768945    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v" podStartSLOduration=1.7689303079999998 podStartE2EDuration="1.768930308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:21:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:21:03.768242907 +0000 UTC m=+2859.426460498" watchObservedRunningTime="2026-08-02 11:21:03.768930308 +0000 UTC m=+2859.427147897"
Aug 02 11:21:12.667343 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:12.667310    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:12.667897 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:12.667487    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:12.680110 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:12.680088    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:12.806901 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:12.806873    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:21:57.134369 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:57.134331    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"]
Aug 02 11:21:57.155141 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:57.155107    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:21:58.122130 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:58.122095    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"]
Aug 02 11:21:58.216577 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:58.216536    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:21:58.810415 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:58.810384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:21:58.848051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:58.848019    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"]
Aug 02 11:21:58.848332 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:58.848257    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr" podUID="0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" containerName="payload-pre-processing" containerID="cri-o://1e407a424681ed68e351a66f32a2421f1889d8c85d0ef551043f14ca60df1981" gracePeriod=30
Aug 02 11:21:58.910668 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:58.910611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:21:59.010931 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.010838    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:21:59.013147 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.013103    2563 generic.go:356] "Generic (PLEG): container finished" podID="0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" containerID="1e407a424681ed68e351a66f32a2421f1889d8c85d0ef551043f14ca60df1981" exitCode=0
Aug 02 11:21:59.013327 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.013179    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr" event={"ID":"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a","Type":"ContainerDied","Data":"1e407a424681ed68e351a66f32a2421f1889d8c85d0ef551043f14ca60df1981"}
Aug 02 11:21:59.110572 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.110544    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:21:59.192345 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.192316    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-plugins-config-volume\") pod \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") "
Aug 02 11:21:59.192518 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.192389    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpwvm\" (UniqueName: \"kubernetes.io/projected/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-kube-api-access-lpwvm\") pod \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\" (UID: \"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a\") "
Aug 02 11:21:59.192669 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.192646    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" (UID: "0eab1c81-50ba-4fc9-8531-0c29a0e2d13a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:21:59.194566 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.194545    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-kube-api-access-lpwvm" (OuterVolumeSpecName: "kube-api-access-lpwvm") pod "0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" (UID: "0eab1c81-50ba-4fc9-8531-0c29a0e2d13a"). InnerVolumeSpecName "kube-api-access-lpwvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:21:59.293733 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.293703    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:21:59.293733 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.293729    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpwvm\" (UniqueName: \"kubernetes.io/projected/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a-kube-api-access-lpwvm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:21:59.311775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:21:59.311739    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:00.018554 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:00.018520    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"
Aug 02 11:22:00.018554 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:00.018549    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr" event={"ID":"0eab1c81-50ba-4fc9-8531-0c29a0e2d13a","Type":"ContainerDied","Data":"cae11cf1a68f150d7256928d53f0111c8fe8c09c17814824132a2c5c3e150dd4"}
Aug 02 11:22:00.018810 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:00.018609    2563 scope.go:117] "RemoveContainer" containerID="1e407a424681ed68e351a66f32a2421f1889d8c85d0ef551043f14ca60df1981"
Aug 02 11:22:00.038605 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:00.038579    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"]
Aug 02 11:22:00.044222 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:00.044197    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-638e7f-788db8c9c6-k4zrr"]
Aug 02 11:22:00.847054 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:00.847011    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" path="/var/lib/kubelet/pods/0eab1c81-50ba-4fc9-8531-0c29a0e2d13a/volumes"
Aug 02 11:22:04.394446 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:04.394406    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:12.155314 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.155249    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm" podUID="73700390-59d2-488a-b1f1-949fd467433d" containerName="main" containerID="cri-o://9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713" gracePeriod=45
Aug 02 11:22:12.405012 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.404984    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:22:12.410878 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.410832    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-home\") pod \"73700390-59d2-488a-b1f1-949fd467433d\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") "
Aug 02 11:22:12.410878 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.410871    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-model-cache\") pod \"73700390-59d2-488a-b1f1-949fd467433d\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") "
Aug 02 11:22:12.410969 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.410929    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-dshm\") pod \"73700390-59d2-488a-b1f1-949fd467433d\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") "
Aug 02 11:22:12.410969 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.410961    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxzkc\" (UniqueName: \"kubernetes.io/projected/73700390-59d2-488a-b1f1-949fd467433d-kube-api-access-sxzkc\") pod \"73700390-59d2-488a-b1f1-949fd467433d\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") "
Aug 02 11:22:12.411095 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.410985    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73700390-59d2-488a-b1f1-949fd467433d-tls-certs\") pod \"73700390-59d2-488a-b1f1-949fd467433d\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") "
Aug 02 11:22:12.411095 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.411029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-tmp-dir\") pod \"73700390-59d2-488a-b1f1-949fd467433d\" (UID: \"73700390-59d2-488a-b1f1-949fd467433d\") "
Aug 02 11:22:12.411207 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.411085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-home" (OuterVolumeSpecName: "home") pod "73700390-59d2-488a-b1f1-949fd467433d" (UID: "73700390-59d2-488a-b1f1-949fd467433d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:12.411207 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.411172    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-model-cache" (OuterVolumeSpecName: "model-cache") pod "73700390-59d2-488a-b1f1-949fd467433d" (UID: "73700390-59d2-488a-b1f1-949fd467433d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:12.411344 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.411324    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "73700390-59d2-488a-b1f1-949fd467433d" (UID: "73700390-59d2-488a-b1f1-949fd467433d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:12.411403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.411375    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:12.411403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.411393    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:12.413426 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.413403    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-dshm" (OuterVolumeSpecName: "dshm") pod "73700390-59d2-488a-b1f1-949fd467433d" (UID: "73700390-59d2-488a-b1f1-949fd467433d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:12.413525 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.413421    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73700390-59d2-488a-b1f1-949fd467433d-kube-api-access-sxzkc" (OuterVolumeSpecName: "kube-api-access-sxzkc") pod "73700390-59d2-488a-b1f1-949fd467433d" (UID: "73700390-59d2-488a-b1f1-949fd467433d"). InnerVolumeSpecName "kube-api-access-sxzkc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:22:12.413525 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.413452    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73700390-59d2-488a-b1f1-949fd467433d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "73700390-59d2-488a-b1f1-949fd467433d" (UID: "73700390-59d2-488a-b1f1-949fd467433d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:22:12.512182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.512144    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:12.512182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.512174    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxzkc\" (UniqueName: \"kubernetes.io/projected/73700390-59d2-488a-b1f1-949fd467433d-kube-api-access-sxzkc\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:12.512182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.512184    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/73700390-59d2-488a-b1f1-949fd467433d-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:12.512182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:12.512193    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/73700390-59d2-488a-b1f1-949fd467433d-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:13.081721 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.081678    2563 generic.go:356] "Generic (PLEG): container finished" podID="73700390-59d2-488a-b1f1-949fd467433d" containerID="9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713" exitCode=0
Aug 02 11:22:13.081895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.081739    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"
Aug 02 11:22:13.081895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.081753    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm" event={"ID":"73700390-59d2-488a-b1f1-949fd467433d","Type":"ContainerDied","Data":"9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713"}
Aug 02 11:22:13.081895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.081797    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm" event={"ID":"73700390-59d2-488a-b1f1-949fd467433d","Type":"ContainerDied","Data":"e2b5478f26151aa68a5fbd765afd91d3cdbd378307fb47513797644f90238227"}
Aug 02 11:22:13.081895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.081816    2563 scope.go:117] "RemoveContainer" containerID="9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713"
Aug 02 11:22:13.090503 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.090486    2563 scope.go:117] "RemoveContainer" containerID="9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713"
Aug 02 11:22:13.090763 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:22:13.090745    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713\": container with ID starting with 9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713 not found: ID does not exist" containerID="9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713"
Aug 02 11:22:13.090839 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.090770    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713"} err="failed to get container status \"9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713\": rpc error: code = NotFound desc = could not find container \"9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713\": container with ID starting with 9f5691ecca8ce422d827f3401f969ceaa8a348bbcba4da04a43bb4955e605713 not found: ID does not exist"
Aug 02 11:22:13.096420 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.096398    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"]
Aug 02 11:22:13.098224 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.098202    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-638e7f/test-model-638e7f-kserve-7c79ff8b7-j7qsm"]
Aug 02 11:22:13.141992 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.141954    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v" podUID="5ec08b4d-07aa-47cf-a311-506500f95731" containerName="main" containerID="cri-o://c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64" gracePeriod=45
Aug 02 11:22:13.397031 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.396965    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:22:13.421496 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421468    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-model-cache\") pod \"5ec08b4d-07aa-47cf-a311-506500f95731\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") "
Aug 02 11:22:13.421696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421552    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-tmp-dir\") pod \"5ec08b4d-07aa-47cf-a311-506500f95731\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") "
Aug 02 11:22:13.421696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421571    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-home\") pod \"5ec08b4d-07aa-47cf-a311-506500f95731\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") "
Aug 02 11:22:13.421696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421587    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-dshm\") pod \"5ec08b4d-07aa-47cf-a311-506500f95731\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") "
Aug 02 11:22:13.421696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421614    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ec08b4d-07aa-47cf-a311-506500f95731-tls-certs\") pod \"5ec08b4d-07aa-47cf-a311-506500f95731\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") "
Aug 02 11:22:13.421696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421656    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t6fh\" (UniqueName: \"kubernetes.io/projected/5ec08b4d-07aa-47cf-a311-506500f95731-kube-api-access-5t6fh\") pod \"5ec08b4d-07aa-47cf-a311-506500f95731\" (UID: \"5ec08b4d-07aa-47cf-a311-506500f95731\") "
Aug 02 11:22:13.421989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421798    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ec08b4d-07aa-47cf-a311-506500f95731" (UID: "5ec08b4d-07aa-47cf-a311-506500f95731"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:13.421989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421842    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-home" (OuterVolumeSpecName: "home") pod "5ec08b4d-07aa-47cf-a311-506500f95731" (UID: "5ec08b4d-07aa-47cf-a311-506500f95731"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:13.421989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421859    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ec08b4d-07aa-47cf-a311-506500f95731" (UID: "5ec08b4d-07aa-47cf-a311-506500f95731"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:13.421989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421956    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:13.421989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421974    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:13.421989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.421988    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:13.424020 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.423982    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-dshm" (OuterVolumeSpecName: "dshm") pod "5ec08b4d-07aa-47cf-a311-506500f95731" (UID: "5ec08b4d-07aa-47cf-a311-506500f95731"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:13.424020 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.424015    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ec08b4d-07aa-47cf-a311-506500f95731-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ec08b4d-07aa-47cf-a311-506500f95731" (UID: "5ec08b4d-07aa-47cf-a311-506500f95731"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:22:13.424217 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.424028    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ec08b4d-07aa-47cf-a311-506500f95731-kube-api-access-5t6fh" (OuterVolumeSpecName: "kube-api-access-5t6fh") pod "5ec08b4d-07aa-47cf-a311-506500f95731" (UID: "5ec08b4d-07aa-47cf-a311-506500f95731"). InnerVolumeSpecName "kube-api-access-5t6fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:22:13.523090 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.523050    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t6fh\" (UniqueName: \"kubernetes.io/projected/5ec08b4d-07aa-47cf-a311-506500f95731-kube-api-access-5t6fh\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:13.523090 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.523082    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ec08b4d-07aa-47cf-a311-506500f95731-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:13.523090 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:13.523092    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ec08b4d-07aa-47cf-a311-506500f95731-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:14.088060 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.088021    2563 generic.go:356] "Generic (PLEG): container finished" podID="5ec08b4d-07aa-47cf-a311-506500f95731" containerID="c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64" exitCode=0
Aug 02 11:22:14.088060 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.088065    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"
Aug 02 11:22:14.088303 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.088118    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v" event={"ID":"5ec08b4d-07aa-47cf-a311-506500f95731","Type":"ContainerDied","Data":"c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64"}
Aug 02 11:22:14.088303 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.088157    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v" event={"ID":"5ec08b4d-07aa-47cf-a311-506500f95731","Type":"ContainerDied","Data":"d7d3e96d54cd3cbe7e23e11a68e24df93f16eda37c973d822fb334a62e720a2b"}
Aug 02 11:22:14.088303 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.088176    2563 scope.go:117] "RemoveContainer" containerID="c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64"
Aug 02 11:22:14.097619 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.097601    2563 scope.go:117] "RemoveContainer" containerID="c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64"
Aug 02 11:22:14.097846 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:22:14.097828    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64\": container with ID starting with c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64 not found: ID does not exist" containerID="c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64"
Aug 02 11:22:14.097895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.097858    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64"} err="failed to get container status \"c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64\": rpc error: code = NotFound desc = could not find container \"c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64\": container with ID starting with c3aa2c61ea5ea176575dacc88bdf1d2bd4c151abe344169a2d2f651e147aca64 not found: ID does not exist"
Aug 02 11:22:14.106995 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.106971    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"]
Aug 02 11:22:14.110086 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.110066    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-66e93e/test-model-66e93e-kserve-5795db95f7-q4l6v"]
Aug 02 11:22:14.846236 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.846205    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ec08b4d-07aa-47cf-a311-506500f95731" path="/var/lib/kubelet/pods/5ec08b4d-07aa-47cf-a311-506500f95731/volumes"
Aug 02 11:22:14.846638 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:14.846623    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73700390-59d2-488a-b1f1-949fd467433d" path="/var/lib/kubelet/pods/73700390-59d2-488a-b1f1-949fd467433d/volumes"
Aug 02 11:22:20.385632 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:20.385591    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:20.435831 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:20.435796    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:41.319908 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:41.319867    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:41.585331 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:41.585226    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:41.804416 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:41.804375    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:42.660872 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:42.660840    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:42.760567 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:42.760528    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:42.860818 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:42.860786    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:43.162192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:43.162139    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:49.200057 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:49.199953    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:49.257482 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:49.257444    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:49.449869 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:49.449837    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"]
Aug 02 11:22:49.450145 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:49.450067    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy" containerID="cri-o://981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7" gracePeriod=30
Aug 02 11:22:49.471135 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:49.471103    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:49.689091 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:49.689053    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:50.023537 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:50.023502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:50.326932 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:50.326846    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:50.570811 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:50.570770    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:53.462043 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:53.462001    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:53.561114 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:53.561071    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:54.559231 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.559198    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:54.659544 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.659498    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:54.696843 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.696818    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:22:54.788975 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.788889    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674d7490-7e59-44c6-a69a-2128ce785d04-istio-podinfo\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.788975 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.788931    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-credential-socket\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.788975 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.788967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bzrc\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-kube-api-access-2bzrc\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789007    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-socket\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789056    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-certs\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789081    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-envoy\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789109    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674d7490-7e59-44c6-a69a-2128ce785d04-istiod-ca-cert\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789182    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-istio-token\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789530 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789253    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:54.789530 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789374    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:54.789530 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789390    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:54.789530 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789415    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-data\") pod \"674d7490-7e59-44c6-a69a-2128ce785d04\" (UID: \"674d7490-7e59-44c6-a69a-2128ce785d04\") "
Aug 02 11:22:54.789711 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789550    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/674d7490-7e59-44c6-a69a-2128ce785d04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:22:54.789711 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789647    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-data" (OuterVolumeSpecName: "istio-data") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:54.789711 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789694    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/674d7490-7e59-44c6-a69a-2128ce785d04-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.789711 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789707    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.789872 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789721    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.789872 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.789735    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.791359 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.791333    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:22:54.791498 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.791479    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-istio-token" (OuterVolumeSpecName: "istio-token") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:22:54.791877 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.791852    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/674d7490-7e59-44c6-a69a-2128ce785d04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:22:54.791877 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.791854    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-kube-api-access-2bzrc" (OuterVolumeSpecName: "kube-api-access-2bzrc") pod "674d7490-7e59-44c6-a69a-2128ce785d04" (UID: "674d7490-7e59-44c6-a69a-2128ce785d04"). InnerVolumeSpecName "kube-api-access-2bzrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:22:54.890647 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.890611    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/674d7490-7e59-44c6-a69a-2128ce785d04-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.890647 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.890641    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2bzrc\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-kube-api-access-2bzrc\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.890647 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.890651    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.890647 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.890659    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/674d7490-7e59-44c6-a69a-2128ce785d04-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:54.890969 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:54.890667    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/674d7490-7e59-44c6-a69a-2128ce785d04-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:22:55.053476 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.053363    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:55.151734 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.151700    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:22:55.272971 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.272934    2563 generic.go:356] "Generic (PLEG): container finished" podID="674d7490-7e59-44c6-a69a-2128ce785d04" containerID="981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7" exitCode=0
Aug 02 11:22:55.273165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.272989    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"
Aug 02 11:22:55.273165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.273021    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" event={"ID":"674d7490-7e59-44c6-a69a-2128ce785d04","Type":"ContainerDied","Data":"981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7"}
Aug 02 11:22:55.273165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.273087    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds" event={"ID":"674d7490-7e59-44c6-a69a-2128ce785d04","Type":"ContainerDied","Data":"2bebbf0f7c1e61ab977a8635737b2c84d6da59302d8221dae0f7fc91d18cd455"}
Aug 02 11:22:55.273165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.273119    2563 scope.go:117] "RemoveContainer" containerID="981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7"
Aug 02 11:22:55.281875 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.281857    2563 scope.go:117] "RemoveContainer" containerID="3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"
Aug 02 11:22:55.289803 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.289775    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"]
Aug 02 11:22:55.290625 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.290611    2563 scope.go:117] "RemoveContainer" containerID="981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7"
Aug 02 11:22:55.290888 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:22:55.290862    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7\": container with ID starting with 981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7 not found: ID does not exist" containerID="981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7"
Aug 02 11:22:55.290981 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.290909    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7"} err="failed to get container status \"981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7\": rpc error: code = NotFound desc = could not find container \"981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7\": container with ID starting with 981b704966c85152d919b6a027758907417c73532bf5465eb6352a3cd1c0b0b7 not found: ID does not exist"
Aug 02 11:22:55.290981 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.290934    2563 scope.go:117] "RemoveContainer" containerID="3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"
Aug 02 11:22:55.291254 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:22:55.291228    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0\": container with ID starting with 3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0 not found: ID does not exist" containerID="3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"
Aug 02 11:22:55.291254 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.291284    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0"} err="failed to get container status \"3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0\": rpc error: code = NotFound desc = could not find container \"3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0\": container with ID starting with 3d667fb09b55c04766ce228541c067a70ac136014801c36dac87f2c321df5dd0 not found: ID does not exist"
Aug 02 11:22:55.293172 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:55.293152    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-66e93e-openshift-default-8ff5d4fcb-2vvds"]
Aug 02 11:22:56.846405 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:22:56.846373    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" path="/var/lib/kubelet/pods/674d7490-7e59-44c6-a69a-2128ce785d04/volumes"
Aug 02 11:23:18.420753 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:18.420713    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:18.875308 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:18.875180    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:19.146338 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146307    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"]
Aug 02 11:23:19.146791 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146772    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146797    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146807    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ec08b4d-07aa-47cf-a311-506500f95731" containerName="main"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146812    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ec08b4d-07aa-47cf-a311-506500f95731" containerName="main"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146824    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73700390-59d2-488a-b1f1-949fd467433d" containerName="main"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146829    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="73700390-59d2-488a-b1f1-949fd467433d" containerName="main"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146837    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" containerName="payload-pre-processing"
Aug 02 11:23:19.146841 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146842    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" containerName="payload-pre-processing"
Aug 02 11:23:19.147051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146909    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy"
Aug 02 11:23:19.147051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146917    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="73700390-59d2-488a-b1f1-949fd467433d" containerName="main"
Aug 02 11:23:19.147051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146923    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ec08b4d-07aa-47cf-a311-506500f95731" containerName="main"
Aug 02 11:23:19.147051 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.146930    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="0eab1c81-50ba-4fc9-8531-0c29a0e2d13a" containerName="payload-pre-processing"
Aug 02 11:23:19.149693 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.149675    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.151482 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.151451    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5afe3e-openshift-default-dockercfg-c5l2q\""
Aug 02 11:23:19.161170 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.161147    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"]
Aug 02 11:23:19.170429 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.170400    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:19.311061 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311029    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-envoy\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311069    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-credential-socket\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311108    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-data\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311168    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-podinfo\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311221    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-certs\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311248    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8hc\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-kube-api-access-bc8hc\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311453 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311297    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-socket\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311453 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311320    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-token\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.311453 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.311341    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istiod-ca-cert\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.412781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412697    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-socket\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.412781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412726    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-token\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.412781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412749    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istiod-ca-cert\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.412781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412781    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-envoy\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412811    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-credential-socket\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412848    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-data\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412883    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-podinfo\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412932    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-certs\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.412972    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8hc\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-kube-api-access-bc8hc\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413349 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.413187    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-socket\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.413360    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-credential-socket\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413460 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.413395    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-certs\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413460 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.413427    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-data\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.413756 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.413734    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istiod-ca-cert\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.415403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.415384    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-envoy\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.415527 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.415508    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-podinfo\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.420031 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.419997    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8hc\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-kube-api-access-bc8hc\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.420372 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.420353    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-token\") pod \"e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") " pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.465140 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.465114    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:19.604227 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.604202    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"]
Aug 02 11:23:19.606487 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:23:19.606453    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a01ef2_a4c2_4c9d_a658_d24adbdc3ac1.slice/crio-19487f0feb587e9a8dd6e07e2424029bbb1bd14b74c86f721f888c8c940e2ec7 WatchSource:0}: Error finding container 19487f0feb587e9a8dd6e07e2424029bbb1bd14b74c86f721f888c8c940e2ec7: Status 404 returned error can't find the container with id 19487f0feb587e9a8dd6e07e2424029bbb1bd14b74c86f721f888c8c940e2ec7
Aug 02 11:23:19.608629 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.608600    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:23:19.608698 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.608664    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:23:19.608736 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.608695    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:23:19.752659 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:19.752559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:20.385914 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:20.385879    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" event={"ID":"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1","Type":"ContainerStarted","Data":"503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"}
Aug 02 11:23:20.386097 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:20.385931    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" event={"ID":"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1","Type":"ContainerStarted","Data":"19487f0feb587e9a8dd6e07e2424029bbb1bd14b74c86f721f888c8c940e2ec7"}
Aug 02 11:23:20.402922 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:20.402868    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podStartSLOduration=1.402848641 podStartE2EDuration="1.402848641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:23:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:23:20.401570201 +0000 UTC m=+2996.059787791" watchObservedRunningTime="2026-08-02 11:23:20.402848641 +0000 UTC m=+2996.061066232"
Aug 02 11:23:20.465968 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:20.465935    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:20.471047 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:20.471018    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:21.391596 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:21.391561    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:21.392701 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:21.392681    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:22.274070 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:22.274035    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:22.370438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:22.370398    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:23.377231 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.377192    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:23.588989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.588952    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:23.853233 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.853197    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:23.947091 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.947054    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"]
Aug 02 11:23:23.947509 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.947491    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy"
Aug 02 11:23:23.947614 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.947513    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy"
Aug 02 11:23:23.947614 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.947593    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="674d7490-7e59-44c6-a69a-2128ce785d04" containerName="istio-proxy"
Aug 02 11:23:23.947924 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.947892    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:23.950768 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.950752    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:23.952571 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.952549    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-5afe3e-dockercfg-pdfbz\""
Aug 02 11:23:23.952571 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.952564    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-5afe3e\""
Aug 02 11:23:23.958003 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:23.957983    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"]
Aug 02 11:23:24.054473 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.054443    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.054653 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.054582    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwxpd\" (UniqueName: \"kubernetes.io/projected/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-kube-api-access-bwxpd\") pod \"payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.155090 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.155048    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwxpd\" (UniqueName: \"kubernetes.io/projected/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-kube-api-access-bwxpd\") pod \"payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.155323 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.155134    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.155924 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.155898    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.162559 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.162538    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwxpd\" (UniqueName: \"kubernetes.io/projected/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-kube-api-access-bwxpd\") pod \"payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.262321 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.262284    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:24.396565 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.396534    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"]
Aug 02 11:23:24.399579 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:23:24.399533    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e31447_4d16_4e43_bcff_390e6c2dcbb1.slice/crio-98f1c2f02997c436c7aaae05cf36643d2c3ce62dc5e59ff1f902947c55f8906d WatchSource:0}: Error finding container 98f1c2f02997c436c7aaae05cf36643d2c3ce62dc5e59ff1f902947c55f8906d: Status 404 returned error can't find the container with id 98f1c2f02997c436c7aaae05cf36643d2c3ce62dc5e59ff1f902947c55f8906d
Aug 02 11:23:24.405911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.405847    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25" event={"ID":"a7e31447-4d16-4e43-bcff-390e6c2dcbb1","Type":"ContainerStarted","Data":"98f1c2f02997c436c7aaae05cf36643d2c3ce62dc5e59ff1f902947c55f8906d"}
Aug 02 11:23:24.959316 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.959286    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:23:24.965287 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:24.965246    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:23:25.411487 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:25.411446    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25" event={"ID":"a7e31447-4d16-4e43-bcff-390e6c2dcbb1","Type":"ContainerStarted","Data":"395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f"}
Aug 02 11:23:25.411863 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:25.411635    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:25.426626 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:25.426581    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25" podStartSLOduration=2.426565698 podStartE2EDuration="2.426565698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:23:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:23:25.423996972 +0000 UTC m=+3001.082214561" watchObservedRunningTime="2026-08-02 11:23:25.426565698 +0000 UTC m=+3001.084783287"
Aug 02 11:23:36.393029 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.392995    2563 patch_prober.go:28] interesting pod/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 02 11:23:36.393464 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.393062    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 02 11:23:36.417955 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.417922    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:23:36.471706 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.471675    2563 generic.go:356] "Generic (PLEG): container finished" podID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerID="503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7" exitCode=0
Aug 02 11:23:36.471881 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.471761    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" event={"ID":"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1","Type":"ContainerDied","Data":"503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"}
Aug 02 11:23:36.472287 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.472248    2563 scope.go:117] "RemoveContainer" containerID="503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"
Aug 02 11:23:36.473408 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.473381    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:23:36.473512 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.473482    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:23:36.473580 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:36.473556    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:23:37.478533 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:37.478499    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" event={"ID":"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1","Type":"ContainerStarted","Data":"348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9"}
Aug 02 11:23:38.465332 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:38.465289    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:38.465604 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:38.465581    2563 patch_prober.go:28] interesting pod/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 02 11:23:38.465694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:38.465636    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 02 11:23:39.466415 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:39.466376    2563 patch_prober.go:28] interesting pod/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 02 11:23:39.466817 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:39.466429    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 02 11:23:40.466154 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:40.466114    2563 patch_prober.go:28] interesting pod/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 02 11:23:40.466358 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:40.466188    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 02 11:23:41.465757 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:41.465717    2563 patch_prober.go:28] interesting pod/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 02 11:23:41.466149 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:41.465773    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 02 11:23:42.465578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:42.465526    2563 patch_prober.go:28] interesting pod/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Aug 02 11:23:42.465803 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:42.465587    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Aug 02 11:23:43.470325 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:43.470292    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:43.470797 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:43.470553    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:43.471369 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:43.471352    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:23:47.240499 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:47.240464    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:55.709905 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:55.709869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:55.764934 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:55.764900    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:55.865615 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:55.865575    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:55.968685 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:55.968597    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:23:56.192204 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:23:56.192170    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:02.015079 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:02.015048    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:02.079017 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:02.078957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:02.290332 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:02.290214    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:02.515156 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:02.515120    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:08.324140 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.324095    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:08.355986 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.355955    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"]
Aug 02 11:24:08.356242 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.356212    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25" podUID="a7e31447-4d16-4e43-bcff-390e6c2dcbb1" containerName="payload-pre-processing" containerID="cri-o://395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f" gracePeriod=30
Aug 02 11:24:08.424006 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.423970    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:08.524781 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.524727    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:08.606721 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.606692    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:24:08.623970 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.623942    2563 generic.go:356] "Generic (PLEG): container finished" podID="a7e31447-4d16-4e43-bcff-390e6c2dcbb1" containerID="395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f" exitCode=0
Aug 02 11:24:08.624131 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.624002    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"
Aug 02 11:24:08.624131 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.624056    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25" event={"ID":"a7e31447-4d16-4e43-bcff-390e6c2dcbb1","Type":"ContainerDied","Data":"395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f"}
Aug 02 11:24:08.624131 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.624101    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25" event={"ID":"a7e31447-4d16-4e43-bcff-390e6c2dcbb1","Type":"ContainerDied","Data":"98f1c2f02997c436c7aaae05cf36643d2c3ce62dc5e59ff1f902947c55f8906d"}
Aug 02 11:24:08.624131 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.624129    2563 scope.go:117] "RemoveContainer" containerID="395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f"
Aug 02 11:24:08.633129 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.633107    2563 scope.go:117] "RemoveContainer" containerID="395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f"
Aug 02 11:24:08.633451 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:24:08.633427    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f\": container with ID starting with 395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f not found: ID does not exist" containerID="395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f"
Aug 02 11:24:08.633523 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.633465    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f"} err="failed to get container status \"395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f\": rpc error: code = NotFound desc = could not find container \"395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f\": container with ID starting with 395168cb480299de94137f69b517b935370a1e8b903b6baa60818a869207545f not found: ID does not exist"
Aug 02 11:24:08.677045 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.677006    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwxpd\" (UniqueName: \"kubernetes.io/projected/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-kube-api-access-bwxpd\") pod \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") "
Aug 02 11:24:08.677223 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.677067    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-plugins-config-volume\") pod \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\" (UID: \"a7e31447-4d16-4e43-bcff-390e6c2dcbb1\") "
Aug 02 11:24:08.677503 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.677477    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a7e31447-4d16-4e43-bcff-390e6c2dcbb1" (UID: "a7e31447-4d16-4e43-bcff-390e6c2dcbb1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:24:08.679305 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.679282    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-kube-api-access-bwxpd" (OuterVolumeSpecName: "kube-api-access-bwxpd") pod "a7e31447-4d16-4e43-bcff-390e6c2dcbb1" (UID: "a7e31447-4d16-4e43-bcff-390e6c2dcbb1"). InnerVolumeSpecName "kube-api-access-bwxpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:24:08.777887 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.777851    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwxpd\" (UniqueName: \"kubernetes.io/projected/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-kube-api-access-bwxpd\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:08.777887 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.777882    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7e31447-4d16-4e43-bcff-390e6c2dcbb1-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:08.809145 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.809111    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:08.937120 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.937085    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"]
Aug 02 11:24:08.940662 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:08.940632    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-5afe3e-bb65b995b-wfh25"]
Aug 02 11:24:10.847101 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:10.847066    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e31447-4d16-4e43-bcff-390e6c2dcbb1" path="/var/lib/kubelet/pods/a7e31447-4d16-4e43-bcff-390e6c2dcbb1/volumes"
Aug 02 11:24:14.521546 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:14.521495    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:14.622076 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:14.622040    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:15.139476 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.139439    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:15.239736 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.239695    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:15.386755 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.386723    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"]
Aug 02 11:24:15.387030 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.386998    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy" containerID="cri-o://348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9" gracePeriod=30
Aug 02 11:24:15.406332 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.406220    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:15.624415 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.624329    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:15.970421 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:15.970384    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:16.250895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:16.250795    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:16.647553 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:16.647511    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:18.988298 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:18.988244    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:19.078137 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:19.078098    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:20.121092 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.121059    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:20.273058 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.273027    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:20.557653 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.557619    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:20.648563 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.648540    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:24:20.654694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.654627    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:20.679219 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.679181    2563 generic.go:356] "Generic (PLEG): container finished" podID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerID="348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9" exitCode=0
Aug 02 11:24:20.679438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.679233    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" event={"ID":"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1","Type":"ContainerDied","Data":"348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9"}
Aug 02 11:24:20.679438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.679309    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b" event={"ID":"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1","Type":"ContainerDied","Data":"19487f0feb587e9a8dd6e07e2424029bbb1bd14b74c86f721f888c8c940e2ec7"}
Aug 02 11:24:20.679438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.679347    2563 scope.go:117] "RemoveContainer" containerID="348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9"
Aug 02 11:24:20.679438 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.679401    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"
Aug 02 11:24:20.691684 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.691651    2563 scope.go:117] "RemoveContainer" containerID="503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"
Aug 02 11:24:20.699924 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.699890    2563 scope.go:117] "RemoveContainer" containerID="348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9"
Aug 02 11:24:20.700390 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:24:20.700343    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9\": container with ID starting with 348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9 not found: ID does not exist" containerID="348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9"
Aug 02 11:24:20.700465 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.700402    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9"} err="failed to get container status \"348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9\": rpc error: code = NotFound desc = could not find container \"348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9\": container with ID starting with 348fb30b6022b78b489a6526718e44a23c75087e31dde143fdb6cd81c840efd9 not found: ID does not exist"
Aug 02 11:24:20.700465 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.700426    2563 scope.go:117] "RemoveContainer" containerID="503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"
Aug 02 11:24:20.700693 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:24:20.700671    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7\": container with ID starting with 503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7 not found: ID does not exist" containerID="503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"
Aug 02 11:24:20.700744 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.700702    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7"} err="failed to get container status \"503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7\": rpc error: code = NotFound desc = could not find container \"503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7\": container with ID starting with 503f797bacf1687772229c2a342f9e62a773fc1a8c66efe027bd7931b2d318f7 not found: ID does not exist"
Aug 02 11:24:20.786406 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786368    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-podinfo\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786406 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786413    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-socket\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786429    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-token\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786480    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc8hc\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-kube-api-access-bc8hc\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786506    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istiod-ca-cert\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786522    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-credential-socket\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786557    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-data\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786598    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-certs\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.786657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786633    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-envoy\") pod \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\" (UID: \"03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1\") "
Aug 02 11:24:20.787037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786717    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:24:20.787037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786860    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-data" (OuterVolumeSpecName: "istio-data") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:24:20.787037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786953    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.787037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786972    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.787037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.786973    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:24:20.787487 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.787085    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:24:20.787566 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.787502    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:24:20.788932 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.788902    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-kube-api-access-bc8hc" (OuterVolumeSpecName: "kube-api-access-bc8hc") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "kube-api-access-bc8hc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:24:20.789048 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.788945    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-token" (OuterVolumeSpecName: "istio-token") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:24:20.789048 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.788952    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:24:20.789048 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.788953    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" (UID: "03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:24:20.887727 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887696    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.887727 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887726    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.887918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887735    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc8hc\" (UniqueName: \"kubernetes.io/projected/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-kube-api-access-bc8hc\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.887918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887745    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.887918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887754    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.887918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887762    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.887918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.887770    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:24:20.995670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:20.995589    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"]
Aug 02 11:24:21.001029 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:21.000987    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5afe3e-openshift-default-65fbc4879b-llj4b"]
Aug 02 11:24:22.846756 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:22.846723    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" path="/var/lib/kubelet/pods/03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1/volumes"
Aug 02 11:24:43.945035 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:43.945002    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:44.256150 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.256063    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:44.526119 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526036    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"]
Aug 02 11:24:44.526391 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526376    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7e31447-4d16-4e43-bcff-390e6c2dcbb1" containerName="payload-pre-processing"
Aug 02 11:24:44.526470 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526392    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e31447-4d16-4e43-bcff-390e6c2dcbb1" containerName="payload-pre-processing"
Aug 02 11:24:44.526470 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526400    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy"
Aug 02 11:24:44.526470 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526407    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy"
Aug 02 11:24:44.526636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526473    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7e31447-4d16-4e43-bcff-390e6c2dcbb1" containerName="payload-pre-processing"
Aug 02 11:24:44.526636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526480    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy"
Aug 02 11:24:44.526636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.526486    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy"
Aug 02 11:24:44.529510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.529486    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.531296 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.531256    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-4f1bb7-openshift-default-dockercfg-nddc7\""
Aug 02 11:24:44.540899 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.540878    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"]
Aug 02 11:24:44.548630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.548603    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:44.579433 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579406    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-credential-socket\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579440    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-token\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579461    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-data\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579569 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579504    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istiod-ca-cert\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579682 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579609    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vgcs\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-kube-api-access-9vgcs\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579682 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579635    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-envoy\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579682 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579651    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-podinfo\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579682 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579671    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-certs\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.579818 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.579737    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-socket\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680152 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680119    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vgcs\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-kube-api-access-9vgcs\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680152 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680154    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-envoy\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680169    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-podinfo\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680188    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-certs\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680309    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-socket\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680371    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-credential-socket\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-token\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680441    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-data\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.680497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680476    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istiod-ca-cert\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.681037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680712    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-certs\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.681037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680765    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-socket\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.681037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680806    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-credential-socket\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.681037 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.680916    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-data\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.681286 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.681202    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istiod-ca-cert\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.682624 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.682604    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-envoy\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.682742 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.682726    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-podinfo\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.687298 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.687254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-token\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.687458 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.687442    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vgcs\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-kube-api-access-9vgcs\") pod \"e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") " pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.833916 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.833825    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:44.839729 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.839706    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:44.976365 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.976293    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"]
Aug 02 11:24:44.978975 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:24:44.978948    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod706ed4d9_5964_48a1_8b73_7bf7f65bb158.slice/crio-7a693a857a4368cf450b74b6ad7c175a4833181cf6341a73fd29481ae8357263 WatchSource:0}: Error finding container 7a693a857a4368cf450b74b6ad7c175a4833181cf6341a73fd29481ae8357263: Status 404 returned error can't find the container with id 7a693a857a4368cf450b74b6ad7c175a4833181cf6341a73fd29481ae8357263
Aug 02 11:24:44.981424 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.981389    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:24:44.981502 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.981475    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:24:44.981541 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:44.981514    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:24:45.789031 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:45.788997    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" event={"ID":"706ed4d9-5964-48a1-8b73-7bf7f65bb158","Type":"ContainerStarted","Data":"756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"}
Aug 02 11:24:45.789254 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:45.789051    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" event={"ID":"706ed4d9-5964-48a1-8b73-7bf7f65bb158","Type":"ContainerStarted","Data":"7a693a857a4368cf450b74b6ad7c175a4833181cf6341a73fd29481ae8357263"}
Aug 02 11:24:45.806562 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:45.806515    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podStartSLOduration=1.80649978 podStartE2EDuration="1.80649978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:24:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:24:45.804750252 +0000 UTC m=+3081.462967845" watchObservedRunningTime="2026-08-02 11:24:45.80649978 +0000 UTC m=+3081.464717370"
Aug 02 11:24:45.840520 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:45.840490    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:46.847042 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:46.847012    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:47.667279 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:47.667227    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:47.765785 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:47.765744    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:47.797695 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:47.797669    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:47.798764 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:47.798745    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:24:48.884599 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:48.884566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:49.179608 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.179578    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:49.365598 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.365566    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:49.464243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.464159    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:24:49.497031 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.496992    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"]
Aug 02 11:24:49.497362 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.497348    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy"
Aug 02 11:24:49.497410 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.497364    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a01ef2-a4c2-4c9d-a658-d24adbdc3ac1" containerName="istio-proxy"
Aug 02 11:24:49.500414 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.500397    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.502298 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.502276    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-4f1bb7-dockercfg-6s9kr\""
Aug 02 11:24:49.502433 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.502284    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-4f1bb7\""
Aug 02 11:24:49.507674 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.507651    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"]
Aug 02 11:24:49.624718 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.624687    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb4wq\" (UniqueName: \"kubernetes.io/projected/d6dfc758-deea-4058-a0c9-291d48b55de2-kube-api-access-rb4wq\") pod \"payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.624877 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.624724    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6dfc758-deea-4058-a0c9-291d48b55de2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.725383 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.725287    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb4wq\" (UniqueName: \"kubernetes.io/projected/d6dfc758-deea-4058-a0c9-291d48b55de2-kube-api-access-rb4wq\") pod \"payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.725383 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.725327    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6dfc758-deea-4058-a0c9-291d48b55de2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.726039 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.726018    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6dfc758-deea-4058-a0c9-291d48b55de2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.732539 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.732517    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb4wq\" (UniqueName: \"kubernetes.io/projected/d6dfc758-deea-4058-a0c9-291d48b55de2-kube-api-access-rb4wq\") pod \"payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.813756 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.813717    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:49.950532 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:49.950375    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"]
Aug 02 11:24:49.953096 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:24:49.953072    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6dfc758_deea_4058_a0c9_291d48b55de2.slice/crio-65a4a6492812d5f94cafd73803f04e94f04aa24f6df305a8f3a9e3ec4070679a WatchSource:0}: Error finding container 65a4a6492812d5f94cafd73803f04e94f04aa24f6df305a8f3a9e3ec4070679a: Status 404 returned error can't find the container with id 65a4a6492812d5f94cafd73803f04e94f04aa24f6df305a8f3a9e3ec4070679a
Aug 02 11:24:50.811688 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:50.811656    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q" event={"ID":"d6dfc758-deea-4058-a0c9-291d48b55de2","Type":"ContainerStarted","Data":"e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087"}
Aug 02 11:24:50.811908 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:50.811706    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q" event={"ID":"d6dfc758-deea-4058-a0c9-291d48b55de2","Type":"ContainerStarted","Data":"65a4a6492812d5f94cafd73803f04e94f04aa24f6df305a8f3a9e3ec4070679a"}
Aug 02 11:24:50.811908 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:50.811792    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:24:50.827373 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:24:50.827325    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q" podStartSLOduration=1.8273085199999999 podStartE2EDuration="1.82730852s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:24:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:24:50.825650635 +0000 UTC m=+3086.483868245" watchObservedRunningTime="2026-08-02 11:24:50.82730852 +0000 UTC m=+3086.485526109"
Aug 02 11:25:01.819014 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.818988    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:25:01.874788 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.874757    2563 generic.go:356] "Generic (PLEG): container finished" podID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerID="756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0" exitCode=0
Aug 02 11:25:01.874951 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.874801    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" event={"ID":"706ed4d9-5964-48a1-8b73-7bf7f65bb158","Type":"ContainerDied","Data":"756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"}
Aug 02 11:25:01.875215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.875198    2563 scope.go:117] "RemoveContainer" containerID="756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"
Aug 02 11:25:01.876439 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.876406    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:25:01.876516 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.876486    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:25:01.876557 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:01.876518    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:25:02.798035 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:02.797995    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:25:02.880645 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:02.880612    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" event={"ID":"706ed4d9-5964-48a1-8b73-7bf7f65bb158","Type":"ContainerStarted","Data":"6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8"}
Aug 02 11:25:03.842095 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:03.842047    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:25:03.842346 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:03.842188    2563 patch_prober.go:28] interesting pod/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 02 11:25:03.842346 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:03.842234    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 02 11:25:04.844252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:04.844211    2563 patch_prober.go:28] interesting pod/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 02 11:25:04.844778 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:04.844311    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 02 11:25:05.841217 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:05.841174    2563 patch_prober.go:28] interesting pod/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 02 11:25:05.841442 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:05.841238    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 02 11:25:06.845619 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:06.845574    2563 patch_prober.go:28] interesting pod/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 02 11:25:06.846134 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:06.845646    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 02 11:25:07.840715 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:07.840667    2563 patch_prober.go:28] interesting pod/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Aug 02 11:25:07.840966 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:07.840769    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Aug 02 11:25:08.846571 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:08.846545    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:25:08.847128 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:08.846841    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:25:08.847634 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:08.847617    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:25:12.632644 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:12.632611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:25:26.847340 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.847305    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"]
Aug 02 11:25:26.850635 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.850620    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:26.852918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.852897    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"default-dockercfg-44xf5\""
Aug 02 11:25:26.852918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.852911    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"kube-root-ca.crt\""
Aug 02 11:25:26.853110 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.852912    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"auth-test-model-3951f6-kserve-self-signed-certs\""
Aug 02 11:25:26.853110 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.852918    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"openshift-service-ca.crt\""
Aug 02 11:25:26.857801 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.857439    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"]
Aug 02 11:25:26.946089 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.946052    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:25:26.954135 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.954107    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-home\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:26.954253 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.954145    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbgdw\" (UniqueName: \"kubernetes.io/projected/23fb4369-658c-4141-b45b-4435945058a1-kube-api-access-dbgdw\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:26.954253 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.954178    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-dshm\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:26.954418 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.954279    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-model-cache\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:26.954418 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.954311    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fb4369-658c-4141-b45b-4435945058a1-tls-certs\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:26.954418 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:26.954358    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-tmp-dir\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055103 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055069    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-home\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055103 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055110    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbgdw\" (UniqueName: \"kubernetes.io/projected/23fb4369-658c-4141-b45b-4435945058a1-kube-api-access-dbgdw\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055411 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-dshm\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055411 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055184    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-model-cache\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055411 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055205    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fb4369-658c-4141-b45b-4435945058a1-tls-certs\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055411 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055228    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-tmp-dir\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055617 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055594    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-home\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055662 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055607    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-model-cache\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.055716 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.055694    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-tmp-dir\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.057710 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.057688    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-dshm\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.058236 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.058208    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fb4369-658c-4141-b45b-4435945058a1-tls-certs\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.062816 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.062793    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbgdw\" (UniqueName: \"kubernetes.io/projected/23fb4369-658c-4141-b45b-4435945058a1-kube-api-access-dbgdw\") pod \"auth-test-model-3951f6-kserve-f79d467ff-llrdg\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") " pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.160252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.160211    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:27.294954 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.294923    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"]
Aug 02 11:25:27.297819 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:25:27.297789    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23fb4369_658c_4141_b45b_4435945058a1.slice/crio-84dd4c73fa5c9d44797018aec940b192ddcd975f3896b1a74664771f2d18fdf6 WatchSource:0}: Error finding container 84dd4c73fa5c9d44797018aec940b192ddcd975f3896b1a74664771f2d18fdf6: Status 404 returned error can't find the container with id 84dd4c73fa5c9d44797018aec940b192ddcd975f3896b1a74664771f2d18fdf6
Aug 02 11:25:27.995054 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.995017    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg" event={"ID":"23fb4369-658c-4141-b45b-4435945058a1","Type":"ContainerStarted","Data":"042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54"}
Aug 02 11:25:27.995054 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:27.995059    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg" event={"ID":"23fb4369-658c-4141-b45b-4435945058a1","Type":"ContainerStarted","Data":"84dd4c73fa5c9d44797018aec940b192ddcd975f3896b1a74664771f2d18fdf6"}
Aug 02 11:25:28.010257 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:28.010201    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg" podStartSLOduration=2.010174264 podStartE2EDuration="2.010174264s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:25:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:25:28.009778353 +0000 UTC m=+3123.667995943" watchObservedRunningTime="2026-08-02 11:25:28.010174264 +0000 UTC m=+3123.668391856"
Aug 02 11:25:37.160423 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:37.160388    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:37.160838 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:37.160447    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:37.173239 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:37.173214    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:38.051490 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:38.051410    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:25:52.447532 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.447452    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"]
Aug 02 11:25:52.451468 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.451447    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.453878 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.453855    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"openshift-service-ca.crt\""
Aug 02 11:25:52.453995 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.453879    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"kube-root-ca.crt\""
Aug 02 11:25:52.453995 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.453860    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"default-dockercfg-msxv2\""
Aug 02 11:25:52.453995 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.453855    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"auth-test-model-4f1bb7-kserve-self-signed-certs\""
Aug 02 11:25:52.460440 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.460417    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"]
Aug 02 11:25:52.473389 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.473359    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:25:52.593629 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.593590    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-dshm\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.593820 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.593662    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-model-cache\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.593820 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.593706    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-tmp-dir\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.593820 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.593726    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhwlh\" (UniqueName: \"kubernetes.io/projected/c7610949-4734-448d-8ab3-2284ebd97c01-kube-api-access-qhwlh\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.593820 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.593791    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7610949-4734-448d-8ab3-2284ebd97c01-tls-certs\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.593962 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.593850    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-home\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.694673 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.694633    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-home\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.694866 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.694703    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-dshm\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.694866 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.694736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-model-cache\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.694866 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.694758    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-tmp-dir\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.694866 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.694774    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhwlh\" (UniqueName: \"kubernetes.io/projected/c7610949-4734-448d-8ab3-2284ebd97c01-kube-api-access-qhwlh\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.694866 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.694802    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7610949-4734-448d-8ab3-2284ebd97c01-tls-certs\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.695112 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.695088    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-home\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.695159 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.695139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-model-cache\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.695207 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.695176    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-tmp-dir\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.697178 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.697150    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-dshm\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.697452 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.697435    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7610949-4734-448d-8ab3-2284ebd97c01-tls-certs\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.701556 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.701502    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhwlh\" (UniqueName: \"kubernetes.io/projected/c7610949-4734-448d-8ab3-2284ebd97c01-kube-api-access-qhwlh\") pod \"auth-test-model-4f1bb7-kserve-68cf6c864c-7d892\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") " pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.763222 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.763191    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:25:52.901804 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:52.901734    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"]
Aug 02 11:25:52.904218 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:25:52.904184    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc7610949_4734_448d_8ab3_2284ebd97c01.slice/crio-848c90b1f27909812abb2cc377f7fbac05d65ed4e4d9f51cbe6c1c0a882e193e WatchSource:0}: Error finding container 848c90b1f27909812abb2cc377f7fbac05d65ed4e4d9f51cbe6c1c0a882e193e: Status 404 returned error can't find the container with id 848c90b1f27909812abb2cc377f7fbac05d65ed4e4d9f51cbe6c1c0a882e193e
Aug 02 11:25:53.110581 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:53.110544    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892" event={"ID":"c7610949-4734-448d-8ab3-2284ebd97c01","Type":"ContainerStarted","Data":"128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357"}
Aug 02 11:25:53.110750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:53.110593    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892" event={"ID":"c7610949-4734-448d-8ab3-2284ebd97c01","Type":"ContainerStarted","Data":"848c90b1f27909812abb2cc377f7fbac05d65ed4e4d9f51cbe6c1c0a882e193e"}
Aug 02 11:25:53.126492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:25:53.126449    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892" podStartSLOduration=1.1264335380000001 podStartE2EDuration="1.126433538s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:25:53.125197478 +0000 UTC m=+3148.783415067" watchObservedRunningTime="2026-08-02 11:25:53.126433538 +0000 UTC m=+3148.784651127"
Aug 02 11:26:02.763324 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:26:02.763290    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:26:02.763796 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:26:02.763349    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:26:02.775719 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:26:02.775697    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:26:03.166830 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:26:03.166804    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:27:26.181692 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:27:26.181611    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:28:11.990541 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:28:11.990502    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:28:24.989231 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:28:24.989190    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:28:24.996481 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:28:24.996458    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:29:37.569198 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:37.569158    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:29:37.668637 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:37.668599    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:29:38.148372 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:38.148341    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"]
Aug 02 11:29:38.163565 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:38.163516    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:29:39.122623 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:39.122586    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"]
Aug 02 11:29:39.141008 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:39.140977    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:29:50.062203 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:50.062164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:29:53.167864 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.167803    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg" podUID="23fb4369-658c-4141-b45b-4435945058a1" containerName="main" containerID="cri-o://042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54" gracePeriod=45
Aug 02 11:29:53.413486 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.413449    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:29:53.540785 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.540694    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-home\") pod \"23fb4369-658c-4141-b45b-4435945058a1\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") "
Aug 02 11:29:53.540785 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.540738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-dshm\") pod \"23fb4369-658c-4141-b45b-4435945058a1\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") "
Aug 02 11:29:53.540785 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.540764    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fb4369-658c-4141-b45b-4435945058a1-tls-certs\") pod \"23fb4369-658c-4141-b45b-4435945058a1\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") "
Aug 02 11:29:53.541094 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.540828    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbgdw\" (UniqueName: \"kubernetes.io/projected/23fb4369-658c-4141-b45b-4435945058a1-kube-api-access-dbgdw\") pod \"23fb4369-658c-4141-b45b-4435945058a1\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") "
Aug 02 11:29:53.541094 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.540875    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-tmp-dir\") pod \"23fb4369-658c-4141-b45b-4435945058a1\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") "
Aug 02 11:29:53.541094 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.540901    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-model-cache\") pod \"23fb4369-658c-4141-b45b-4435945058a1\" (UID: \"23fb4369-658c-4141-b45b-4435945058a1\") "
Aug 02 11:29:53.541094 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.541005    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-home" (OuterVolumeSpecName: "home") pod "23fb4369-658c-4141-b45b-4435945058a1" (UID: "23fb4369-658c-4141-b45b-4435945058a1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:53.541335 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.541160    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23fb4369-658c-4141-b45b-4435945058a1" (UID: "23fb4369-658c-4141-b45b-4435945058a1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:53.541335 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.541251    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-model-cache" (OuterVolumeSpecName: "model-cache") pod "23fb4369-658c-4141-b45b-4435945058a1" (UID: "23fb4369-658c-4141-b45b-4435945058a1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:53.541335 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.541285    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:53.541335 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.541302    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:53.543165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.543143    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-dshm" (OuterVolumeSpecName: "dshm") pod "23fb4369-658c-4141-b45b-4435945058a1" (UID: "23fb4369-658c-4141-b45b-4435945058a1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:53.543295 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.543201    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23fb4369-658c-4141-b45b-4435945058a1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23fb4369-658c-4141-b45b-4435945058a1" (UID: "23fb4369-658c-4141-b45b-4435945058a1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:29:53.543295 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.543234    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23fb4369-658c-4141-b45b-4435945058a1-kube-api-access-dbgdw" (OuterVolumeSpecName: "kube-api-access-dbgdw") pod "23fb4369-658c-4141-b45b-4435945058a1" (UID: "23fb4369-658c-4141-b45b-4435945058a1"). InnerVolumeSpecName "kube-api-access-dbgdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:29:53.642156 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.642125    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbgdw\" (UniqueName: \"kubernetes.io/projected/23fb4369-658c-4141-b45b-4435945058a1-kube-api-access-dbgdw\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:53.642156 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.642151    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:53.642156 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.642160    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23fb4369-658c-4141-b45b-4435945058a1-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:53.642429 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:53.642168    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23fb4369-658c-4141-b45b-4435945058a1-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.142912 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.142873    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892" podUID="c7610949-4734-448d-8ab3-2284ebd97c01" containerName="main" containerID="cri-o://128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357" gracePeriod=45
Aug 02 11:29:54.212631 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.212594    2563 generic.go:356] "Generic (PLEG): container finished" podID="23fb4369-658c-4141-b45b-4435945058a1" containerID="042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54" exitCode=0
Aug 02 11:29:54.213058 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.212641    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"
Aug 02 11:29:54.213058 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.212688    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg" event={"ID":"23fb4369-658c-4141-b45b-4435945058a1","Type":"ContainerDied","Data":"042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54"}
Aug 02 11:29:54.213058 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.212738    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg" event={"ID":"23fb4369-658c-4141-b45b-4435945058a1","Type":"ContainerDied","Data":"84dd4c73fa5c9d44797018aec940b192ddcd975f3896b1a74664771f2d18fdf6"}
Aug 02 11:29:54.213058 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.212756    2563 scope.go:117] "RemoveContainer" containerID="042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54"
Aug 02 11:29:54.234104 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.234078    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"]
Aug 02 11:29:54.237229 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.237208    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/auth-test-model-3951f6-kserve-f79d467ff-llrdg"]
Aug 02 11:29:54.254332 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.254315    2563 scope.go:117] "RemoveContainer" containerID="042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54"
Aug 02 11:29:54.254613 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:29:54.254594    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54\": container with ID starting with 042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54 not found: ID does not exist" containerID="042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54"
Aug 02 11:29:54.254676 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.254621    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54"} err="failed to get container status \"042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54\": rpc error: code = NotFound desc = could not find container \"042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54\": container with ID starting with 042f88a0a2ca4fe81194e02233c02fd621829a626bb0caa3b04d8f466fc7aa54 not found: ID does not exist"
Aug 02 11:29:54.395473 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.395413    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:29:54.550708 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.550667    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-dshm\") pod \"c7610949-4734-448d-8ab3-2284ebd97c01\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") "
Aug 02 11:29:54.550911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.550736    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-model-cache\") pod \"c7610949-4734-448d-8ab3-2284ebd97c01\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") "
Aug 02 11:29:54.550911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.550760    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-home\") pod \"c7610949-4734-448d-8ab3-2284ebd97c01\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") "
Aug 02 11:29:54.550911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.550784    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qhwlh\" (UniqueName: \"kubernetes.io/projected/c7610949-4734-448d-8ab3-2284ebd97c01-kube-api-access-qhwlh\") pod \"c7610949-4734-448d-8ab3-2284ebd97c01\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") "
Aug 02 11:29:54.550911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.550816    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-tmp-dir\") pod \"c7610949-4734-448d-8ab3-2284ebd97c01\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") "
Aug 02 11:29:54.550911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.550868    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7610949-4734-448d-8ab3-2284ebd97c01-tls-certs\") pod \"c7610949-4734-448d-8ab3-2284ebd97c01\" (UID: \"c7610949-4734-448d-8ab3-2284ebd97c01\") "
Aug 02 11:29:54.551162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.551038    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-model-cache" (OuterVolumeSpecName: "model-cache") pod "c7610949-4734-448d-8ab3-2284ebd97c01" (UID: "c7610949-4734-448d-8ab3-2284ebd97c01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:54.551162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.551067    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-home" (OuterVolumeSpecName: "home") pod "c7610949-4734-448d-8ab3-2284ebd97c01" (UID: "c7610949-4734-448d-8ab3-2284ebd97c01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:54.551162 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.551103    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c7610949-4734-448d-8ab3-2284ebd97c01" (UID: "c7610949-4734-448d-8ab3-2284ebd97c01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:54.551297 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.551171    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.551297 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.551188    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.551297 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.551202    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.553191 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.553167    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-dshm" (OuterVolumeSpecName: "dshm") pod "c7610949-4734-448d-8ab3-2284ebd97c01" (UID: "c7610949-4734-448d-8ab3-2284ebd97c01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:29:54.553337 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.553206    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7610949-4734-448d-8ab3-2284ebd97c01-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c7610949-4734-448d-8ab3-2284ebd97c01" (UID: "c7610949-4734-448d-8ab3-2284ebd97c01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:29:54.553337 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.553213    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7610949-4734-448d-8ab3-2284ebd97c01-kube-api-access-qhwlh" (OuterVolumeSpecName: "kube-api-access-qhwlh") pod "c7610949-4734-448d-8ab3-2284ebd97c01" (UID: "c7610949-4734-448d-8ab3-2284ebd97c01"). InnerVolumeSpecName "kube-api-access-qhwlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:29:54.652381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.652286    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c7610949-4734-448d-8ab3-2284ebd97c01-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.652381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.652328    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qhwlh\" (UniqueName: \"kubernetes.io/projected/c7610949-4734-448d-8ab3-2284ebd97c01-kube-api-access-qhwlh\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.652381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.652339    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c7610949-4734-448d-8ab3-2284ebd97c01-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:29:54.847430 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:54.847397    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23fb4369-658c-4141-b45b-4435945058a1" path="/var/lib/kubelet/pods/23fb4369-658c-4141-b45b-4435945058a1/volumes"
Aug 02 11:29:55.218660 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.218632    2563 generic.go:356] "Generic (PLEG): container finished" podID="c7610949-4734-448d-8ab3-2284ebd97c01" containerID="128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357" exitCode=0
Aug 02 11:29:55.219106 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.218678    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"
Aug 02 11:29:55.219106 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.218718    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892" event={"ID":"c7610949-4734-448d-8ab3-2284ebd97c01","Type":"ContainerDied","Data":"128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357"}
Aug 02 11:29:55.219106 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.218755    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892" event={"ID":"c7610949-4734-448d-8ab3-2284ebd97c01","Type":"ContainerDied","Data":"848c90b1f27909812abb2cc377f7fbac05d65ed4e4d9f51cbe6c1c0a882e193e"}
Aug 02 11:29:55.219106 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.218773    2563 scope.go:117] "RemoveContainer" containerID="128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357"
Aug 02 11:29:55.227687 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.227669    2563 scope.go:117] "RemoveContainer" containerID="128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357"
Aug 02 11:29:55.227940 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:29:55.227922    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357\": container with ID starting with 128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357 not found: ID does not exist" containerID="128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357"
Aug 02 11:29:55.228009 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.227949    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357"} err="failed to get container status \"128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357\": rpc error: code = NotFound desc = could not find container \"128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357\": container with ID starting with 128d61310313828327d020e17ae08d9c386bf3e993d82af59de33870f8b0c357 not found: ID does not exist"
Aug 02 11:29:55.231707 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.231655    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"]
Aug 02 11:29:55.234238 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:55.234217    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/auth-test-model-4f1bb7-kserve-68cf6c864c-7d892"]
Aug 02 11:29:56.846929 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:29:56.846899    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7610949-4734-448d-8ab3-2284ebd97c01" path="/var/lib/kubelet/pods/c7610949-4734-448d-8ab3-2284ebd97c01/volumes"
Aug 02 11:30:12.940071 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940040    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"]
Aug 02 11:30:12.942309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940378    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23fb4369-658c-4141-b45b-4435945058a1" containerName="main"
Aug 02 11:30:12.942309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940390    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="23fb4369-658c-4141-b45b-4435945058a1" containerName="main"
Aug 02 11:30:12.942309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940400    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7610949-4734-448d-8ab3-2284ebd97c01" containerName="main"
Aug 02 11:30:12.942309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940406    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7610949-4734-448d-8ab3-2284ebd97c01" containerName="main"
Aug 02 11:30:12.942309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940454    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="23fb4369-658c-4141-b45b-4435945058a1" containerName="main"
Aug 02 11:30:12.942309 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.940464    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7610949-4734-448d-8ab3-2284ebd97c01" containerName="main"
Aug 02 11:30:12.943119 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.943103    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:12.945474 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.945451    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"kube-root-ca.crt\""
Aug 02 11:30:12.945586 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.945476    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"openshift-service-ca.crt\""
Aug 02 11:30:12.945586 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.945477    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"sub-test-model-4f1bb7-kserve-self-signed-certs\""
Aug 02 11:30:12.945586 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.945450    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"default-dockercfg-msxv2\""
Aug 02 11:30:12.951859 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:12.951837    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"]
Aug 02 11:30:13.020670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.020643    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tls-certs\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.020825 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.020720    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42vs2\" (UniqueName: \"kubernetes.io/projected/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-kube-api-access-42vs2\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.020825 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.020760    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-dshm\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.020825 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.020808    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-model-cache\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.020942 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.020831    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tmp-dir\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.020942 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.020886    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-home\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.036964 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.036938    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:30:13.121522 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.121489    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42vs2\" (UniqueName: \"kubernetes.io/projected/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-kube-api-access-42vs2\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.121694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.121550    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-dshm\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.121694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.121611    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-model-cache\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.121694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.121628    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tmp-dir\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.121694 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.121688    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-home\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.121868 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.121736    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tls-certs\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.122117 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.122093    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tmp-dir\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.122117 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.122111    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-model-cache\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.122243 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.122139    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-home\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.124071 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.124050    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-dshm\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.124274 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.124243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tls-certs\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.129451 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.129432    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42vs2\" (UniqueName: \"kubernetes.io/projected/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-kube-api-access-42vs2\") pod \"sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") " pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.252643 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.252558    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:13.384821 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:13.384795    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"]
Aug 02 11:30:13.387312 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:30:13.387287    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd08e7ae3_c5f4_4e50_bc70_f82ee1e8b192.slice/crio-c5eae5e512387a52ccfed60d3ff18c8973e3348b3209342ab3123a8ce0b266d7 WatchSource:0}: Error finding container c5eae5e512387a52ccfed60d3ff18c8973e3348b3209342ab3123a8ce0b266d7: Status 404 returned error can't find the container with id c5eae5e512387a52ccfed60d3ff18c8973e3348b3209342ab3123a8ce0b266d7
Aug 02 11:30:14.310508 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:14.310473    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9" event={"ID":"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192","Type":"ContainerStarted","Data":"c60a78c577a336b9e34c7c957d928d25d29580bd6077e74f53ead3b8135918eb"}
Aug 02 11:30:14.310910 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:14.310520    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9" event={"ID":"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192","Type":"ContainerStarted","Data":"c5eae5e512387a52ccfed60d3ff18c8973e3348b3209342ab3123a8ce0b266d7"}
Aug 02 11:30:14.325044 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:14.324984    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9" podStartSLOduration=2.324965155 podStartE2EDuration="2.324965155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:30:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:30:14.32401994 +0000 UTC m=+3409.982237530" watchObservedRunningTime="2026-08-02 11:30:14.324965155 +0000 UTC m=+3409.983182747"
Aug 02 11:30:15.775110 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:15.775020    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:30:23.253134 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:23.253092    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:23.253674 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:23.253150    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:23.265946 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:23.265921    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:23.361534 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:23.361507    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:30:34.854318 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:34.854279    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:30:34.955055 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:30:34.955009    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:31:39.818553 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:39.818519    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:31:40.636619 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:40.636585    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"]
Aug 02 11:31:40.653112 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:40.653081    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:31:47.234383 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.234310    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"]
Aug 02 11:31:47.237539 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.237517    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.239975 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.239951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"kube-root-ca.crt\""
Aug 02 11:31:47.240111 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.239951    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"openshift-service-ca.crt\""
Aug 02 11:31:47.240111 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.239990    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"rate-test-model-3951f6-kserve-self-signed-certs\""
Aug 02 11:31:47.240111 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.240038    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3951f6\"/\"default-dockercfg-44xf5\""
Aug 02 11:31:47.244927 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.244901    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"]
Aug 02 11:31:47.266673 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.266640    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:31:47.349981 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.349941    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-dshm\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.349981 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.349982    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-tmp-dir\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.350205 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.350022    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-model-cache\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.350205 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.350097    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935f1b80-fe09-47e1-a757-d27dcce34ae1-tls-certs\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.350205 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.350155    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62xrd\" (UniqueName: \"kubernetes.io/projected/935f1b80-fe09-47e1-a757-d27dcce34ae1-kube-api-access-62xrd\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.350362 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.350214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-home\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.451460 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.451419    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935f1b80-fe09-47e1-a757-d27dcce34ae1-tls-certs\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.451680 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.451480    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62xrd\" (UniqueName: \"kubernetes.io/projected/935f1b80-fe09-47e1-a757-d27dcce34ae1-kube-api-access-62xrd\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.451680 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.451513    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-home\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.451680 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.451558    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-dshm\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.451680 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.451576    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-tmp-dir\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.451680 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.451604    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-model-cache\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.452034 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.452012    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-model-cache\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.452080 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.452053    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-home\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.452132 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.452072    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-tmp-dir\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.453910 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.453887    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-dshm\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.454292 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.454254    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935f1b80-fe09-47e1-a757-d27dcce34ae1-tls-certs\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.458862 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.458840    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62xrd\" (UniqueName: \"kubernetes.io/projected/935f1b80-fe09-47e1-a757-d27dcce34ae1-kube-api-access-62xrd\") pod \"rate-test-model-3951f6-kserve-5b57495595-kkfhv\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") " pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.547892 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.547785    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:47.682117 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.682092    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"]
Aug 02 11:31:47.684714 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:31:47.684685    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod935f1b80_fe09_47e1_a757_d27dcce34ae1.slice/crio-a66a18501874cb191b2e5f1110afb4153d214c5e00a73daca328c78d07300cf8 WatchSource:0}: Error finding container a66a18501874cb191b2e5f1110afb4153d214c5e00a73daca328c78d07300cf8: Status 404 returned error can't find the container with id a66a18501874cb191b2e5f1110afb4153d214c5e00a73daca328c78d07300cf8
Aug 02 11:31:47.726157 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:47.726122    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv" event={"ID":"935f1b80-fe09-47e1-a757-d27dcce34ae1","Type":"ContainerStarted","Data":"a66a18501874cb191b2e5f1110afb4153d214c5e00a73daca328c78d07300cf8"}
Aug 02 11:31:48.732456 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:48.732417    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv" event={"ID":"935f1b80-fe09-47e1-a757-d27dcce34ae1","Type":"ContainerStarted","Data":"78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e"}
Aug 02 11:31:48.749473 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:48.749422    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv" podStartSLOduration=1.749405688 podStartE2EDuration="1.749405688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:31:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:31:48.746828431 +0000 UTC m=+3504.405046017" watchObservedRunningTime="2026-08-02 11:31:48.749405688 +0000 UTC m=+3504.407623278"
Aug 02 11:31:55.656465 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.656424    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9" podUID="d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" containerName="main" containerID="cri-o://c60a78c577a336b9e34c7c957d928d25d29580bd6077e74f53ead3b8135918eb" gracePeriod=45
Aug 02 11:31:55.772750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.772719    2563 generic.go:356] "Generic (PLEG): container finished" podID="d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" containerID="c60a78c577a336b9e34c7c957d928d25d29580bd6077e74f53ead3b8135918eb" exitCode=0
Aug 02 11:31:55.772897 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.772779    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9" event={"ID":"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192","Type":"ContainerDied","Data":"c60a78c577a336b9e34c7c957d928d25d29580bd6077e74f53ead3b8135918eb"}
Aug 02 11:31:55.913354 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.913297    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:31:55.918061 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918039    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-dshm\") pod \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") "
Aug 02 11:31:55.918166 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918070    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tmp-dir\") pod \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") "
Aug 02 11:31:55.918166 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918108    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42vs2\" (UniqueName: \"kubernetes.io/projected/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-kube-api-access-42vs2\") pod \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") "
Aug 02 11:31:55.918244 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918178    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-home\") pod \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") "
Aug 02 11:31:55.918244 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918219    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-model-cache\") pod \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") "
Aug 02 11:31:55.918385 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918299    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tls-certs\") pod \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\" (UID: \"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192\") "
Aug 02 11:31:55.918385 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918353    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" (UID: "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:31:55.918492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918415    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-home" (OuterVolumeSpecName: "home") pod "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" (UID: "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:31:55.918554 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918511    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-model-cache" (OuterVolumeSpecName: "model-cache") pod "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" (UID: "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:31:55.918632 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918615    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:31:55.918683 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918637    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:31:55.918683 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.918653    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:31:55.920419 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.920400    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-dshm" (OuterVolumeSpecName: "dshm") pod "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" (UID: "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:31:55.920494 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.920440    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-kube-api-access-42vs2" (OuterVolumeSpecName: "kube-api-access-42vs2") pod "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" (UID: "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192"). InnerVolumeSpecName "kube-api-access-42vs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:31:55.920536 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:55.920527    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" (UID: "d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:31:56.019185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.019149    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:31:56.019185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.019178    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:31:56.019185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.019190    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42vs2\" (UniqueName: \"kubernetes.io/projected/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192-kube-api-access-42vs2\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:31:56.778653 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.778622    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"
Aug 02 11:31:56.779144 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.778666    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9" event={"ID":"d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192","Type":"ContainerDied","Data":"c5eae5e512387a52ccfed60d3ff18c8973e3348b3209342ab3123a8ce0b266d7"}
Aug 02 11:31:56.779144 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.778718    2563 scope.go:117] "RemoveContainer" containerID="c60a78c577a336b9e34c7c957d928d25d29580bd6077e74f53ead3b8135918eb"
Aug 02 11:31:56.798135 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.798110    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"]
Aug 02 11:31:56.801634 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.801612    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/sub-test-model-4f1bb7-kserve-84f649bdb7-n55n9"]
Aug 02 11:31:56.846496 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:56.846468    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" path="/var/lib/kubelet/pods/d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192/volumes"
Aug 02 11:31:57.548340 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:57.548297    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:57.548541 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:57.548404    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:57.561212 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:57.561186    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:31:57.795412 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:31:57.795387    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:32:22.452303 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.452250    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"]
Aug 02 11:32:22.452766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.452736    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" containerName="main"
Aug 02 11:32:22.452766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.452751    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" containerName="main"
Aug 02 11:32:22.452869 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.452857    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d08e7ae3-c5f4-4e50-bc70-f82ee1e8b192" containerName="main"
Aug 02 11:32:22.456164 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.456143    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.458030 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.458009    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"openshift-service-ca.crt\""
Aug 02 11:32:22.458161 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.458051    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"rate-test-model-4f1bb7-kserve-self-signed-certs\""
Aug 02 11:32:22.458468 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.458444    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"kube-root-ca.crt\""
Aug 02 11:32:22.458578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.458488    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-4f1bb7\"/\"default-dockercfg-msxv2\""
Aug 02 11:32:22.462185 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.462163    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"]
Aug 02 11:32:22.475121 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.475089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:32:22.550501 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.550465    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a83c95e-88df-4997-bfc5-caf8ad636578-tls-certs\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.550679 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.550514    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-tmp-dir\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.550679 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.550595    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-model-cache\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.550679 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.550617    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-home\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.550679 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.550634    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-dshm\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.550854 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.550721    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2gsm\" (UniqueName: \"kubernetes.io/projected/1a83c95e-88df-4997-bfc5-caf8ad636578-kube-api-access-q2gsm\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.651700 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.651660    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-model-cache\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.651700 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.651700    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-home\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.651949 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.651720    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-dshm\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.651949 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.651753    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2gsm\" (UniqueName: \"kubernetes.io/projected/1a83c95e-88df-4997-bfc5-caf8ad636578-kube-api-access-q2gsm\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.651949 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.651788    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a83c95e-88df-4997-bfc5-caf8ad636578-tls-certs\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.651949 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.651818    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-tmp-dir\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.652142 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.652122    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-model-cache\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.652204 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.652138    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-home\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.652287 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.652223    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-tmp-dir\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.654281 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.654243    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-dshm\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.654570 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.654548    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a83c95e-88df-4997-bfc5-caf8ad636578-tls-certs\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.659775 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.659749    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2gsm\" (UniqueName: \"kubernetes.io/projected/1a83c95e-88df-4997-bfc5-caf8ad636578-kube-api-access-q2gsm\") pod \"rate-test-model-4f1bb7-kserve-66dc5fd67-725m9\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") " pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.766502 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.766419    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:22.903200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:22.903175    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"]
Aug 02 11:32:22.905289 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:32:22.905247    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a83c95e_88df_4997_bfc5_caf8ad636578.slice/crio-b1a0c7afa51a521cf72e2ed30783bb90d02d4fe6a3c47f128176b8a8cf878fc3 WatchSource:0}: Error finding container b1a0c7afa51a521cf72e2ed30783bb90d02d4fe6a3c47f128176b8a8cf878fc3: Status 404 returned error can't find the container with id b1a0c7afa51a521cf72e2ed30783bb90d02d4fe6a3c47f128176b8a8cf878fc3
Aug 02 11:32:23.899280 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:23.899224    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9" event={"ID":"1a83c95e-88df-4997-bfc5-caf8ad636578","Type":"ContainerStarted","Data":"f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f"}
Aug 02 11:32:23.899280 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:23.899283    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9" event={"ID":"1a83c95e-88df-4997-bfc5-caf8ad636578","Type":"ContainerStarted","Data":"b1a0c7afa51a521cf72e2ed30783bb90d02d4fe6a3c47f128176b8a8cf878fc3"}
Aug 02 11:32:23.916173 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:23.916123    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9" podStartSLOduration=1.91610953 podStartE2EDuration="1.91610953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:32:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:32:23.914902088 +0000 UTC m=+3539.573119691" watchObservedRunningTime="2026-08-02 11:32:23.91610953 +0000 UTC m=+3539.574327119"
Aug 02 11:32:32.767604 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:32.767560    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:32.768015 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:32.767630    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:32.780535 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:32.780504    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:32:32.953001 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:32:32.952974    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:33:21.019895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:21.019810    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:25.020364 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:25.020336    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:33:25.027796 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:25.027773    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:33:29.968825 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:29.968789    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"]
Aug 02 11:33:29.981403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:29.981374    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:30.834203 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:30.834164    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"]
Aug 02 11:33:30.848357 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:30.846648    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:44.988145 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:44.988104    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv" podUID="935f1b80-fe09-47e1-a757-d27dcce34ae1" containerName="main" containerID="cri-o://78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e" gracePeriod=45
Aug 02 11:33:45.242689 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.242636    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:33:45.274693 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.274662    2563 generic.go:356] "Generic (PLEG): container finished" podID="935f1b80-fe09-47e1-a757-d27dcce34ae1" containerID="78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e" exitCode=0
Aug 02 11:33:45.274880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.274715    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv" event={"ID":"935f1b80-fe09-47e1-a757-d27dcce34ae1","Type":"ContainerDied","Data":"78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e"}
Aug 02 11:33:45.274880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.274722    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"
Aug 02 11:33:45.274880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.274747    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv" event={"ID":"935f1b80-fe09-47e1-a757-d27dcce34ae1","Type":"ContainerDied","Data":"a66a18501874cb191b2e5f1110afb4153d214c5e00a73daca328c78d07300cf8"}
Aug 02 11:33:45.274880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.274770    2563 scope.go:117] "RemoveContainer" containerID="78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e"
Aug 02 11:33:45.283620 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.283597    2563 scope.go:117] "RemoveContainer" containerID="78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e"
Aug 02 11:33:45.283902 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:33:45.283882    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e\": container with ID starting with 78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e not found: ID does not exist" containerID="78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e"
Aug 02 11:33:45.283957 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.283912    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e"} err="failed to get container status \"78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e\": rpc error: code = NotFound desc = could not find container \"78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e\": container with ID starting with 78d8beaea4d9c150fdd26079467580e0d336536deec26e2bf0da45437a8bfd8e not found: ID does not exist"
Aug 02 11:33:45.303839 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.303804    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-tmp-dir\") pod \"935f1b80-fe09-47e1-a757-d27dcce34ae1\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") "
Aug 02 11:33:45.303839 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.303845    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935f1b80-fe09-47e1-a757-d27dcce34ae1-tls-certs\") pod \"935f1b80-fe09-47e1-a757-d27dcce34ae1\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") "
Aug 02 11:33:45.304043 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.303903    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-model-cache\") pod \"935f1b80-fe09-47e1-a757-d27dcce34ae1\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") "
Aug 02 11:33:45.304043 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.303945    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-dshm\") pod \"935f1b80-fe09-47e1-a757-d27dcce34ae1\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") "
Aug 02 11:33:45.304043 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.303981    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62xrd\" (UniqueName: \"kubernetes.io/projected/935f1b80-fe09-47e1-a757-d27dcce34ae1-kube-api-access-62xrd\") pod \"935f1b80-fe09-47e1-a757-d27dcce34ae1\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") "
Aug 02 11:33:45.304043 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.304004    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-home\") pod \"935f1b80-fe09-47e1-a757-d27dcce34ae1\" (UID: \"935f1b80-fe09-47e1-a757-d27dcce34ae1\") "
Aug 02 11:33:45.304257 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.304067    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "935f1b80-fe09-47e1-a757-d27dcce34ae1" (UID: "935f1b80-fe09-47e1-a757-d27dcce34ae1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:45.304257 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.304194    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-model-cache" (OuterVolumeSpecName: "model-cache") pod "935f1b80-fe09-47e1-a757-d27dcce34ae1" (UID: "935f1b80-fe09-47e1-a757-d27dcce34ae1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:45.304394 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.304355    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-home" (OuterVolumeSpecName: "home") pod "935f1b80-fe09-47e1-a757-d27dcce34ae1" (UID: "935f1b80-fe09-47e1-a757-d27dcce34ae1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:45.304394 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.304365    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:45.304394 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.304385    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:45.306183 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.306155    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-dshm" (OuterVolumeSpecName: "dshm") pod "935f1b80-fe09-47e1-a757-d27dcce34ae1" (UID: "935f1b80-fe09-47e1-a757-d27dcce34ae1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:45.306313 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.306221    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935f1b80-fe09-47e1-a757-d27dcce34ae1-kube-api-access-62xrd" (OuterVolumeSpecName: "kube-api-access-62xrd") pod "935f1b80-fe09-47e1-a757-d27dcce34ae1" (UID: "935f1b80-fe09-47e1-a757-d27dcce34ae1"). InnerVolumeSpecName "kube-api-access-62xrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:33:45.306313 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.306238    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/935f1b80-fe09-47e1-a757-d27dcce34ae1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "935f1b80-fe09-47e1-a757-d27dcce34ae1" (UID: "935f1b80-fe09-47e1-a757-d27dcce34ae1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:33:45.404858 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.404812    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/935f1b80-fe09-47e1-a757-d27dcce34ae1-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:45.404858 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.404847    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:45.404858 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.404857    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62xrd\" (UniqueName: \"kubernetes.io/projected/935f1b80-fe09-47e1-a757-d27dcce34ae1-kube-api-access-62xrd\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:45.404858 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.404867    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/935f1b80-fe09-47e1-a757-d27dcce34ae1-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:45.596531 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.596504    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"]
Aug 02 11:33:45.598573 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.598552    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3951f6/rate-test-model-3951f6-kserve-5b57495595-kkfhv"]
Aug 02 11:33:45.858994 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:45.858893    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9" podUID="1a83c95e-88df-4997-bfc5-caf8ad636578" containerName="main" containerID="cri-o://f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f" gracePeriod=45
Aug 02 11:33:46.119966 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.119901    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:33:46.212207 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212172    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-tmp-dir\") pod \"1a83c95e-88df-4997-bfc5-caf8ad636578\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") "
Aug 02 11:33:46.212207 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212213    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-home\") pod \"1a83c95e-88df-4997-bfc5-caf8ad636578\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") "
Aug 02 11:33:46.212440 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212232    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2gsm\" (UniqueName: \"kubernetes.io/projected/1a83c95e-88df-4997-bfc5-caf8ad636578-kube-api-access-q2gsm\") pod \"1a83c95e-88df-4997-bfc5-caf8ad636578\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") "
Aug 02 11:33:46.212440 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212299    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a83c95e-88df-4997-bfc5-caf8ad636578-tls-certs\") pod \"1a83c95e-88df-4997-bfc5-caf8ad636578\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") "
Aug 02 11:33:46.212440 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212326    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-dshm\") pod \"1a83c95e-88df-4997-bfc5-caf8ad636578\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") "
Aug 02 11:33:46.212440 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212347    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-model-cache\") pod \"1a83c95e-88df-4997-bfc5-caf8ad636578\" (UID: \"1a83c95e-88df-4997-bfc5-caf8ad636578\") "
Aug 02 11:33:46.212649 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212543    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-home" (OuterVolumeSpecName: "home") pod "1a83c95e-88df-4997-bfc5-caf8ad636578" (UID: "1a83c95e-88df-4997-bfc5-caf8ad636578"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:46.212649 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212561    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1a83c95e-88df-4997-bfc5-caf8ad636578" (UID: "1a83c95e-88df-4997-bfc5-caf8ad636578"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:46.212762 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212701    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:46.212762 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212726    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:46.212762 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.212696    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-model-cache" (OuterVolumeSpecName: "model-cache") pod "1a83c95e-88df-4997-bfc5-caf8ad636578" (UID: "1a83c95e-88df-4997-bfc5-caf8ad636578"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:46.214554 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.214534    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a83c95e-88df-4997-bfc5-caf8ad636578-kube-api-access-q2gsm" (OuterVolumeSpecName: "kube-api-access-q2gsm") pod "1a83c95e-88df-4997-bfc5-caf8ad636578" (UID: "1a83c95e-88df-4997-bfc5-caf8ad636578"). InnerVolumeSpecName "kube-api-access-q2gsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:33:46.215002 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.214987    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-dshm" (OuterVolumeSpecName: "dshm") pod "1a83c95e-88df-4997-bfc5-caf8ad636578" (UID: "1a83c95e-88df-4997-bfc5-caf8ad636578"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:33:46.215049 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.215016    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a83c95e-88df-4997-bfc5-caf8ad636578-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1a83c95e-88df-4997-bfc5-caf8ad636578" (UID: "1a83c95e-88df-4997-bfc5-caf8ad636578"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:33:46.279586 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.279553    2563 generic.go:356] "Generic (PLEG): container finished" podID="1a83c95e-88df-4997-bfc5-caf8ad636578" containerID="f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f" exitCode=0
Aug 02 11:33:46.279750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.279601    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"
Aug 02 11:33:46.279750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.279641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9" event={"ID":"1a83c95e-88df-4997-bfc5-caf8ad636578","Type":"ContainerDied","Data":"f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f"}
Aug 02 11:33:46.279750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.279682    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9" event={"ID":"1a83c95e-88df-4997-bfc5-caf8ad636578","Type":"ContainerDied","Data":"b1a0c7afa51a521cf72e2ed30783bb90d02d4fe6a3c47f128176b8a8cf878fc3"}
Aug 02 11:33:46.279750 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.279704    2563 scope.go:117] "RemoveContainer" containerID="f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f"
Aug 02 11:33:46.288479 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.288458    2563 scope.go:117] "RemoveContainer" containerID="f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f"
Aug 02 11:33:46.288725 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:33:46.288705    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f\": container with ID starting with f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f not found: ID does not exist" containerID="f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f"
Aug 02 11:33:46.288796 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.288733    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f"} err="failed to get container status \"f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f\": rpc error: code = NotFound desc = could not find container \"f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f\": container with ID starting with f5780552ad94fc83bd2e06649d1a4f5447a5d9d655f1570db80e787a00ba3a5f not found: ID does not exist"
Aug 02 11:33:46.298740 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.298718    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"]
Aug 02 11:33:46.302247 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.302229    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-4f1bb7/rate-test-model-4f1bb7-kserve-66dc5fd67-725m9"]
Aug 02 11:33:46.314064 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.314041    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1a83c95e-88df-4997-bfc5-caf8ad636578-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:46.314064 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.314064    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:46.314153 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.314073    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1a83c95e-88df-4997-bfc5-caf8ad636578-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:46.314153 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.314082    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2gsm\" (UniqueName: \"kubernetes.io/projected/1a83c95e-88df-4997-bfc5-caf8ad636578-kube-api-access-q2gsm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:46.750582 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750547    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7333-139910175028688"]
Aug 02 11:33:46.750878 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750867    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a83c95e-88df-4997-bfc5-caf8ad636578" containerName="main"
Aug 02 11:33:46.750924 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750880    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a83c95e-88df-4997-bfc5-caf8ad636578" containerName="main"
Aug 02 11:33:46.750924 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750892    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935f1b80-fe09-47e1-a757-d27dcce34ae1" containerName="main"
Aug 02 11:33:46.750924 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750897    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="935f1b80-fe09-47e1-a757-d27dcce34ae1" containerName="main"
Aug 02 11:33:46.751019 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750967    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a83c95e-88df-4997-bfc5-caf8ad636578" containerName="main"
Aug 02 11:33:46.751019 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.750978    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="935f1b80-fe09-47e1-a757-d27dcce34ae1" containerName="main"
Aug 02 11:33:46.755405 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.755382    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:46.757098 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.757071    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7333-139910175028688"]
Aug 02 11:33:46.757349 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.757334    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mqz2w\""
Aug 02 11:33:46.818048 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.818018    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrvsp\" (UniqueName: \"kubernetes.io/projected/8ccb99aa-586e-4b83-b874-3e4b4ccb253d-kube-api-access-xrvsp\") pod \"test-curl-7333-139910175028688\" (UID: \"8ccb99aa-586e-4b83-b874-3e4b4ccb253d\") " pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:46.846271 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.846238    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a83c95e-88df-4997-bfc5-caf8ad636578" path="/var/lib/kubelet/pods/1a83c95e-88df-4997-bfc5-caf8ad636578/volumes"
Aug 02 11:33:46.846655 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.846641    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="935f1b80-fe09-47e1-a757-d27dcce34ae1" path="/var/lib/kubelet/pods/935f1b80-fe09-47e1-a757-d27dcce34ae1/volumes"
Aug 02 11:33:46.919617 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.919587    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrvsp\" (UniqueName: \"kubernetes.io/projected/8ccb99aa-586e-4b83-b874-3e4b4ccb253d-kube-api-access-xrvsp\") pod \"test-curl-7333-139910175028688\" (UID: \"8ccb99aa-586e-4b83-b874-3e4b4ccb253d\") " pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:46.927046 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:46.927026    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrvsp\" (UniqueName: \"kubernetes.io/projected/8ccb99aa-586e-4b83-b874-3e4b4ccb253d-kube-api-access-xrvsp\") pod \"test-curl-7333-139910175028688\" (UID: \"8ccb99aa-586e-4b83-b874-3e4b4ccb253d\") " pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:47.066407 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:47.066324    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:47.199133 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:47.199111    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7333-139910175028688"]
Aug 02 11:33:47.201102 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:33:47.201075    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8ccb99aa_586e_4b83_b874_3e4b4ccb253d.slice/crio-590a30618285b629bee2b26f480b005efc7fd018603e3c387a1a68cfc345a26d WatchSource:0}: Error finding container 590a30618285b629bee2b26f480b005efc7fd018603e3c387a1a68cfc345a26d: Status 404 returned error can't find the container with id 590a30618285b629bee2b26f480b005efc7fd018603e3c387a1a68cfc345a26d
Aug 02 11:33:47.202448 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:47.202432    2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 02 11:33:47.287111 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:47.287076    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7333-139910175028688" event={"ID":"8ccb99aa-586e-4b83-b874-3e4b4ccb253d","Type":"ContainerStarted","Data":"590a30618285b629bee2b26f480b005efc7fd018603e3c387a1a68cfc345a26d"}
Aug 02 11:33:48.292930 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:48.292894    2563 generic.go:356] "Generic (PLEG): container finished" podID="8ccb99aa-586e-4b83-b874-3e4b4ccb253d" containerID="64598034c98b0fb16170169983c97bc03047599cf875f48805b84b96ddbfd8d6" exitCode=0
Aug 02 11:33:48.293369 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:48.292999    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7333-139910175028688" event={"ID":"8ccb99aa-586e-4b83-b874-3e4b4ccb253d","Type":"ContainerDied","Data":"64598034c98b0fb16170169983c97bc03047599cf875f48805b84b96ddbfd8d6"}
Aug 02 11:33:49.435845 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.435819    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:49.455100 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.455070    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7333-139910175028688_8ccb99aa-586e-4b83-b874-3e4b4ccb253d/test-curl-7333-139910175028688/0.log"
Aug 02 11:33:49.474941 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.474912    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7333-139910175028688"]
Aug 02 11:33:49.481520 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.481496    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7333-139910175028688"]
Aug 02 11:33:49.543316 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.543288    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrvsp\" (UniqueName: \"kubernetes.io/projected/8ccb99aa-586e-4b83-b874-3e4b4ccb253d-kube-api-access-xrvsp\") pod \"8ccb99aa-586e-4b83-b874-3e4b4ccb253d\" (UID: \"8ccb99aa-586e-4b83-b874-3e4b4ccb253d\") "
Aug 02 11:33:49.545510 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.545476    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ccb99aa-586e-4b83-b874-3e4b4ccb253d-kube-api-access-xrvsp" (OuterVolumeSpecName: "kube-api-access-xrvsp") pod "8ccb99aa-586e-4b83-b874-3e4b4ccb253d" (UID: "8ccb99aa-586e-4b83-b874-3e4b4ccb253d"). InnerVolumeSpecName "kube-api-access-xrvsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:33:49.644817 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.644773    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrvsp\" (UniqueName: \"kubernetes.io/projected/8ccb99aa-586e-4b83-b874-3e4b4ccb253d-kube-api-access-xrvsp\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:33:49.979465 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:49.979427    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:50.250492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.250413    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"]
Aug 02 11:33:50.250763 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.250750    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ccb99aa-586e-4b83-b874-3e4b4ccb253d" containerName="test-curl-7333-139910175028688"
Aug 02 11:33:50.250807 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.250765    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ccb99aa-586e-4b83-b874-3e4b4ccb253d" containerName="test-curl-7333-139910175028688"
Aug 02 11:33:50.250844 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.250834    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ccb99aa-586e-4b83-b874-3e4b4ccb253d" containerName="test-curl-7333-139910175028688"
Aug 02 11:33:50.253688 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.253671    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.255617 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.255599    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-fe62c7-openshift-default-dockercfg-g8lzp\""
Aug 02 11:33:50.262247 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.262225    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"]
Aug 02 11:33:50.276116 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.276092    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:50.305749 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.305723    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:50.305910 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.305730    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="590a30618285b629bee2b26f480b005efc7fd018603e3c387a1a68cfc345a26d"
Aug 02 11:33:50.315556 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:33:50.315515    2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7333-139910175028688\" is forbidden: User \"system:node:ip-10-0-130-84.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-84.ec2.internal' and this object" podUID="8ccb99aa-586e-4b83-b874-3e4b4ccb253d" pod="opendatahub/test-curl-7333-139910175028688"
Aug 02 11:33:50.352002 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.351969    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-socket\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.352216 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352030    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-token\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.352216 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352062    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-data\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.352216 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352117    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-certs\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.352216 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352157    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istiod-ca-cert\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.352216 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352184    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-envoy\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.352216 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352214    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-credential-socket\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.353493 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352294    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-podinfo\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.353493 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.352327    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gfrv\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-kube-api-access-2gfrv\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.453693 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453649    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-token\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.453693 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453695    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-data\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453722    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-certs\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453756    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istiod-ca-cert\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453784    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-envoy\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453808    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-credential-socket\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453833    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-podinfo\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453858    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gfrv\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-kube-api-access-2gfrv\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.453911    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-socket\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454197 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.454133    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-data\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454571 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.454199    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-certs\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454571 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.454378    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-credential-socket\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454571 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.454439    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-socket\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.454685 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.454668    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istiod-ca-cert\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.456210 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.456184    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-envoy\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.456593 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.456574    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-podinfo\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.461071 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.461045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-token\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.461434 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.461413    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gfrv\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-kube-api-access-2gfrv\") pod \"e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") " pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.462714 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.462689    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:50.565771 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.565674    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:50.702983 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.702956    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"]
Aug 02 11:33:50.705187 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:33:50.705154    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb80d7f2d_01e6_4e59_aebf_d8a308c0031e.slice/crio-af0f91fd85a3756bf7efe9906fd4dcf9c56f15c67b93faca157b4d6c9783905c WatchSource:0}: Error finding container af0f91fd85a3756bf7efe9906fd4dcf9c56f15c67b93faca157b4d6c9783905c: Status 404 returned error can't find the container with id af0f91fd85a3756bf7efe9906fd4dcf9c56f15c67b93faca157b4d6c9783905c
Aug 02 11:33:50.707778 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.707741    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:33:50.707862 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.707827    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:33:50.707905 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.707872    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:33:50.847561 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:50.847468    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ccb99aa-586e-4b83-b874-3e4b4ccb253d" path="/var/lib/kubelet/pods/8ccb99aa-586e-4b83-b874-3e4b4ccb253d/volumes"
Aug 02 11:33:51.311726 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:51.311690    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" event={"ID":"b80d7f2d-01e6-4e59-aebf-d8a308c0031e","Type":"ContainerStarted","Data":"0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81"}
Aug 02 11:33:51.311961 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:51.311749    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" event={"ID":"b80d7f2d-01e6-4e59-aebf-d8a308c0031e","Type":"ContainerStarted","Data":"af0f91fd85a3756bf7efe9906fd4dcf9c56f15c67b93faca157b4d6c9783905c"}
Aug 02 11:33:51.329816 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:51.329768    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podStartSLOduration=1.329751865 podStartE2EDuration="1.329751865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:33:51.327764579 +0000 UTC m=+3626.985982190" watchObservedRunningTime="2026-08-02 11:33:51.329751865 +0000 UTC m=+3626.987969454"
Aug 02 11:33:51.566613 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:51.566531    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:51.571919 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:51.571890    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:52.316478 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:52.316449    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:52.317593 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:52.317569    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:33:53.208109 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:53.208077    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:53.306130 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:53.306089    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:54.316927 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:54.316893    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:54.515998 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:54.515955    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:54.798139 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:54.798106    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:33:54.899718 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:33:54.899684    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:07.318158 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.318116    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 02 11:34:07.318632 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.318185    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 02 11:34:07.395583 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.395550    2563 generic.go:356] "Generic (PLEG): container finished" podID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerID="0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81" exitCode=0
Aug 02 11:34:07.395751 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.395614    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" event={"ID":"b80d7f2d-01e6-4e59-aebf-d8a308c0031e","Type":"ContainerDied","Data":"0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81"}
Aug 02 11:34:07.395996 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.395983    2563 scope.go:117] "RemoveContainer" containerID="0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81"
Aug 02 11:34:07.397080 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.397051    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:34:07.397147 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.397120    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:34:07.397192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:07.397173    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:34:08.402246 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:08.402207    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" event={"ID":"b80d7f2d-01e6-4e59-aebf-d8a308c0031e","Type":"ContainerStarted","Data":"64075ccc7bbcca42aba2da08a149e8df997917b24a296d37a55ff2a9fe406d4b"}
Aug 02 11:34:08.565868 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:08.565828    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:34:08.566095 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:08.566071    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 02 11:34:08.566148 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:08.566120    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 02 11:34:09.566484 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:09.566445    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 02 11:34:09.567003 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:09.566530    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 02 11:34:10.566657 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:10.566619    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 02 11:34:10.567109 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:10.566696    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 02 11:34:11.566326 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:11.566291    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 02 11:34:11.566513 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:11.566359    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 02 11:34:12.566761 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:12.566718    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Aug 02 11:34:12.567312 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:12.566783    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Aug 02 11:34:13.571410 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:13.571372    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:34:13.571904 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:13.571739    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:34:13.572648 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:13.572629    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:34:18.178911 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:18.178869    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:18.823985 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:18.823957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:19.118383 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:19.118252    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:19.432064 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:19.432033    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:22.532439 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:22.532402    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:22.632251 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:22.632217    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:23.644989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:23.644942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:24.112296 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:24.112189    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:24.208990 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:24.208949    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:24.612849 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:24.612799    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:34:47.498661 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:34:47.498576    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:02.551918 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.551883    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"]
Aug 02 11:35:02.559439 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.559415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.561931 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.561849    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fe62c7\"/\"openshift-service-ca.crt\""
Aug 02 11:35:02.561931 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.561856    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fe62c7\"/\"default-dockercfg-2jtnw\""
Aug 02 11:35:02.564670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.562453    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-fe62c7\"/\"ipp-route-fe62c7-kserve-self-signed-certs\""
Aug 02 11:35:02.564670 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.563153    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"]
Aug 02 11:35:02.570192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.570154    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-fe62c7\"/\"kube-root-ca.crt\""
Aug 02 11:35:02.581515 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.581478    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:02.624850 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.624820    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-tmp-dir\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.625027 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.624856    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-dshm\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.625027 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.624873    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b2e8b9-c5b5-4619-a077-6e96139d434c-tls-certs\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.625027 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.624914    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9qvq\" (UniqueName: \"kubernetes.io/projected/36b2e8b9-c5b5-4619-a077-6e96139d434c-kube-api-access-h9qvq\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.625027 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.624983    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-model-cache\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.625198 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.625058    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-home\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.726537 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726502    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-home\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.726741 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726551    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-tmp-dir\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.726741 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726579    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-dshm\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.726741 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726601    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b2e8b9-c5b5-4619-a077-6e96139d434c-tls-certs\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.726741 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726654    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9qvq\" (UniqueName: \"kubernetes.io/projected/36b2e8b9-c5b5-4619-a077-6e96139d434c-kube-api-access-h9qvq\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.726741 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726686    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-model-cache\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.727018 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.726947    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-tmp-dir\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.727064 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.727045    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-home\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.727100 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.727085    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-model-cache\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.729095 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.729078    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-dshm\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.729188 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.729170    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b2e8b9-c5b5-4619-a077-6e96139d434c-tls-certs\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.735450 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.735426    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9qvq\" (UniqueName: \"kubernetes.io/projected/36b2e8b9-c5b5-4619-a077-6e96139d434c-kube-api-access-h9qvq\") pod \"ipp-route-fe62c7-kserve-759c7c875-hwd8q\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") " pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:02.873928 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:02.873851    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:03.009118 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:03.008937    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"]
Aug 02 11:35:03.011102 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:35:03.011061    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36b2e8b9_c5b5_4619_a077_6e96139d434c.slice/crio-5632f0b461b51bee0839adcbf4fb2f24a8676609e63dc95396d956dee7fc6a1c WatchSource:0}: Error finding container 5632f0b461b51bee0839adcbf4fb2f24a8676609e63dc95396d956dee7fc6a1c: Status 404 returned error can't find the container with id 5632f0b461b51bee0839adcbf4fb2f24a8676609e63dc95396d956dee7fc6a1c
Aug 02 11:35:03.654673 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:03.654641    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q" event={"ID":"36b2e8b9-c5b5-4619-a077-6e96139d434c","Type":"ContainerStarted","Data":"8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857"}
Aug 02 11:35:03.654673 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:03.654679    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q" event={"ID":"36b2e8b9-c5b5-4619-a077-6e96139d434c","Type":"ContainerStarted","Data":"5632f0b461b51bee0839adcbf4fb2f24a8676609e63dc95396d956dee7fc6a1c"}
Aug 02 11:35:03.670414 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:03.670367    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q" podStartSLOduration=1.670351857 podStartE2EDuration="1.670351857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:35:03.668762799 +0000 UTC m=+3699.326980389" watchObservedRunningTime="2026-08-02 11:35:03.670351857 +0000 UTC m=+3699.328569446"
Aug 02 11:35:12.874526 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:12.874479    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:12.874526 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:12.874537    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:12.887107 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:12.887079    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:13.720464 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:13.720432    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:35:39.516777 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.516741    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:39.794665 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.794590    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"]
Aug 02 11:35:39.797942 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.797926    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.799713 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.799694    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-52c040-openshift-default-dockercfg-7sv7x\""
Aug 02 11:35:39.807811 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.807774    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"]
Aug 02 11:35:39.845103 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.845073    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:39.861356 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861322    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-envoy\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861356 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861354    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-istio-token\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861502 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861401    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-credential-socket\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861502 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861438    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698de86b-4c88-4f57-b443-405399d4739d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861574 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861545    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-socket\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861609 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861580    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-data\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861644 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861603    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698de86b-4c88-4f57-b443-405399d4739d-istio-podinfo\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861644 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861629    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk2hx\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-kube-api-access-sk2hx\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.861711 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.861648    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-certs\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.962993 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.962956    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-data\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.962993 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.962996    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698de86b-4c88-4f57-b443-405399d4739d-istio-podinfo\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963255 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963014    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk2hx\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-kube-api-access-sk2hx\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963255 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963032    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-certs\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963255 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963159    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-envoy\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963255 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963201    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-istio-token\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963255 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963239    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-credential-socket\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963303    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698de86b-4c88-4f57-b443-405399d4739d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963417    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-certs\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963449    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-socket\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963578 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963470    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-data\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963758 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963733    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-credential-socket\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.963819 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963801    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-socket\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.964017 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.963999    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698de86b-4c88-4f57-b443-405399d4739d-istiod-ca-cert\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.966029 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.966013    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-envoy\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.966375 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.966357    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698de86b-4c88-4f57-b443-405399d4739d-istio-podinfo\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.977765 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.977732    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk2hx\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-kube-api-access-sk2hx\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:39.978371 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:39.978348    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-istio-token\") pod \"e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") " pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:40.108496 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.108415    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:40.136403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.136371    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:40.249935 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.249911    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"]
Aug 02 11:35:40.251939 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:35:40.251916    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698de86b_4c88_4f57_b443_405399d4739d.slice/crio-e11d3c47504a6e252e92f1d9ac3937b080daa0fb27e96dbfc2f60e62f141de0d WatchSource:0}: Error finding container e11d3c47504a6e252e92f1d9ac3937b080daa0fb27e96dbfc2f60e62f141de0d: Status 404 returned error can't find the container with id e11d3c47504a6e252e92f1d9ac3937b080daa0fb27e96dbfc2f60e62f141de0d
Aug 02 11:35:40.254113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.254084    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:35:40.254196 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.254140    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:35:40.254196 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.254166    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:35:40.829968 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.829934    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" event={"ID":"698de86b-4c88-4f57-b443-405399d4739d","Type":"ContainerStarted","Data":"bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"}
Aug 02 11:35:40.830490 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.829988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" event={"ID":"698de86b-4c88-4f57-b443-405399d4739d","Type":"ContainerStarted","Data":"e11d3c47504a6e252e92f1d9ac3937b080daa0fb27e96dbfc2f60e62f141de0d"}
Aug 02 11:35:40.845965 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:40.845920    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podStartSLOduration=1.845903029 podStartE2EDuration="1.845903029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:35:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:35:40.845535013 +0000 UTC m=+3736.503752623" watchObservedRunningTime="2026-08-02 11:35:40.845903029 +0000 UTC m=+3736.504120620"
Aug 02 11:35:41.109254 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:41.109168    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:41.114691 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:41.114667    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:41.835213 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:41.835184    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:41.836281 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:41.836246    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:35:42.720142 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:42.720101    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:42.818701 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:42.818663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:43.815706 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:43.815672    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:44.119652 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:44.119560    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:44.397056 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:44.397013    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:44.497084 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:44.497051    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:35:57.877430 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:57.877391    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Aug 02 11:35:57.877828 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:57.877476    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Aug 02 11:35:59.923869 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:59.923834    2563 generic.go:356] "Generic (PLEG): container finished" podID="698de86b-4c88-4f57-b443-405399d4739d" containerID="bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f" exitCode=0
Aug 02 11:35:59.924421 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:59.923909    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" event={"ID":"698de86b-4c88-4f57-b443-405399d4739d","Type":"ContainerDied","Data":"bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"}
Aug 02 11:35:59.924497 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:59.924432    2563 scope.go:117] "RemoveContainer" containerID="bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"
Aug 02 11:35:59.925560 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:59.925533    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:35:59.925678 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:59.925612    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:35:59.925743 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:35:59.925681    2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"}
Aug 02 11:36:00.933321 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:00.933252    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" event={"ID":"698de86b-4c88-4f57-b443-405399d4739d","Type":"ContainerStarted","Data":"878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc"}
Aug 02 11:36:01.108854 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:01.108815    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:36:01.109151 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:01.109121    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 02 11:36:01.109306 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:01.109182    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 02 11:36:02.109704 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:02.109669    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 02 11:36:02.110128 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:02.109731    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 02 11:36:03.109076 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:03.109040    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 02 11:36:03.109286 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:03.109094    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 02 11:36:04.109709 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:04.109670    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 02 11:36:04.110113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:04.109741    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 02 11:36:05.109793 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:05.109758    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 02 11:36:05.110218 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:05.109814    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 02 11:36:06.109705 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:06.109662    2563 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Aug 02 11:36:06.109893 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:06.109726    2563 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Aug 02 11:36:07.112697 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:07.112659    2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:36:07.113184 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:07.113028    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:36:07.113628 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:07.113607    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:36:07.696298 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:07.696235    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:08.762171 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:08.762127    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:08.827650 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:08.827612    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:08.890413 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:08.890380    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:08.990403 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:08.990372    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:09.239059 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:09.239023    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:15.222200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:15.222164    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:15.278662 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:15.278626    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:15.459238 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:15.459204    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"]
Aug 02 11:36:15.459552 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:15.459509    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy" containerID="cri-o://878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc" gracePeriod=30
Aug 02 11:36:15.480372 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:15.480253    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:15.700990 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:15.700951    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:20.712905 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.712883    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:36:20.750821 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.750745    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-socket\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.750954 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.750825    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-envoy\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.750954 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.750856    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-istio-token\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.750954 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.750882    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-credential-socket\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.750954 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.750935    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698de86b-4c88-4f57-b443-405399d4739d-istio-podinfo\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.751102 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.750967    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-data\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.751102 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751007    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-certs\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.751102 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751021    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:20.751102 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751087    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698de86b-4c88-4f57-b443-405399d4739d-istiod-ca-cert\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.751318 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751208    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sk2hx\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-kube-api-access-sk2hx\") pod \"698de86b-4c88-4f57-b443-405399d4739d\" (UID: \"698de86b-4c88-4f57-b443-405399d4739d\") "
Aug 02 11:36:20.751318 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751254    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:20.751318 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751298    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:20.751493 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751410    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-data" (OuterVolumeSpecName: "istio-data") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:20.751602 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751575    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/698de86b-4c88-4f57-b443-405399d4739d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:36:20.751672 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751581    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.751672 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751627    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.751672 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751644    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.751672 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.751659    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.753208 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.753176    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-istio-token" (OuterVolumeSpecName: "istio-token") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:36:20.753481 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.753454    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:20.753604 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.753487    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/698de86b-4c88-4f57-b443-405399d4739d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:36:20.753897 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.753878    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-kube-api-access-sk2hx" (OuterVolumeSpecName: "kube-api-access-sk2hx") pod "698de86b-4c88-4f57-b443-405399d4739d" (UID: "698de86b-4c88-4f57-b443-405399d4739d"). InnerVolumeSpecName "kube-api-access-sk2hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:36:20.852200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.852169    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/698de86b-4c88-4f57-b443-405399d4739d-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.852200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.852200    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/698de86b-4c88-4f57-b443-405399d4739d-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.852200 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.852215    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sk2hx\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-kube-api-access-sk2hx\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.852490 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.852231    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/698de86b-4c88-4f57-b443-405399d4739d-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:20.852490 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:20.852245    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/698de86b-4c88-4f57-b443-405399d4739d-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:21.033987 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.033902    2563 generic.go:356] "Generic (PLEG): container finished" podID="698de86b-4c88-4f57-b443-405399d4739d" containerID="878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc" exitCode=0
Aug 02 11:36:21.033987 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.033957    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"
Aug 02 11:36:21.034182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.033988    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" event={"ID":"698de86b-4c88-4f57-b443-405399d4739d","Type":"ContainerDied","Data":"878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc"}
Aug 02 11:36:21.034182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.034044    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb" event={"ID":"698de86b-4c88-4f57-b443-405399d4739d","Type":"ContainerDied","Data":"e11d3c47504a6e252e92f1d9ac3937b080daa0fb27e96dbfc2f60e62f141de0d"}
Aug 02 11:36:21.034182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.034061    2563 scope.go:117] "RemoveContainer" containerID="878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc"
Aug 02 11:36:21.047424 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.047403    2563 scope.go:117] "RemoveContainer" containerID="bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"
Aug 02 11:36:21.050659 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.050640    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"]
Aug 02 11:36:21.053905 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.053879    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-52c040-openshift-default-6d78944876-6ckpb"]
Aug 02 11:36:21.058602 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.058584    2563 scope.go:117] "RemoveContainer" containerID="878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc"
Aug 02 11:36:21.058964 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:36:21.058941    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc\": container with ID starting with 878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc not found: ID does not exist" containerID="878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc"
Aug 02 11:36:21.059096 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.059066    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc"} err="failed to get container status \"878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc\": rpc error: code = NotFound desc = could not find container \"878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc\": container with ID starting with 878928089a7740fb422b5aa17631fec917906c7b87ac08dbf05423ac3f40c7fc not found: ID does not exist"
Aug 02 11:36:21.059096 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.059097    2563 scope.go:117] "RemoveContainer" containerID="bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"
Aug 02 11:36:21.059670 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:36:21.059651    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f\": container with ID starting with bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f not found: ID does not exist" containerID="bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"
Aug 02 11:36:21.059742 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:21.059680    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f"} err="failed to get container status \"bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f\": rpc error: code = NotFound desc = could not find container \"bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f\": container with ID starting with bc08fc6949f17f0bb7d9c663ed11ba0895dc273e74aeda20fc850aa3fa995e4f not found: ID does not exist"
Aug 02 11:36:22.846619 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:22.846582    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="698de86b-4c88-4f57-b443-405399d4739d" path="/var/lib/kubelet/pods/698de86b-4c88-4f57-b443-405399d4739d/volumes"
Aug 02 11:36:24.137359 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:24.137316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:24.202608 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:24.202559    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:24.265081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:24.265043    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:24.366007 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:24.365971    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:24.629561 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:24.629447    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:29.617980 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:29.617941    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"]
Aug 02 11:36:29.713761 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:29.713724    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:36:44.638717 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.638678    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q" podUID="36b2e8b9-c5b5-4619-a077-6e96139d434c" containerName="main" containerID="cri-o://8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857" gracePeriod=45
Aug 02 11:36:44.877025 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.876998    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:36:44.969113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969015    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9qvq\" (UniqueName: \"kubernetes.io/projected/36b2e8b9-c5b5-4619-a077-6e96139d434c-kube-api-access-h9qvq\") pod \"36b2e8b9-c5b5-4619-a077-6e96139d434c\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") "
Aug 02 11:36:44.969113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969067    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-tmp-dir\") pod \"36b2e8b9-c5b5-4619-a077-6e96139d434c\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") "
Aug 02 11:36:44.969113 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969103    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b2e8b9-c5b5-4619-a077-6e96139d434c-tls-certs\") pod \"36b2e8b9-c5b5-4619-a077-6e96139d434c\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") "
Aug 02 11:36:44.969445 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969145    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-model-cache\") pod \"36b2e8b9-c5b5-4619-a077-6e96139d434c\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") "
Aug 02 11:36:44.969445 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969176    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-home\") pod \"36b2e8b9-c5b5-4619-a077-6e96139d434c\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") "
Aug 02 11:36:44.969445 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969314    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-dshm\") pod \"36b2e8b9-c5b5-4619-a077-6e96139d434c\" (UID: \"36b2e8b9-c5b5-4619-a077-6e96139d434c\") "
Aug 02 11:36:44.969445 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969401    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36b2e8b9-c5b5-4619-a077-6e96139d434c" (UID: "36b2e8b9-c5b5-4619-a077-6e96139d434c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:44.969660 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969572    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-home" (OuterVolumeSpecName: "home") pod "36b2e8b9-c5b5-4619-a077-6e96139d434c" (UID: "36b2e8b9-c5b5-4619-a077-6e96139d434c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:44.969717 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969693    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-model-cache" (OuterVolumeSpecName: "model-cache") pod "36b2e8b9-c5b5-4619-a077-6e96139d434c" (UID: "36b2e8b9-c5b5-4619-a077-6e96139d434c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:44.969766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969724    2563 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-tmp-dir\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:44.969766 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.969740    2563 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-home\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:44.971540 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.971509    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36b2e8b9-c5b5-4619-a077-6e96139d434c-kube-api-access-h9qvq" (OuterVolumeSpecName: "kube-api-access-h9qvq") pod "36b2e8b9-c5b5-4619-a077-6e96139d434c" (UID: "36b2e8b9-c5b5-4619-a077-6e96139d434c"). InnerVolumeSpecName "kube-api-access-h9qvq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:36:44.971937 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.971921    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36b2e8b9-c5b5-4619-a077-6e96139d434c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36b2e8b9-c5b5-4619-a077-6e96139d434c" (UID: "36b2e8b9-c5b5-4619-a077-6e96139d434c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 02 11:36:44.971993 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:44.971950    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-dshm" (OuterVolumeSpecName: "dshm") pod "36b2e8b9-c5b5-4619-a077-6e96139d434c" (UID: "36b2e8b9-c5b5-4619-a077-6e96139d434c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:36:45.070989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.070950    2563 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-dshm\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:45.070989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.070982    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9qvq\" (UniqueName: \"kubernetes.io/projected/36b2e8b9-c5b5-4619-a077-6e96139d434c-kube-api-access-h9qvq\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:45.070989 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.070997    2563 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36b2e8b9-c5b5-4619-a077-6e96139d434c-tls-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:45.071242 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.071011    2563 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36b2e8b9-c5b5-4619-a077-6e96139d434c-model-cache\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:36:45.152320 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.152253    2563 generic.go:356] "Generic (PLEG): container finished" podID="36b2e8b9-c5b5-4619-a077-6e96139d434c" containerID="8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857" exitCode=0
Aug 02 11:36:45.152320 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.152310    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"
Aug 02 11:36:45.152564 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.152331    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q" event={"ID":"36b2e8b9-c5b5-4619-a077-6e96139d434c","Type":"ContainerDied","Data":"8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857"}
Aug 02 11:36:45.152564 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.152370    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q" event={"ID":"36b2e8b9-c5b5-4619-a077-6e96139d434c","Type":"ContainerDied","Data":"5632f0b461b51bee0839adcbf4fb2f24a8676609e63dc95396d956dee7fc6a1c"}
Aug 02 11:36:45.152564 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.152389    2563 scope.go:117] "RemoveContainer" containerID="8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857"
Aug 02 11:36:45.162081 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.162055    2563 scope.go:117] "RemoveContainer" containerID="8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857"
Aug 02 11:36:45.162423 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:36:45.162391    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857\": container with ID starting with 8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857 not found: ID does not exist" containerID="8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857"
Aug 02 11:36:45.162505 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.162433    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857"} err="failed to get container status \"8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857\": rpc error: code = NotFound desc = could not find container \"8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857\": container with ID starting with 8bea96d13f82e705336b08555de120e474941064583813393afb0f5175148857 not found: ID does not exist"
Aug 02 11:36:45.171477 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.171441    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"]
Aug 02 11:36:45.173600 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:45.173579    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-fe62c7/ipp-route-fe62c7-kserve-759c7c875-hwd8q"]
Aug 02 11:36:46.847055 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:36:46.847023    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36b2e8b9-c5b5-4619-a077-6e96139d434c" path="/var/lib/kubelet/pods/36b2e8b9-c5b5-4619-a077-6e96139d434c/volumes"
Aug 02 11:37:06.677070 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:06.677034    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:06.949552 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:06.949449    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:12.819690 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:12.819641    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:12.920714 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:12.920663    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:13.070704 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:13.070618    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"]
Aug 02 11:37:13.070936 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:13.070889    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" containerID="cri-o://64075ccc7bbcca42aba2da08a149e8df997917b24a296d37a55ff2a9fe406d4b" gracePeriod=30
Aug 02 11:37:13.092973 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:13.092942    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:13.324382 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:13.324248    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:13.574110 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:13.574075    2563 patch_prober.go:28] interesting pod/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 02 11:37:13.574304 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:13.574147    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 02 11:37:14.144720 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:14.144680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:14.214524 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:14.214491    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:14.313182 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:14.313144    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:14.365599 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:14.365553    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:14.670062 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:14.670021    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:18.305488 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.305459    2563 generic.go:356] "Generic (PLEG): container finished" podID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerID="64075ccc7bbcca42aba2da08a149e8df997917b24a296d37a55ff2a9fe406d4b" exitCode=0
Aug 02 11:37:18.305935 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.305512    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" event={"ID":"b80d7f2d-01e6-4e59-aebf-d8a308c0031e","Type":"ContainerDied","Data":"64075ccc7bbcca42aba2da08a149e8df997917b24a296d37a55ff2a9fe406d4b"}
Aug 02 11:37:18.305935 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.305566    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657" event={"ID":"b80d7f2d-01e6-4e59-aebf-d8a308c0031e","Type":"ContainerDied","Data":"af0f91fd85a3756bf7efe9906fd4dcf9c56f15c67b93faca157b4d6c9783905c"}
Aug 02 11:37:18.305935 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.305588    2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af0f91fd85a3756bf7efe9906fd4dcf9c56f15c67b93faca157b4d6c9783905c"
Aug 02 11:37:18.305935 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.305601    2563 scope.go:117] "RemoveContainer" containerID="0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81"
Aug 02 11:37:18.317085 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:37:18.317062    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81\": container with ID starting with 0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81 not found: ID does not exist" containerID="0b6fa2a8140ad14fed395adb0d7e8236f87014ff968aa491929b4631bacb9b81"
Aug 02 11:37:18.320555 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.320537    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:37:18.370927 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.370849    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-token\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.370927 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.370886    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-certs\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.370927 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.370909    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-socket\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.370941    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-envoy\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.370959    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istiod-ca-cert\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371000    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-data\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371029    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-podinfo\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371095    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gfrv\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-kube-api-access-2gfrv\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371139    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-credential-socket\") pod \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\" (UID: \"b80d7f2d-01e6-4e59-aebf-d8a308c0031e\") "
Aug 02 11:37:18.371215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371141    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371322    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-data" (OuterVolumeSpecName: "istio-data") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371338    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371521    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371555    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371576    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371590    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.371630 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.371607    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:37:18.373310 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.373285    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-kube-api-access-2gfrv" (OuterVolumeSpecName: "kube-api-access-2gfrv") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "kube-api-access-2gfrv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:37:18.373421 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.373323    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:18.373604 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.373585    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:37:18.373604 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.373595    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-token" (OuterVolumeSpecName: "istio-token") pod "b80d7f2d-01e6-4e59-aebf-d8a308c0031e" (UID: "b80d7f2d-01e6-4e59-aebf-d8a308c0031e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:37:18.472130 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.472096    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.472130 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.472126    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gfrv\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-kube-api-access-2gfrv\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.472130 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.472136    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.472408 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.472146    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.472408 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.472154    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:18.472408 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:18.472164    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b80d7f2d-01e6-4e59-aebf-d8a308c0031e-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:19.311559 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:19.311521    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"
Aug 02 11:37:19.327898 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:19.327852    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"]
Aug 02 11:37:19.330031 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:19.330005    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-fe62c7-openshift-default-5b6b9fc688-42657"]
Aug 02 11:37:20.598246 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:20.598208    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:20.662191 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:20.662157    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:20.850538 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:20.848243    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" path="/var/lib/kubelet/pods/b80d7f2d-01e6-4e59-aebf-d8a308c0031e/volumes"
Aug 02 11:37:20.854401 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:20.854316    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:21.067777 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:21.067738    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:21.777296 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:21.777242    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:21.850695 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:21.850653    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:21.912518 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:21.912486    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:22.012987 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:22.012957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:22.302629 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:22.302596    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:28.408476 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:28.408431    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:28.508819 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:28.508784    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:28.672444 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:28.672352    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:28.890683 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:28.890649    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:29.709430 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:29.709393    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:29.736458 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:29.736427    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"]
Aug 02 11:37:29.736709 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:29.736679    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q" podUID="d6dfc758-deea-4058-a0c9-291d48b55de2" containerName="payload-processing" containerID="cri-o://e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087" gracePeriod=30
Aug 02 11:37:29.809587 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:29.809542    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:29.910764 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:29.910718    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:29.987796 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:29.987764    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:37:30.084372 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.084336    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6dfc758-deea-4058-a0c9-291d48b55de2-plugins-config-volume\") pod \"d6dfc758-deea-4058-a0c9-291d48b55de2\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") "
Aug 02 11:37:30.084554 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.084442    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rb4wq\" (UniqueName: \"kubernetes.io/projected/d6dfc758-deea-4058-a0c9-291d48b55de2-kube-api-access-rb4wq\") pod \"d6dfc758-deea-4058-a0c9-291d48b55de2\" (UID: \"d6dfc758-deea-4058-a0c9-291d48b55de2\") "
Aug 02 11:37:30.084817 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.084790    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6dfc758-deea-4058-a0c9-291d48b55de2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6dfc758-deea-4058-a0c9-291d48b55de2" (UID: "d6dfc758-deea-4058-a0c9-291d48b55de2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:37:30.086650 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.086631    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6dfc758-deea-4058-a0c9-291d48b55de2-kube-api-access-rb4wq" (OuterVolumeSpecName: "kube-api-access-rb4wq") pod "d6dfc758-deea-4058-a0c9-291d48b55de2" (UID: "d6dfc758-deea-4058-a0c9-291d48b55de2"). InnerVolumeSpecName "kube-api-access-rb4wq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:37:30.185411 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.185374    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rb4wq\" (UniqueName: \"kubernetes.io/projected/d6dfc758-deea-4058-a0c9-291d48b55de2-kube-api-access-rb4wq\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:30.185411 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.185403    2563 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6dfc758-deea-4058-a0c9-291d48b55de2-plugins-config-volume\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:30.205799 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.205753    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:30.364560 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.364476    2563 generic.go:356] "Generic (PLEG): container finished" podID="d6dfc758-deea-4058-a0c9-291d48b55de2" containerID="e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087" exitCode=0
Aug 02 11:37:30.364560 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.364524    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"
Aug 02 11:37:30.364747 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.364564    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q" event={"ID":"d6dfc758-deea-4058-a0c9-291d48b55de2","Type":"ContainerDied","Data":"e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087"}
Aug 02 11:37:30.364747 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.364621    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q" event={"ID":"d6dfc758-deea-4058-a0c9-291d48b55de2","Type":"ContainerDied","Data":"65a4a6492812d5f94cafd73803f04e94f04aa24f6df305a8f3a9e3ec4070679a"}
Aug 02 11:37:30.364747 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.364649    2563 scope.go:117] "RemoveContainer" containerID="e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087"
Aug 02 11:37:30.373473 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.373454    2563 scope.go:117] "RemoveContainer" containerID="e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087"
Aug 02 11:37:30.373726 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:37:30.373705    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087\": container with ID starting with e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087 not found: ID does not exist" containerID="e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087"
Aug 02 11:37:30.373780 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.373745    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087"} err="failed to get container status \"e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087\": rpc error: code = NotFound desc = could not find container \"e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087\": container with ID starting with e752ef7332ce3a3aa39762039bc0a3f9b8d192bf4f20e2c85744cd378305f087 not found: ID does not exist"
Aug 02 11:37:30.383151 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.383131    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"]
Aug 02 11:37:30.385235 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.385216    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-4f1bb7-775b458b-kdc2q"]
Aug 02 11:37:30.846391 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:30.846358    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6dfc758-deea-4058-a0c9-291d48b55de2" path="/var/lib/kubelet/pods/d6dfc758-deea-4058-a0c9-291d48b55de2/volumes"
Aug 02 11:37:36.293155 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:36.293117    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:36.393998 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:36.393957    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:36.520616 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:36.520586    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"]
Aug 02 11:37:36.520860 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:36.520834    2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" containerID="cri-o://6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8" gracePeriod=30
Aug 02 11:37:36.541714 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:36.541680    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:36.761434 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:36.761394    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:37.190042 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:37.190011    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785557b4c-ghpmv_f618dac1-b38a-4039-95fe-445f8930fa86/authorino/0.log"
Aug 02 11:37:38.849615 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:38.849574    2563 patch_prober.go:28] interesting pod/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 02 11:37:38.849986 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:38.849644    2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 02 11:37:41.767038 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.767015    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:37:41.789685 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789595    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-credential-socket\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789685 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789661    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istiod-ca-cert\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789698    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-socket\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789738    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-token\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789762    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-data\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789799    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-certs\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789826    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-podinfo\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789855    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-envoy\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.789894 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789878    2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vgcs\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-kube-api-access-9vgcs\") pod \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\" (UID: \"706ed4d9-5964-48a1-8b73-7bf7f65bb158\") "
Aug 02 11:37:41.790299 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789936    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:41.790299 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.789995    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:41.790299 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790045    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 02 11:37:41.790299 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790143    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:41.790485 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790302    2563 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-credential-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.790485 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790324    2563 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istiod-ca-cert\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.790485 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790337    2563 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-socket\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.790485 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790350    2563 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-workload-certs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.790485 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.790354    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-data" (OuterVolumeSpecName: "istio-data") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:41.792506 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.792473    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-kube-api-access-9vgcs" (OuterVolumeSpecName: "kube-api-access-9vgcs") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "kube-api-access-9vgcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:37:41.792759 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.792727    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Aug 02 11:37:41.792849 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.792788    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 02 11:37:41.792967 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.792950    2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-token" (OuterVolumeSpecName: "istio-token") pod "706ed4d9-5964-48a1-8b73-7bf7f65bb158" (UID: "706ed4d9-5964-48a1-8b73-7bf7f65bb158"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 02 11:37:41.891311 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.891239    2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-token\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.891311 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.891303    2563 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-data\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.891311 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.891312    2563 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-podinfo\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.891311 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.891320    2563 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/706ed4d9-5964-48a1-8b73-7bf7f65bb158-istio-envoy\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:41.891601 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:41.891329    2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vgcs\" (UniqueName: \"kubernetes.io/projected/706ed4d9-5964-48a1-8b73-7bf7f65bb158-kube-api-access-9vgcs\") on node \"ip-10-0-130-84.ec2.internal\" DevicePath \"\""
Aug 02 11:37:42.419664 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.419630    2563 generic.go:356] "Generic (PLEG): container finished" podID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerID="6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8" exitCode=0
Aug 02 11:37:42.419870 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.419678    2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"
Aug 02 11:37:42.419870 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.419716    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" event={"ID":"706ed4d9-5964-48a1-8b73-7bf7f65bb158","Type":"ContainerDied","Data":"6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8"}
Aug 02 11:37:42.419870 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.419775    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h" event={"ID":"706ed4d9-5964-48a1-8b73-7bf7f65bb158","Type":"ContainerDied","Data":"7a693a857a4368cf450b74b6ad7c175a4833181cf6341a73fd29481ae8357263"}
Aug 02 11:37:42.419870 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.419804    2563 scope.go:117] "RemoveContainer" containerID="6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8"
Aug 02 11:37:42.429664 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.429644    2563 scope.go:117] "RemoveContainer" containerID="756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"
Aug 02 11:37:42.437546 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.437530    2563 scope.go:117] "RemoveContainer" containerID="6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8"
Aug 02 11:37:42.437801 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:37:42.437783    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8\": container with ID starting with 6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8 not found: ID does not exist" containerID="6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8"
Aug 02 11:37:42.437843 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.437812    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8"} err="failed to get container status \"6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8\": rpc error: code = NotFound desc = could not find container \"6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8\": container with ID starting with 6f7caa9048c25b23e9964fe028ff04f9ea9065b13a826045904e01897e5ecbc8 not found: ID does not exist"
Aug 02 11:37:42.437843 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.437830    2563 scope.go:117] "RemoveContainer" containerID="756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"
Aug 02 11:37:42.438120 ip-10-0-130-84 kubenswrapper[2563]: E0802 11:37:42.438068    2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0\": container with ID starting with 756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0 not found: ID does not exist" containerID="756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"
Aug 02 11:37:42.438120 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.438100    2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0"} err="failed to get container status \"756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0\": rpc error: code = NotFound desc = could not find container \"756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0\": container with ID starting with 756ca5a6add704ee3dcba56c2d60923977832f7ebb0e2ff3be2bcf43c2a213f0 not found: ID does not exist"
Aug 02 11:37:42.440442 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.440420    2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"]
Aug 02 11:37:42.443522 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.443500    2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-4f1bb7-openshift-default-757f74c6fb-t527h"]
Aug 02 11:37:42.710689 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.710593    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:42.818148 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.818120    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-kwdsv_ae18dfe4-042c-4cae-8c6d-eda5ef65095f/copy-manifests/0.log"
Aug 02 11:37:42.824442 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.824421    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-kwdsv_ae18dfe4-042c-4cae-8c6d-eda5ef65095f/manager/0.log"
Aug 02 11:37:42.846232 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:42.846206    2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" path="/var/lib/kubelet/pods/706ed4d9-5964-48a1-8b73-7bf7f65bb158/volumes"
Aug 02 11:37:44.244275 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:44.244237    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785557b4c-ghpmv_f618dac1-b38a-4039-95fe-445f8930fa86/authorino/0.log"
Aug 02 11:37:45.223327 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:45.223299    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt_1358d3dd-cb4f-485a-bf07-2df43fbfe196/istio-proxy/0.log"
Aug 02 11:37:45.550819 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:45.550738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47d49594-xc85k_af8c5597-9f42-4d33-a525-3fc396315309/kube-auth-proxy/0.log"
Aug 02 11:37:46.654315 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:46.654285    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f59sjb_2897a6ee-75ce-4168-9a81-4ccc78ab828c/main/0.log"
Aug 02 11:37:46.872249 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:46.872220    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-tkqwq_a536afe9-d9be-4d30-a89b-343da544a931/main/0.log"
Aug 02 11:37:51.960913 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.960881    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9p2g8/must-gather-lvhrb"]
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961171    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961182    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961195    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6dfc758-deea-4058-a0c9-291d48b55de2" containerName="payload-processing"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961201    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6dfc758-deea-4058-a0c9-291d48b55de2" containerName="payload-processing"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961210    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961216    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961225    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961230    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961238    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961243    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961252    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961274    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961281    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36b2e8b9-c5b5-4619-a077-6e96139d434c" containerName="main"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961286    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="36b2e8b9-c5b5-4619-a077-6e96139d434c" containerName="main"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961334    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6dfc758-deea-4058-a0c9-291d48b55de2" containerName="payload-processing"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961343    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961353    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy"
Aug 02 11:37:51.961350 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961359    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="36b2e8b9-c5b5-4619-a077-6e96139d434c" containerName="main"
Aug 02 11:37:51.961895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961365    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="698de86b-4c88-4f57-b443-405399d4739d" containerName="istio-proxy"
Aug 02 11:37:51.961895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961370    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy"
Aug 02 11:37:51.961895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961377    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy"
Aug 02 11:37:51.961895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961422    2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy"
Aug 02 11:37:51.961895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961428    2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="706ed4d9-5964-48a1-8b73-7bf7f65bb158" containerName="istio-proxy"
Aug 02 11:37:51.961895 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.961481    2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b80d7f2d-01e6-4e59-aebf-d8a308c0031e" containerName="istio-proxy"
Aug 02 11:37:51.967109 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.966570    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:51.969333 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.969307    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9p2g8\"/\"kube-root-ca.crt\""
Aug 02 11:37:51.969636 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.969615    2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9p2g8\"/\"openshift-service-ca.crt\""
Aug 02 11:37:51.969770 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.969618    2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9p2g8\"/\"default-dockercfg-jktht\""
Aug 02 11:37:51.973731 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.973706    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p2g8/must-gather-lvhrb"]
Aug 02 11:37:51.980088 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:51.980064    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:52.040600 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.040568    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:37:52.074020 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.073990    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7-must-gather-output\") pod \"must-gather-lvhrb\" (UID: \"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7\") " pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.074020 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.074023    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw579\" (UniqueName: \"kubernetes.io/projected/c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7-kube-api-access-gw579\") pod \"must-gather-lvhrb\" (UID: \"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7\") " pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.175275 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.175233    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7-must-gather-output\") pod \"must-gather-lvhrb\" (UID: \"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7\") " pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.175462 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.175300    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw579\" (UniqueName: \"kubernetes.io/projected/c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7-kube-api-access-gw579\") pod \"must-gather-lvhrb\" (UID: \"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7\") " pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.175600 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.175580    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7-must-gather-output\") pod \"must-gather-lvhrb\" (UID: \"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7\") " pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.182224 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.182206    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw579\" (UniqueName: \"kubernetes.io/projected/c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7-kube-api-access-gw579\") pod \"must-gather-lvhrb\" (UID: \"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7\") " pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.277413 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.277326    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p2g8/must-gather-lvhrb"
Aug 02 11:37:52.427176 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.427034    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p2g8/must-gather-lvhrb"]
Aug 02 11:37:52.430120 ip-10-0-130-84 kubenswrapper[2563]: W0802 11:37:52.430090    2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc0caf6d7_aa7c_49b4_9ae9_3a7284aab9d7.slice/crio-36ea629652a6cbee860ecf8470ab6daf118cc874ee2da230d675985860047053 WatchSource:0}: Error finding container 36ea629652a6cbee860ecf8470ab6daf118cc874ee2da230d675985860047053: Status 404 returned error can't find the container with id 36ea629652a6cbee860ecf8470ab6daf118cc874ee2da230d675985860047053
Aug 02 11:37:52.465233 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:52.465205    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/must-gather-lvhrb" event={"ID":"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7","Type":"ContainerStarted","Data":"36ea629652a6cbee860ecf8470ab6daf118cc874ee2da230d675985860047053"}
Aug 02 11:37:53.475103 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:53.474245    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/must-gather-lvhrb" event={"ID":"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7","Type":"ContainerStarted","Data":"97831adbaeb01612d7abc893ca58d65b9ecd86c82bed8c63aac6e777bab8c81a"}
Aug 02 11:37:53.475103 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:53.474328    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/must-gather-lvhrb" event={"ID":"c0caf6d7-aa7c-49b4-9ae9-3a7284aab9d7","Type":"ContainerStarted","Data":"ae6b0c2bda194c0f34f80c9c0c9ed62741e6134cbd2951ad8884bce7115518dc"}
Aug 02 11:37:53.490798 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:53.490739    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9p2g8/must-gather-lvhrb" podStartSLOduration=1.8077210830000001 podStartE2EDuration="2.490715115s" totalImagesPullingTime="682.994032ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-02 11:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:37:53.488686535 +0000 UTC m=+3869.146904126" watchObservedRunningTime="2026-08-02 11:37:53.490715115 +0000 UTC m=+3869.148932707"
Aug 02 11:37:54.699441 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:54.699403    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rgvjh_284b4fad-3427-46a8-b7ad-fd052a5d4e8c/global-pull-secret-syncer/0.log"
Aug 02 11:37:54.799815 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:54.799782    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log"
Aug 02 11:37:54.892757 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:37:54.892727    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-84.ec2.internal_261365b1a79fe86655ad402ba8ac7bb7/haproxy/0.log"
Aug 02 11:38:00.226286 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:00.225205    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785557b4c-ghpmv_f618dac1-b38a-4039-95fe-445f8930fa86/authorino/0.log"
Aug 02 11:38:02.193965 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.193929    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6f55c4f58d-x7ncw_e55d319f-9bbb-4fc8-bc0c-f7e11e83eee6/cluster-monitoring-operator/0.log"
Aug 02 11:38:02.347354 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.347326    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-fkd7d_7b622317-147e-4a54-b41e-c2ff4160a1f6/monitoring-plugin/0.log"
Aug 02 11:38:02.560853 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.560770    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvlrf_a0b1641f-0342-49ab-8604-8ce01d6439cc/node-exporter/0.log"
Aug 02 11:38:02.583469 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.583444    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvlrf_a0b1641f-0342-49ab-8604-8ce01d6439cc/kube-rbac-proxy/0.log"
Aug 02 11:38:02.604001 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.603978    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pvlrf_a0b1641f-0342-49ab-8604-8ce01d6439cc/init-textfile/0.log"
Aug 02 11:38:02.943846 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.943811    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dc5fcff4f-s2vnm_36e8a1ce-225a-495f-8db9-646f3f24cd3e/telemeter-client/0.log"
Aug 02 11:38:02.966520 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.966491    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dc5fcff4f-s2vnm_36e8a1ce-225a-495f-8db9-646f3f24cd3e/reload/0.log"
Aug 02 11:38:02.989470 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:02.989443    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6dc5fcff4f-s2vnm_36e8a1ce-225a-495f-8db9-646f3f24cd3e/kube-rbac-proxy/0.log"
Aug 02 11:38:04.432136 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:04.432108    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-gj5n6_b72e01bd-c8e2-4f38-8ec6-8be071a9b88a/networking-console-plugin/0.log"
Aug 02 11:38:05.045653 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.045619    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/2.log"
Aug 02 11:38:05.055002 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.054967    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-hdkvd_94831f8f-b1d0-4340-a018-c9529199471f/console-operator/3.log"
Aug 02 11:38:05.167009 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.166976    2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"]
Aug 02 11:38:05.171540 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.171502    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.178184 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.178155    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"]
Aug 02 11:38:05.217189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.216782    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-podres\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.217189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.216903    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-proc\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.217189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.216957    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-sys\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.217189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.216993    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-lib-modules\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.217189 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.217016    2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz7wg\" (UniqueName: \"kubernetes.io/projected/c6d96900-f182-4ff0-8c85-eb829225e121-kube-api-access-gz7wg\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318081    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-proc\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318124    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-sys\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318165 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318145    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-lib-modules\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318213    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-sys\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318229    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-proc\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318288    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-lib-modules\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318304    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz7wg\" (UniqueName: \"kubernetes.io/projected/c6d96900-f182-4ff0-8c85-eb829225e121-kube-api-access-gz7wg\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318492 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318413    2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-podres\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.318696 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.318553    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/c6d96900-f182-4ff0-8c85-eb829225e121-podres\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.325721 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.325695    2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz7wg\" (UniqueName: \"kubernetes.io/projected/c6d96900-f182-4ff0-8c85-eb829225e121-kube-api-access-gz7wg\") pod \"perf-node-gather-daemonset-54dcv\" (UID: \"c6d96900-f182-4ff0-8c85-eb829225e121\") " pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.488531 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.488497    2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:05.681252 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.679862    2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"]
Aug 02 11:38:05.704057 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:05.704031    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-77c974ffcf-xm4gh_b83f20a3-4faa-47a6-a783-c94b00781f8d/download-server/0.log"
Aug 02 11:38:06.583961 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:06.583926    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv" event={"ID":"c6d96900-f182-4ff0-8c85-eb829225e121","Type":"ContainerStarted","Data":"c2c358498648257f8fbed3709cec7b33b320254412c896c0748c538d86afe3c3"}
Aug 02 11:38:06.584407 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:06.583989    2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv" event={"ID":"c6d96900-f182-4ff0-8c85-eb829225e121","Type":"ContainerStarted","Data":"21084a647f7737ef47fe548edd41ee49af55baa080609c7c368bc74a9dff8bd9"}
Aug 02 11:38:06.584407 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:06.584032    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:06.598609 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:06.598559    2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv" podStartSLOduration=1.598542609 podStartE2EDuration="1.598542609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-02 11:38:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-02 11:38:06.597506481 +0000 UTC m=+3882.255724071" watchObservedRunningTime="2026-08-02 11:38:06.598542609 +0000 UTC m=+3882.256760198"
Aug 02 11:38:07.536558 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:07.536531    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c5lkm_15f239f4-4548-4481-8d55-82fdaace39b0/dns/0.log"
Aug 02 11:38:07.576247 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:07.576220    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-c5lkm_15f239f4-4548-4481-8d55-82fdaace39b0/kube-rbac-proxy/0.log"
Aug 02 11:38:07.660003 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:07.659976    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jnpd5_8147fcc7-615f-4279-b5c4-102489a5f974/dns-node-resolver/0.log"
Aug 02 11:38:08.287755 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:08.287707    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-894d47cf4-429h2_b234bac1-1324-4977-9c8f-da1295ee4b70/registry/0.log"
Aug 02 11:38:08.320444 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:08.320404    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7p68s_17c36f37-e3e4-4221-892e-f365d1f2bc1d/node-ca/0.log"
Aug 02 11:38:08.454377 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:08.454339    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:38:08.554880 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:08.554751    2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-58tmx_f85284a4-96e0-4bc3-b1db-0f59837d3852/konnectivity-agent/0.log" limit=1024
Aug 02 11:38:09.291802 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:09.291759    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt_1358d3dd-cb4f-485a-bf07-2df43fbfe196/istio-proxy/0.log"
Aug 02 11:38:09.515678 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:09.515633    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47d49594-xc85k_af8c5597-9f42-4d33-a525-3fc396315309/kube-auth-proxy/0.log"
Aug 02 11:38:10.465690 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:10.465657    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-945wh_38cdf496-b973-4b1b-8921-109274790533/serve-healthcheck-canary/0.log"
Aug 02 11:38:11.007192 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:11.007166    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wtvz_fdca932d-8f2e-43d2-8120-67746b8b8adc/kube-rbac-proxy/0.log"
Aug 02 11:38:11.030416 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:11.030390    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wtvz_fdca932d-8f2e-43d2-8120-67746b8b8adc/exporter/0.log"
Aug 02 11:38:11.053788 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:11.053758    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2wtvz_fdca932d-8f2e-43d2-8120-67746b8b8adc/extractor/0.log"
Aug 02 11:38:12.601121 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:12.601096    2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9p2g8/perf-node-gather-daemonset-54dcv"
Aug 02 11:38:13.830302 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:13.830248    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-kwdsv_ae18dfe4-042c-4cae-8c6d-eda5ef65095f/manager/0.log"
Aug 02 11:38:13.850596 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:13.850574    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f6ffbd656-kwdsv_ae18dfe4-042c-4cae-8c6d-eda5ef65095f/copy-manifests/0.log"
Aug 02 11:38:15.450215 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:15.450163    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-669466dd64-lr9k9_a56cd232-9093-4c45-9259-c2a39d1ad3eb/manager/0.log"
Aug 02 11:38:16.257136 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:16.257074    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt_1358d3dd-cb4f-485a-bf07-2df43fbfe196/istio-proxy/0.log"
Aug 02 11:38:16.444760 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:16.444738    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47d49594-xc85k_af8c5597-9f42-4d33-a525-3fc396315309/kube-auth-proxy/0.log"
Aug 02 11:38:17.949830 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:17.949797    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-tqcrt_1358d3dd-cb4f-485a-bf07-2df43fbfe196/istio-proxy/0.log"
Aug 02 11:38:18.152457 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:18.152416    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c47d49594-xc85k_af8c5597-9f42-4d33-a525-3fc396315309/kube-auth-proxy/0.log"
Aug 02 11:38:20.464958 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:20.464928    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-w8mnq_f92f8f8b-c652-447c-97ca-968422d0fb4a/migrator/0.log"
Aug 02 11:38:20.484562 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:20.484535    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-68bc745d87-w8mnq_f92f8f8b-c652-447c-97ca-968422d0fb4a/graceful-termination/0.log"
Aug 02 11:38:20.850114 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:20.850004    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-n6rmv_55c02df8-b088-4351-ba1f-f1b9650de225/kube-storage-version-migrator-operator/1.log"
Aug 02 11:38:20.851855 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:20.851809    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-n6rmv_55c02df8-b088-4351-ba1f-f1b9650de225/kube-storage-version-migrator-operator/0.log"
Aug 02 11:38:22.034083 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.034058    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/kube-multus-additional-cni-plugins/0.log"
Aug 02 11:38:22.055381 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.055355    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/egress-router-binary-copy/0.log"
Aug 02 11:38:22.076988 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.076961    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/cni-plugins/0.log"
Aug 02 11:38:22.101347 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.101324    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/bond-cni-plugin/0.log"
Aug 02 11:38:22.121428 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.121405    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/routeoverride-cni/0.log"
Aug 02 11:38:22.142167 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.142128    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/whereabouts-cni-bincopy/0.log"
Aug 02 11:38:22.165175 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.165151    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-8b865_9ae08e3f-8fc1-437f-96b0-a914cd707ddf/whereabouts-cni/0.log"
Aug 02 11:38:22.346105 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.346027    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ddbjw_5a192f09-2c4b-4d78-9074-31dacee6aa5b/kube-multus/0.log"
Aug 02 11:38:22.373107 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.373079    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4sp8v_e6b44d3c-bb78-4e23-be01-089572c40bbc/network-metrics-daemon/0.log"
Aug 02 11:38:22.390971 ip-10-0-130-84 kubenswrapper[2563]: I0802 11:38:22.390935    2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4sp8v_e6b44d3c-bb78-4e23-be01-089572c40bbc/kube-rbac-proxy/0.log"