Jul 28 13:59:45.620949 ip-10-0-141-71 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 13:59:45.990010 ip-10-0-141-71 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 13:59:45.990010 ip-10-0-141-71 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 13:59:45.990010 ip-10-0-141-71 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 13:59:45.990010 ip-10-0-141-71 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 13:59:45.990010 ip-10-0-141-71 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 13:59:45.990935 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.990848    2558 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 13:59:45.995545 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995527    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:45.995545 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995543    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:45.995545 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995547    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995550    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995553    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995557    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995560    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995562    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995565    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995568    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995572    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995574    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995586    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995589    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995592    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995595    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995597    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995600    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995602    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995605    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995607    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995610    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:45.995666 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995612    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995615    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995617    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995620    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995623    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995625    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995628    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995631    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995633    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995636    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995638    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995641    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995643    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995646    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995660    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995663    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995666    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995668    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995671    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995674    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:45.996147 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995677    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995681    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995684    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995687    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995690    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995692    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995695    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995698    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995700    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995704    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995708    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995712    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995715    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995717    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995720    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995723    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995726    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995730    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:45.996689 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995733    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995736    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995739    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995742    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995745    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995747    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995751    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995755    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995760    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995762    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995765    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995768    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995770    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995773    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995776    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995778    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995781    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995784    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995787    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995789    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:45.997167 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995792    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995794    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995797    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995800    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995803    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995806    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995809    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995811    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995813    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995816    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995819    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995821    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995824    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995826    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995829    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995831    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995834    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995836    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.995839    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996557    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:45.998006 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996564    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996567    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996570    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996572    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996577    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996581    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996584    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996587    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996589    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996592    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996596    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996598    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996601    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996603    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996606    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996609    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996611    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996614    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996616    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996619    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:45.998762 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996621    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996624    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996627    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996629    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996632    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996635    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996638    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996641    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996643    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996646    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996663    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996668    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996672    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996677    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996680    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996683    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996686    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996689    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996691    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996694    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:45.999286 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996697    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996699    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996702    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996705    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996708    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996711    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996714    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996717    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996720    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996722    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996724    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996727    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996730    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996732    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996737    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996740    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996743    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996745    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996747    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:45.999796 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996750    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996752    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996755    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996757    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996760    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996765    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996767    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996770    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996772    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996775    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996777    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996779    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996782    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996784    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996787    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996789    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996792    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996795    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996797    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996800    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:46.000267 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996802    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996804    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996807    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996809    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996812    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996814    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996817    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996819    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996822    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996824    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996827    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996829    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996832    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996834    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996837    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996839    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996842    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996848    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.996850    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.997969    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:46.000769 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.997983    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.997989    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.997994    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.997999    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998010    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998016    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998021    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998027    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998033    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998039    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998044    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998049    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998054    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998058    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998063    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998069    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998079    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998084    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998088    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:46.001264 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998093    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998098    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998102    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998107    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998111    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998116    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998120    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998125    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998129    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998134    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998144    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998149    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998154    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998159    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998163    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998168    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998172    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998176    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998180    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998185    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:46.001751 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998189    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998194    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998203    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998209    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998214    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998218    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998223    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998227    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998232    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998236    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998240    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998245    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998249    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998254    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998258    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998269    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998273    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998281    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998285    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998291    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:46.002237 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998296    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998300    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998305    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998310    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998314    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998320    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998327    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998336    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998341    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998347    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998351    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998354    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998357    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998361    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998365    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998368    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998372    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998377    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998382    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:46.002781 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998385    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998388    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998391    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998394    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998397    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998400    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998403    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998406    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998409    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998412    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998416    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998419    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998425    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998428    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998431    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998434    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998437    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998440    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998443    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:46.003236 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.998446    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.998973    2558 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.998988    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.998996    2558 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999001    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999005    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999009    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999014    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999019    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999022    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999025    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999028    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999032    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999035    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999038    2558 flags.go:64] FLAG: --cgroup-root=""
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999041    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999044    2558 flags.go:64] FLAG: --client-ca-file=""
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999047    2558 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999050    2558 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999054    2558 flags.go:64] FLAG: --cluster-domain=""
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999057    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999060    2558 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999064    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999067    2558 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 13:59:46.003701 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999072    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999075    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999078    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999082    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999085    2558 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999088    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999091    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999094    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999097    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999101    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999106    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999109    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999112    2558 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999115    2558 flags.go:64] FLAG: --enable-server="true"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999118    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999123    2558 flags.go:64] FLAG: --event-burst="100"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999127    2558 flags.go:64] FLAG: --event-qps="50"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999130    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999133    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999136    2558 flags.go:64] FLAG: --eviction-hard=""
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999139    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999142    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999146    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999149    2558 flags.go:64] FLAG: --eviction-soft=""
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999152    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 13:59:46.004310 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999155    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999158    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999160    2558 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999163    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999166    2558 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999169    2558 flags.go:64] FLAG: --feature-gates=""
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999173    2558 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999176    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999179    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999182    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999185    2558 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999188    2558 flags.go:64] FLAG: --help="false"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999191    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-141-71.ec2.internal"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999194    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999197    2558 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999200    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999204    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999208    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999211    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999214    2558 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999217    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999220    2558 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999223    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999226    2558 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 13:59:46.004946 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999229    2558 flags.go:64] FLAG: --kube-reserved=""
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999232    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999235    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999238    2558 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999240    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999244    2558 flags.go:64] FLAG: --lock-file=""
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999247    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999249    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999252    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999258    2558 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999260    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999263    2558 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999266    2558 flags.go:64] FLAG: --logging-format="text"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999269    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999272    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999275    2558 flags.go:64] FLAG: --manifest-url=""
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999278    2558 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999283    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999286    2558 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999290    2558 flags.go:64] FLAG: --max-pods="110"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999293    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999297    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999300    2558 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999303    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999306    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 13:59:46.005571 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999312    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999315    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999324    2558 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999327    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999330    2558 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999333    2558 flags.go:64] FLAG: --pod-cidr=""
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999336    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999342    2558 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999345    2558 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999349    2558 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999351    2558 flags.go:64] FLAG: --port="10250"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999354    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999358    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ccef7af4605af5e8"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999361    2558 flags.go:64] FLAG: --qos-reserved=""
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999364    2558 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999367    2558 flags.go:64] FLAG: --register-node="true"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999370    2558 flags.go:64] FLAG: --register-with-taints=""
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999374    2558 flags.go:64] FLAG: --registry-burst="10"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999377    2558 flags.go:64] FLAG: --registry-qps="5"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999381    2558 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999384    2558 flags.go:64] FLAG: --reserved-memory=""
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999388    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999390    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999393    2558 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999396    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 13:59:46.006443 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999399    2558 flags.go:64] FLAG: --runonce="false"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999403    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999406    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999409    2558 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999411    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999415    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999418    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999421    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999425    2558 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999428    2558 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999431    2558 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999434    2558 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999437    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999440    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999443    2558 flags.go:64] FLAG: --system-cgroups=""
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999446    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999452    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999455    2558 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999458    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999462    2558 flags.go:64] FLAG: --tls-min-version=""
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999465    2558 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999468    2558 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999471    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999474    2558 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999477    2558 flags.go:64] FLAG: --v="2"
Jul 28 13:59:46.007445 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999481    2558 flags.go:64] FLAG: --version="false"
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999485    2558 flags.go:64] FLAG: --vmodule=""
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999489    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:45.999492    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999621    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999625    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999629    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999632    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999635    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999638    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999641    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999643    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999646    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999664    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999667    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999671    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999674    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999676    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999679    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999682    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:46.008266 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999684    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999688    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999693    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999697    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999700    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999703    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999705    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999708    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999711    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999713    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999716    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999718    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999721    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999724    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999726    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999729    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999732    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999734    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999737    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:46.009112 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999739    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999742    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999745    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999747    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999750    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999753    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999756    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999759    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999763    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999766    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999768    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999771    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999773    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999776    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999778    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999781    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999784    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999787    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999789    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999792    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:46.009971 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999794    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999797    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999799    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999802    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999805    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999808    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999810    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999813    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999815    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999819    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999822    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999825    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999828    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999831    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999833    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999836    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999839    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999841    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999845    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999848    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:46.010672 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999852    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999855    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999857    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999860    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999862    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999865    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999869    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999872    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999875    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999878    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999881    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999884    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999887    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999890    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999892    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999895    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999897    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999900    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999903    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:46.011463 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999906    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999908    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999911    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999914    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:45.999916    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.000573    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.008807    2558 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.008827    2558 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.008855    2558 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.008865    2558 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008947    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008955    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008961    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008966    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008970    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:46.012279 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008975    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008979    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008984    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008988    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008992    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.008996    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009001    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009005    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009009    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009013    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009019    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009026    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009031    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009035    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009040    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009044    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009048    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009052    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009056    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:46.012715 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009061    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009065    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009072    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009077    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009082    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009088    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009093    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009097    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009101    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009106    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009110    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009114    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009118    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009122    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009126    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009129    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009133    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009138    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009142    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009146    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:46.013291 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009150    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009154    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009159    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009163    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009167    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009171    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009175    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009180    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009184    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009188    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009192    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009196    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009201    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009205    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009209    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009213    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009217    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009222    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009229    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009233    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:46.013840 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009237    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009242    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009247    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009251    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009255    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009260    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009264    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009268    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009273    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009277    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009281    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009285    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009290    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009294    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009298    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009303    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009307    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009311    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009315    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:46.014405 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009319    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009323    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009328    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009332    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009336    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009340    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009344    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009348    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009352    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009356    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009361    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009366    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009372    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009376    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009380    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:46.014957 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009387    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.009396    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009577    2558 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009587    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009593    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009598    2558 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009602    2558 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009606    2558 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009611    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009615    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009619    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009623    2558 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009628    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009632    2558 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 13:59:46.015333 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009636    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009664    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009670    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009674    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009678    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009682    2558 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009686    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009691    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009695    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009699    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009703    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009708    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009712    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009717    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009721    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009725    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009731    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009735    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009742    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 13:59:46.015744 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009748    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009753    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009758    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009762    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009767    2558 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009771    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009775    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009779    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009783    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009788    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009792    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009796    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009800    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009804    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009808    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009813    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009817    2558 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009822    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009826    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 13:59:46.016300 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009830    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009834    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009838    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009843    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009847    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009851    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009855    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009860    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009865    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009869    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009874    2558 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009879    2558 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009883    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009887    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009891    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009895    2558 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009899    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009904    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009908    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009912    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 13:59:46.017067 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009916    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009920    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009924    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009928    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009932    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009937    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009942    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009946    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009950    2558 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009955    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009959    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009964    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009967    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009972    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009975    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009979    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009982    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009986    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009990    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009994    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 13:59:46.017576 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.009998    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010002    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010006    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010011    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010016    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010021    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010026    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010030    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:46.010034    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.010043    2558 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.010213    2558 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.012751    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.014134    2558 server.go:1019] "Starting client certificate rotation"
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.014245    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 13:59:46.018115 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.014274    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 13:59:46.018466 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.016751    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 13:59:46.020949 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.020927    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 13:59:46.030051 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.030030    2558 log.go:25] "Validated CRI v1 runtime API"
Jul 28 13:59:46.033912 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.033894    2558 log.go:25] "Validated CRI v1 image API"
Jul 28 13:59:46.035358 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.035343    2558 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 13:59:46.038497 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.038475    2558 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ced4e4c9-413e-4c38-8b2c-648fd212347e:/dev/nvme0n1p3 f6034a3b-962b-4016-84b5-4d2fb4b76409:/dev/nvme0n1p4]
Jul 28 13:59:46.038556 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.038496    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 13:59:46.046346 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.046202    2558 manager.go:216] Machine: {Timestamp:2026-07-28 13:59:46.044607772 +0000 UTC m=+0.312493266 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099735 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28962f5ae7c190f9342d13dc2e3f97 SystemUUID:ec28962f-5ae7-c190-f934-2d13dc2e3f97 BootID:c31fa652-8a7a-49fd-bba4-b0a6a4a24c89 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:23:30:72:ed:d1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:23:30:72:ed:d1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:3a:83:5e:57:99 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 13:59:46.046346 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.046333    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 13:59:46.046516 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.046419    2558 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 13:59:46.049060 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.049035    2558 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 13:59:46.049213 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.049064    2558 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-71.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 13:59:46.049345 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.049329    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 13:59:46.049781 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.049769    2558 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 13:59:46.049815 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.049784    2558 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 13:59:46.049815 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.049792    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 13:59:46.050554 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.050544    2558 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 13:59:46.051822 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.051812    2558 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 13:59:46.054808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054797    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 13:59:46.054925 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054916    2558 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 13:59:46.054962 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054945    2558 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 13:59:46.054962 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054954    2558 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 13:59:46.055018 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054968    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 13:59:46.055018 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054979    2558 kubelet.go:398] "Adding apiserver pod source"
Jul 28 13:59:46.055018 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.054987    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 13:59:46.055367 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.055356    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 13:59:46.055417 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.055375    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 13:59:46.057422 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.057405    2558 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 13:59:46.058790 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.058777    2558 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 13:59:46.058832 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.058807    2558 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 13:59:46.059514 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059503    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059519    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059529    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059537    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059548    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059554    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059561    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059566    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059573    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 13:59:46.059575 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059579    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 13:59:46.059831 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059588    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 13:59:46.059831 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.059593    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 13:59:46.061884 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.061871    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 13:59:46.061884 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.061883    2558 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 13:59:46.065210 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.065191    2558 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-71.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 13:59:46.065280 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.065201    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 13:59:46.065318 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.065273    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 13:59:46.065436 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.065424    2558 server.go:1268] "Started kubelet"
Jul 28 13:59:46.065533 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.065498    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 13:59:46.066083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.065589    2558 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 13:59:46.066083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.065944    2558 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 13:59:46.066464 ip-10-0-141-71 systemd[1]: Started Kubernetes Kubelet.
Jul 28 13:59:46.067573 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.067546    2558 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 13:59:46.068159 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.068142    2558 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 13:59:46.070233 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.070211    2558 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 13:59:46.073013 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.072160    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18c678db69b1996c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-07-28 13:59:46.065398124 +0000 UTC m=+0.333283620,LastTimestamp:2026-07-28 13:59:46.065398124 +0000 UTC m=+0.333283620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Jul 28 13:59:46.073719 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.073702    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 13:59:46.073775 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.073705    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 13:59:46.073872 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.073843    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:46.074275 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074261    2558 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 13:59:46.074383 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074269    2558 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 13:59:46.074451 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074438    2558 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 13:59:46.074595 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074585    2558 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 13:59:46.074595 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074595    2558 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 13:59:46.074871 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074857    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 13:59:46.074909 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074873    2558 factory.go:55] Registering systemd factory
Jul 28 13:59:46.074909 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.074882    2558 factory.go:223] Registration of the systemd container factory successfully
Jul 28 13:59:46.076120 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.076032    2558 factory.go:153] Registering CRI-O factory
Jul 28 13:59:46.076120 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.076047    2558 factory.go:223] Registration of the crio container factory successfully
Jul 28 13:59:46.076120 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.076069    2558 factory.go:103] Registering Raw factory
Jul 28 13:59:46.076120 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.076085    2558 manager.go:1196] Started watching for new ooms in manager
Jul 28 13:59:46.076464 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.076446    2558 manager.go:349] Starting recovery of all containers
Jul 28 13:59:46.078031 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.078005    2558 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-71.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 13:59:46.078163 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.078139    2558 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 13:59:46.088935 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.088917    2558 manager.go:354] Recovery completed
Jul 28 13:59:46.093092 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.093079    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:46.094911 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.094894    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:46.094981 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.094923    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:46.094981 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.094937    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:46.095384 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.095372    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 13:59:46.095427 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.095385    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 13:59:46.095427 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.095402    2558 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 13:59:46.095486 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.095428    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:46.096086 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096072    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:46.096143 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096098    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:46.096143 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096107    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:46.096429 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096414    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x22w9"
Jul 28 13:59:46.096627 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096618    2558 policy_none.go:49] "None policy: Start"
Jul 28 13:59:46.096678 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096631    2558 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 13:59:46.096678 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.096642    2558 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 13:59:46.097599 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.097534    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18c678db6b73eb30  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-07-28 13:59:46.094910256 +0000 UTC m=+0.362795754,LastTimestamp:2026-07-28 13:59:46.094910256 +0000 UTC m=+0.362795754,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Jul 28 13:59:46.097815 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.097801    2558 policy_none.go:47] "Start"
Jul 28 13:59:46.108240 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.108180    2558 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-71.ec2.internal.18c678db6b743c2a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-71.ec2.internal,UID:ip-10-0-141-71.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-71.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-71.ec2.internal,},FirstTimestamp:2026-07-28 13:59:46.094930986 +0000 UTC m=+0.362816481,LastTimestamp:2026-07-28 13:59:46.094930986 +0000 UTC m=+0.362816481,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-71.ec2.internal,}"
Jul 28 13:59:46.111206 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.111192    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x22w9"
Jul 28 13:59:46.139362 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139200    2558 manager.go:337] "Starting Device Plugin manager"
Jul 28 13:59:46.139450 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.139375    2558 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 13:59:46.139450 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139386    2558 server.go:87] "Starting device plugin registration server"
Jul 28 13:59:46.139577 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139568    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 13:59:46.139611 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139579    2558 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 13:59:46.139723 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139701    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 13:59:46.139802 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139789    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 13:59:46.139802 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:46.139802    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 13:59:46.140282 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.140265    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 13:59:46.140357 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:46.140315    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.273032 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.272997    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:47.273942 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.273904    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:47.273942 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.273933    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:47.273942 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.273943    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:47.274096 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.273968    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.274549 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.274531    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 13:59:47.275747 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.275724    2558 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 13:59:47.275838 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.275768    2558 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 13:59:47.275838 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.275793    2558 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 13:59:47.275838 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.275832    2558 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 13:59:47.277969 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.277948    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:47.283373 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.283358    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.283460 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.283382    2558 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-71.ec2.internal\": node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.329297 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.329277    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.375908 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.375879    2558 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"]
Jul 28 13:59:47.375989 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.375954    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:47.377408 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.377394    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:47.377465 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.377422    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:47.377465 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.377432    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:47.378625 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.378612    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:47.378781 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.378767    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.378846 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.378808    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:47.379384 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.379367    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:47.379456 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.379398    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:47.379456 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.379412    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:47.379456 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.379420    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:47.379456 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.379445    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:47.379573 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.379472    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:47.380682 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.380667    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.380749 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.380703    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:47.381373 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.381359    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:47.381469 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.381387    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:47.381469 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.381412    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:47.410558 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.410543    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-71.ec2.internal\" not found" node="ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.414764 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.414748    2558 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-71.ec2.internal\" not found" node="ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.430231 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.430212    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.508836 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.508801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee18178d793931ec5a7685e293ce85c6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-71.ec2.internal\" (UID: \"ee18178d793931ec5a7685e293ce85c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.508978 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.508844    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8301f25eff9497223b95ddd60276ca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"d8301f25eff9497223b95ddd60276ca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.508978 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.508878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8301f25eff9497223b95ddd60276ca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"d8301f25eff9497223b95ddd60276ca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.530946 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.530890    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.609612 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.609586    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee18178d793931ec5a7685e293ce85c6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-71.ec2.internal\" (UID: \"ee18178d793931ec5a7685e293ce85c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.609728 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.609599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ee18178d793931ec5a7685e293ce85c6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-71.ec2.internal\" (UID: \"ee18178d793931ec5a7685e293ce85c6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.609728 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.609637    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8301f25eff9497223b95ddd60276ca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"d8301f25eff9497223b95ddd60276ca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.609728 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.609657    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8301f25eff9497223b95ddd60276ca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"d8301f25eff9497223b95ddd60276ca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.609728 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.609681    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8301f25eff9497223b95ddd60276ca2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"d8301f25eff9497223b95ddd60276ca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.609728 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.609707    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d8301f25eff9497223b95ddd60276ca2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal\" (UID: \"d8301f25eff9497223b95ddd60276ca2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.631694 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.631668    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.713180 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.713156    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.718432 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:47.718409    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:47.732508 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.732487    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.833144 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.833050    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:47.933537 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:47.933505    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:48.034068 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:48.034041    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:48.047211 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.047190    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 13:59:48.047372 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.047345    2558 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 13:59:48.118009 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.117920    2558 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:48.134542 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:48.134500    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:48.148679 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.148647    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 13:54:47 +0000 UTC" deadline="2028-05-04 14:36:13.14012081 +0000 UTC"
Jul 28 13:59:48.148679 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.148675    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15504h36m24.991448446s"
Jul 28 13:59:48.235237 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:48.235206    2558 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-71.ec2.internal\" not found"
Jul 28 13:59:48.249432 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:48.248871    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee18178d793931ec5a7685e293ce85c6.slice/crio-904fbeb6fd487c5e8b646863994a16971fc91500d528050d7c20e0e5fdc2613c WatchSource:0}: Error finding container 904fbeb6fd487c5e8b646863994a16971fc91500d528050d7c20e0e5fdc2613c: Status 404 returned error can't find the container with id 904fbeb6fd487c5e8b646863994a16971fc91500d528050d7c20e0e5fdc2613c
Jul 28 13:59:48.249432 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:48.249307    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8301f25eff9497223b95ddd60276ca2.slice/crio-1b69b46dd123f7dff0b8e3e55f565bc2525dc38c6d0a50ca265248ba50f342a7 WatchSource:0}: Error finding container 1b69b46dd123f7dff0b8e3e55f565bc2525dc38c6d0a50ca265248ba50f342a7: Status 404 returned error can't find the container with id 1b69b46dd123f7dff0b8e3e55f565bc2525dc38c6d0a50ca265248ba50f342a7
Jul 28 13:59:48.253921 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.253903    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 13:59:48.266333 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.266309    2558 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 13:59:48.266412 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.266321    2558 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:48.267380 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.267361    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 13:59:48.267477 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.267390    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 13:59:48.267477 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.267400    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeHasSufficientPID"
Jul 28 13:59:48.278685 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.278643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal" event={"ID":"ee18178d793931ec5a7685e293ce85c6","Type":"ContainerStarted","Data":"904fbeb6fd487c5e8b646863994a16971fc91500d528050d7c20e0e5fdc2613c"}
Jul 28 13:59:48.279596 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.279574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" event={"ID":"d8301f25eff9497223b95ddd60276ca2","Type":"ContainerStarted","Data":"1b69b46dd123f7dff0b8e3e55f565bc2525dc38c6d0a50ca265248ba50f342a7"}
Jul 28 13:59:48.307859 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.307841    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:48.317109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.317093    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 13:59:48.318366 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.318354    2558 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal"
Jul 28 13:59:48.328983 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.328970    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 13:59:48.585176 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.585103    2558 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:48.946810 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:48.946728    2558 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 13:59:49.090459 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.090427    2558 apiserver.go:52] "Watching apiserver"
Jul 28 13:59:49.099112 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.099084    2558 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 13:59:49.099623 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.099599    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-c977w","kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g","openshift-cluster-node-tuning-operator/tuned-26bqb","openshift-multus/multus-additional-cni-plugins-x5h2j","openshift-multus/network-metrics-daemon-6ndp9","openshift-dns/node-resolver-4sdxn","openshift-image-registry/node-ca-nbmn2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal","openshift-multus/multus-lbxcs","openshift-network-diagnostics/network-check-target-jhwls","openshift-network-operator/iptables-alerter-jc4r7","openshift-ovn-kubernetes/ovnkube-node-j2qbx","kube-system/global-pull-secret-syncer-bc5tq"]
Jul 28 13:59:49.101329 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.101308    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.102627 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.102604    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.103949 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.103930    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qckb8\""
Jul 28 13:59:49.104064 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.103950    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.104522 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.104182    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.104522 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.104221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.105380 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.105361    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.106671 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.106652    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.107198 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107085    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 13:59:49.107198 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107112    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 13:59:49.107198 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107192    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 13:59:49.107382 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107257    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 13:59:49.107382 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107280    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.107480 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107392    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.107480 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107413    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.107574 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107507    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 13:59:49.107626 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107575    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5nkqh\""
Jul 28 13:59:49.107756 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107733    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gg45c\""
Jul 28 13:59:49.107916 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107901    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.107978 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.107903    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 13:59:49.108200 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.108180    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.108295 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.108243    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.108354 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.108297    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h4wkp\""
Jul 28 13:59:49.108432 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.108412    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.108538 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.108487    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 13:59:49.109602 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.109581    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.109713 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.109696    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 13:59:49.109971 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.109949    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 13:59:49.110080 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.109986    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.110143 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.110110    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 13:59:49.110198 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.110162    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 13:59:49.110241 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.110207    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zfsc2\""
Jul 28 13:59:49.110497 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.110255    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.111583 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.111347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.114160 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.114136    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 13:59:49.115308 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.115289    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 13:59:49.115455 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.115434    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kqh4m\""
Jul 28 13:59:49.116121 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.116104    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.117898 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.117880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.119142 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.119119    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 13:59:49.119332 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.119313    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.119525 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.119509    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jr78q\""
Jul 28 13:59:49.119801 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.119782    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.120119 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.120102    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:49.120203 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.120166    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 13:59:49.120371 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.120352    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 13:59:49.120599 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.120579    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9xbt9\""
Jul 28 13:59:49.120705 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.120676    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.121063 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121042    2558 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 13:59:49.121209 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-kubelet\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121302 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121227    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-systemd-units\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121302 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121253    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-var-lib-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121302 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-log-socket\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121452 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.121452 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121452 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysconfig\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.121452 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121373    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-system-cni-dir\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.121452 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cnibin\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.121452 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121428    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.121779 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfgj5\" (UniqueName: \"kubernetes.io/projected/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-kube-api-access-sfgj5\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121779 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121493    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-registration-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.121779 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-kubernetes\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.121779 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121578    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-os-release\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.121779 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-cni-netd\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.121779 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121738    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovnkube-script-lib\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-var-lib-kubelet\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121914    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-slash\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-device-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.122083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121959    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.122083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.121981    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5fqq\" (UniqueName: \"kubernetes.io/projected/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-kube-api-access-f5fqq\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.122083 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122009    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffqnc\" (UniqueName: \"kubernetes.io/projected/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-kube-api-access-ffqnc\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122082    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-run-netns\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122117    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-cni-bin\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122179    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-run\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122194    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-sys\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-lib-modules\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122238    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-tmp\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122262    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5hvz\" (UniqueName: \"kubernetes.io/projected/83df7d59-5e78-481b-8a96-61e4c7123aa1-kube-api-access-z5hvz\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122282    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-systemd\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-tuned\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-etc-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122342    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-node-log\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-sys-fs\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk6fn\" (UniqueName: \"kubernetes.io/projected/6a427e57-f24e-4688-bcab-616659927837-kube-api-access-vk6fn\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122383    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-modprobe-d\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.122406 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122401    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-etc-selinux\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-ovn\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122478    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-hosts-file\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122547    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-tmp-dir\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122568    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-env-overrides\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122593    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovnkube-config\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122922    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysctl-d\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.122972    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-host\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123012    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5982x\" (UniqueName: \"kubernetes.io/projected/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-kube-api-access-5982x\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123100    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-socket-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysctl-conf\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123136    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-systemd\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.123331 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovn-node-metrics-cert\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.124109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123561    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 13:59:49.124109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123601    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 13:59:49.124109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123826    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 13:59:49.124109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.123976    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vt9l8\""
Jul 28 13:59:49.144611 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.144592    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-njxrs"
Jul 28 13:59:49.153731 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.153713    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-njxrs"
Jul 28 13:59:49.209340 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.209259    2558 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 13:59:49.224308 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224263    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-node-log\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.224308 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-sys-fs\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224336    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk6fn\" (UniqueName: \"kubernetes.io/projected/6a427e57-f24e-4688-bcab-616659927837-kube-api-access-vk6fn\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224357    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-modprobe-d\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224381    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgc5t\" (UniqueName: \"kubernetes.io/projected/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-kube-api-access-kgc5t\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224398    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-node-log\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224416    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-etc-selinux\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-sys-fs\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224499    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vn8n\" (UniqueName: \"kubernetes.io/projected/ed49a9a2-942e-41b6-bb67-f9c60430dd67-kube-api-access-5vn8n\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-system-cni-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-modprobe-d\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.224546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-cni-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224597    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-k8s-cni-cncf-io\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224631    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-cni-bin\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-etc-selinux\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224695    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-ovn\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224767    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224770    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-ovn\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224800    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-cnibin\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-conf-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224874    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e467769-8086-4a54-86fd-576aee1b4554-multus-daemon-config\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224903    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-hosts-file\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-tmp-dir\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224963    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-cni-multus\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.224983    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-env-overrides\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.225037 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-host\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbm9j\" (UniqueName: \"kubernetes.io/projected/0e467769-8086-4a54-86fd-576aee1b4554-kube-api-access-qbm9j\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225081    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovnkube-config\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225154    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysctl-d\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-host\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed49a9a2-942e-41b6-bb67-f9c60430dd67-host-slash\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225274    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-os-release\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225296    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-netns\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225319    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225370    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5982x\" (UniqueName: \"kubernetes.io/projected/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-kube-api-access-5982x\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-socket-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225452    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-etc-kubernetes\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225480    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysctl-conf\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225487    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cni-binary-copy\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-systemd\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225517    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.225735 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225542    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovn-node-metrics-cert\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225081    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-hosts-file\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-env-overrides\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225762    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225851    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-socket-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225951    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysctl-d\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.225987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-run-systemd\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226074    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226111    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-kubelet\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226147    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-systemd-units\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-var-lib-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226203    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-log-socket\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226224    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-kubelet\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226221    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-tmp-dir\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226233    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226269    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-var-lib-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.226541 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226280    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba612107-ebfe-4a59-a4ae-7649e3178e63-konnectivity-ca\") pod \"konnectivity-agent-c977w\" (UID: \"ba612107-ebfe-4a59-a4ae-7649e3178e63\") " pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226303    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-log-socket\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226312    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226335    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226341    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-systemd-units\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226394    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysconfig\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226419    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-system-cni-dir\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226454    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-host\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226470    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysconfig\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-run-ovn-kubernetes\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226489    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cnibin\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226509    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-serviceca\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-system-cni-dir\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226545    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovnkube-config\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226549    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-cnibin\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-multus-certs\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.227339 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226635    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfgj5\" (UniqueName: \"kubernetes.io/projected/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-kube-api-access-sfgj5\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-registration-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-kubernetes\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.226707    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-registration-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226786    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-os-release\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226794    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-kubernetes\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226708    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-os-release\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.226810    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 13:59:49.726776804 +0000 UTC m=+2.961296278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226843    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e467769-8086-4a54-86fd-576aee1b4554-cni-binary-copy\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-kubelet\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-hostroot\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226915    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-cni-netd\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226938    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovnkube-script-lib\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226940    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-sysctl-conf\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226949    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-cni-netd\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228132 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.226960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-var-lib-kubelet\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-var-lib-kubelet\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227065    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-slash\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227161    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-slash\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227176    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-device-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227204    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227241    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5fqq\" (UniqueName: \"kubernetes.io/projected/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-kube-api-access-f5fqq\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227266    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6a427e57-f24e-4688-bcab-616659927837-device-dir\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227277    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed49a9a2-942e-41b6-bb67-f9c60430dd67-iptables-alerter-script\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e8e4996-66ef-4e59-b750-4aaff0ed34da-kubelet-config\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e8e4996-66ef-4e59-b750-4aaff0ed34da-dbus\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffqnc\" (UniqueName: \"kubernetes.io/projected/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-kube-api-access-ffqnc\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227433    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-run-netns\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227494    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-run-netns\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227518    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovnkube-script-lib\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.228945 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227602    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-cni-bin\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227642    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227673    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-run\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227676    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-cni-bin\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-sys\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227727    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227747    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-lib-modules\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227775    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-tmp\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5hvz\" (UniqueName: \"kubernetes.io/projected/83df7d59-5e78-481b-8a96-61e4c7123aa1-kube-api-access-z5hvz\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227800    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-run\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227835    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-systemd\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-lib-modules\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-sys\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.227983    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-systemd\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.228358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba612107-ebfe-4a59-a4ae-7649e3178e63-agent-certs\") pod \"konnectivity-agent-c977w\" (UID: \"ba612107-ebfe-4a59-a4ae-7649e3178e63\") " pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.228386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-socket-dir-parent\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.229768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.228417    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-tuned\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.230641 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.228443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-etc-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.230641 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.228530    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-etc-openvswitch\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.230641 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.230563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-tmp\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.230746 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.230718    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-ovn-node-metrics-cert\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.230913 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.230897    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-etc-tuned\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.236777 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.235168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk6fn\" (UniqueName: \"kubernetes.io/projected/6a427e57-f24e-4688-bcab-616659927837-kube-api-access-vk6fn\") pod \"aws-ebs-csi-driver-node-rks9g\" (UID: \"6a427e57-f24e-4688-bcab-616659927837\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.238599 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.238567    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5982x\" (UniqueName: \"kubernetes.io/projected/13bd51b3-dfc8-4c90-af9a-d96a4da7a653-kube-api-access-5982x\") pod \"tuned-26bqb\" (UID: \"13bd51b3-dfc8-4c90-af9a-d96a4da7a653\") " pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.240005 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.239946    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfgj5\" (UniqueName: \"kubernetes.io/projected/c8d4e7a4-f8bf-4673-90bc-fe4f05155d60-kube-api-access-sfgj5\") pod \"ovnkube-node-j2qbx\" (UID: \"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60\") " pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.240266 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.240247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5fqq\" (UniqueName: \"kubernetes.io/projected/75a367f6-72e8-45c8-9ccd-dbcc78c4f911-kube-api-access-f5fqq\") pod \"multus-additional-cni-plugins-x5h2j\" (UID: \"75a367f6-72e8-45c8-9ccd-dbcc78c4f911\") " pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.241116 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.241096    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5hvz\" (UniqueName: \"kubernetes.io/projected/83df7d59-5e78-481b-8a96-61e4c7123aa1-kube-api-access-z5hvz\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.242124 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.242100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffqnc\" (UniqueName: \"kubernetes.io/projected/f849cc24-20cf-4f7e-a104-58a9d1ed9a9b-kube-api-access-ffqnc\") pod \"node-resolver-4sdxn\" (UID: \"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b\") " pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.329630 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-etc-kubernetes\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329639    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329669    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba612107-ebfe-4a59-a4ae-7649e3178e63-konnectivity-ca\") pod \"konnectivity-agent-c977w\" (UID: \"ba612107-ebfe-4a59-a4ae-7649e3178e63\") " pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329696    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-serviceca\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329708    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-etc-kubernetes\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329721    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-multus-certs\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.329752    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329760    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e467769-8086-4a54-86fd-576aee1b4554-cni-binary-copy\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.329808 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329798    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-kubelet\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.329821    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 13:59:49.829802322 +0000 UTC m=+3.064321775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329831    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-multus-certs\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-hostroot\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329906    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed49a9a2-942e-41b6-bb67-f9c60430dd67-iptables-alerter-script\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329921    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e8e4996-66ef-4e59-b750-4aaff0ed34da-kubelet-config\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329936    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e8e4996-66ef-4e59-b750-4aaff0ed34da-dbus\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329966    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba612107-ebfe-4a59-a4ae-7649e3178e63-agent-certs\") pod \"konnectivity-agent-c977w\" (UID: \"ba612107-ebfe-4a59-a4ae-7649e3178e63\") " pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329982    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-socket-dir-parent\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgc5t\" (UniqueName: \"kubernetes.io/projected/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-kube-api-access-kgc5t\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vn8n\" (UniqueName: \"kubernetes.io/projected/ed49a9a2-942e-41b6-bb67-f9c60430dd67-kube-api-access-5vn8n\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330062    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-system-cni-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330076    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-cni-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330078    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7e8e4996-66ef-4e59-b750-4aaff0ed34da-kubelet-config\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330092    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-k8s-cni-cncf-io\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-cni-bin\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.330236 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330136    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-cnibin\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-conf-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330181    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e467769-8086-4a54-86fd-576aee1b4554-multus-daemon-config\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330205    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-cni-multus\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330224    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-host\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330250    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-serviceca\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330257    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbm9j\" (UniqueName: \"kubernetes.io/projected/0e467769-8086-4a54-86fd-576aee1b4554-kube-api-access-qbm9j\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330316    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed49a9a2-942e-41b6-bb67-f9c60430dd67-host-slash\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-os-release\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330366    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-netns\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330373    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ba612107-ebfe-4a59-a4ae-7649e3178e63-konnectivity-ca\") pod \"konnectivity-agent-c977w\" (UID: \"ba612107-ebfe-4a59-a4ae-7649e3178e63\") " pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330438    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-hostroot\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330442    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0e467769-8086-4a54-86fd-576aee1b4554-cni-binary-copy\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330465    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-socket-dir-parent\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330496    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-cni-bin\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.329839    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-kubelet\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330506    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-cnibin\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7e8e4996-66ef-4e59-b750-4aaff0ed34da-dbus\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.331036 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330550    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-conf-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330561    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-var-lib-cni-multus\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330593    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-host\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ed49a9a2-942e-41b6-bb67-f9c60430dd67-host-slash\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-netns\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330644    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-host-run-k8s-cni-cncf-io\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330681    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-os-release\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-system-cni-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330731    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0e467769-8086-4a54-86fd-576aee1b4554-multus-cni-dir\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.330786    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ed49a9a2-942e-41b6-bb67-f9c60430dd67-iptables-alerter-script\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.331872 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.331068    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0e467769-8086-4a54-86fd-576aee1b4554-multus-daemon-config\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.333030 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.332990    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ba612107-ebfe-4a59-a4ae-7649e3178e63-agent-certs\") pod \"konnectivity-agent-c977w\" (UID: \"ba612107-ebfe-4a59-a4ae-7649e3178e63\") " pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.339911 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.339880    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:49.339911 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.339908    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:49.340089 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.339923    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:49.340089 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.339976    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:49.839961998 +0000 UTC m=+3.074481453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:49.342302 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.342282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbm9j\" (UniqueName: \"kubernetes.io/projected/0e467769-8086-4a54-86fd-576aee1b4554-kube-api-access-qbm9j\") pod \"multus-lbxcs\" (UID: \"0e467769-8086-4a54-86fd-576aee1b4554\") " pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.342722 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.342700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vn8n\" (UniqueName: \"kubernetes.io/projected/ed49a9a2-942e-41b6-bb67-f9c60430dd67-kube-api-access-5vn8n\") pod \"iptables-alerter-jc4r7\" (UID: \"ed49a9a2-942e-41b6-bb67-f9c60430dd67\") " pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.342812 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.342723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgc5t\" (UniqueName: \"kubernetes.io/projected/539fbdf4-b8da-4852-a4ae-e55d5a98a7da-kube-api-access-kgc5t\") pod \"node-ca-nbmn2\" (UID: \"539fbdf4-b8da-4852-a4ae-e55d5a98a7da\") " pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.423510 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.423461    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4sdxn"
Jul 28 13:59:49.426546 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.426517    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 13:59:49.435537 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.435511    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g"
Jul 28 13:59:49.442280 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.442260    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-26bqb"
Jul 28 13:59:49.455186 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.455157    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x5h2j"
Jul 28 13:59:49.461761 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.461710    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c977w"
Jul 28 13:59:49.467368 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.467347    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nbmn2"
Jul 28 13:59:49.474057 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.474038    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lbxcs"
Jul 28 13:59:49.479586 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.479568    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jc4r7"
Jul 28 13:59:49.733695 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.733617    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:49.733846 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.733768    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:49.733846 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.733828    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 13:59:50.733812061 +0000 UTC m=+3.968331519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:49.834594 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.834553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:49.834758 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.834713    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:49.834810 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.834780    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 13:59:50.834765246 +0000 UTC m=+4.069284700 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:49.935460 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:49.935424    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:49.935647 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.935606    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:49.935647 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.935631    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:49.935647 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.935644    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:49.935806 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:49.935710    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:50.935690779 +0000 UTC m=+4.170210249 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:50.097829 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.097788    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod539fbdf4_b8da_4852_a4ae_e55d5a98a7da.slice/crio-d43876f9d19c09b6100abfe55bd0ce56cf11fa48d6dbc77019c5747b3cf13db6 WatchSource:0}: Error finding container d43876f9d19c09b6100abfe55bd0ce56cf11fa48d6dbc77019c5747b3cf13db6: Status 404 returned error can't find the container with id d43876f9d19c09b6100abfe55bd0ce56cf11fa48d6dbc77019c5747b3cf13db6
Jul 28 13:59:50.099535 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.099431    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13bd51b3_dfc8_4c90_af9a_d96a4da7a653.slice/crio-1e7f024def76ecb65371072731f42916e3016835065f6f2266c28361e01e3977 WatchSource:0}: Error finding container 1e7f024def76ecb65371072731f42916e3016835065f6f2266c28361e01e3977: Status 404 returned error can't find the container with id 1e7f024def76ecb65371072731f42916e3016835065f6f2266c28361e01e3977
Jul 28 13:59:50.102883 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.102858    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba612107_ebfe_4a59_a4ae_7649e3178e63.slice/crio-647d720901223a9c62ad0384cb0779e817675eb5baa3ca5c4cdc597e4486362e WatchSource:0}: Error finding container 647d720901223a9c62ad0384cb0779e817675eb5baa3ca5c4cdc597e4486362e: Status 404 returned error can't find the container with id 647d720901223a9c62ad0384cb0779e817675eb5baa3ca5c4cdc597e4486362e
Jul 28 13:59:50.103552 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.103527    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e467769_8086_4a54_86fd_576aee1b4554.slice/crio-050fddc230b664b5310a4ee2dc134bf9569bdef42b5ccbaa24c7c04762f6eb5a WatchSource:0}: Error finding container 050fddc230b664b5310a4ee2dc134bf9569bdef42b5ccbaa24c7c04762f6eb5a: Status 404 returned error can't find the container with id 050fddc230b664b5310a4ee2dc134bf9569bdef42b5ccbaa24c7c04762f6eb5a
Jul 28 13:59:50.105074 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.104703    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a427e57_f24e_4688_bcab_616659927837.slice/crio-00f2922bfc8a66e50bccee232d14d41f0d61184d6d342cc138f5ef6a226371dd WatchSource:0}: Error finding container 00f2922bfc8a66e50bccee232d14d41f0d61184d6d342cc138f5ef6a226371dd: Status 404 returned error can't find the container with id 00f2922bfc8a66e50bccee232d14d41f0d61184d6d342cc138f5ef6a226371dd
Jul 28 13:59:50.105659 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.105635    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8d4e7a4_f8bf_4673_90bc_fe4f05155d60.slice/crio-4e34fbc9032b852f2e9f5de3b760e97f48636a729e7085d10356a86a3660ca02 WatchSource:0}: Error finding container 4e34fbc9032b852f2e9f5de3b760e97f48636a729e7085d10356a86a3660ca02: Status 404 returned error can't find the container with id 4e34fbc9032b852f2e9f5de3b760e97f48636a729e7085d10356a86a3660ca02
Jul 28 13:59:50.106659 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.106640    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded49a9a2_942e_41b6_bb67_f9c60430dd67.slice/crio-749fffde9e3cf2d761d8a28aac41e5865ea67401f0d87960731d93a165ee13a2 WatchSource:0}: Error finding container 749fffde9e3cf2d761d8a28aac41e5865ea67401f0d87960731d93a165ee13a2: Status 404 returned error can't find the container with id 749fffde9e3cf2d761d8a28aac41e5865ea67401f0d87960731d93a165ee13a2
Jul 28 13:59:50.109124 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.109101    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf849cc24_20cf_4f7e_a104_58a9d1ed9a9b.slice/crio-9666dff40981998519da9f0beccd156b31024b913f37505685d5808a4f6b2d29 WatchSource:0}: Error finding container 9666dff40981998519da9f0beccd156b31024b913f37505685d5808a4f6b2d29: Status 404 returned error can't find the container with id 9666dff40981998519da9f0beccd156b31024b913f37505685d5808a4f6b2d29
Jul 28 13:59:50.109529 ip-10-0-141-71 kubenswrapper[2558]: W0728 13:59:50.109504    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a367f6_72e8_45c8_9ccd_dbcc78c4f911.slice/crio-5ed44df786ee6f9602851a131281296e51f53f86c44e4c5e4708a501b5942547 WatchSource:0}: Error finding container 5ed44df786ee6f9602851a131281296e51f53f86c44e4c5e4708a501b5942547: Status 404 returned error can't find the container with id 5ed44df786ee6f9602851a131281296e51f53f86c44e4c5e4708a501b5942547
Jul 28 13:59:50.156268 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.156238    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:54:49 +0000 UTC" deadline="2028-02-18 01:48:39.985223154 +0000 UTC"
Jul 28 13:59:50.156268 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.156263    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13667h48m49.828962458s"
Jul 28 13:59:50.276768 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.276743    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:50.276880 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.276838    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 13:59:50.284099 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.283848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal" event={"ID":"ee18178d793931ec5a7685e293ce85c6","Type":"ContainerStarted","Data":"51922007ab576a1e8bcafd46207a5cde1d5c3f3628d2ead16d32954286a8b826"}
Jul 28 13:59:50.284976 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.284954    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4sdxn" event={"ID":"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b","Type":"ContainerStarted","Data":"9666dff40981998519da9f0beccd156b31024b913f37505685d5808a4f6b2d29"}
Jul 28 13:59:50.286006 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.285964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"4e34fbc9032b852f2e9f5de3b760e97f48636a729e7085d10356a86a3660ca02"}
Jul 28 13:59:50.286918 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.286899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g" event={"ID":"6a427e57-f24e-4688-bcab-616659927837","Type":"ContainerStarted","Data":"00f2922bfc8a66e50bccee232d14d41f0d61184d6d342cc138f5ef6a226371dd"}
Jul 28 13:59:50.287854 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.287831    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lbxcs" event={"ID":"0e467769-8086-4a54-86fd-576aee1b4554","Type":"ContainerStarted","Data":"050fddc230b664b5310a4ee2dc134bf9569bdef42b5ccbaa24c7c04762f6eb5a"}
Jul 28 13:59:50.289143 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.289119    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c977w" event={"ID":"ba612107-ebfe-4a59-a4ae-7649e3178e63","Type":"ContainerStarted","Data":"647d720901223a9c62ad0384cb0779e817675eb5baa3ca5c4cdc597e4486362e"}
Jul 28 13:59:50.290162 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.290145    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26bqb" event={"ID":"13bd51b3-dfc8-4c90-af9a-d96a4da7a653","Type":"ContainerStarted","Data":"1e7f024def76ecb65371072731f42916e3016835065f6f2266c28361e01e3977"}
Jul 28 13:59:50.291124 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.291107    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerStarted","Data":"5ed44df786ee6f9602851a131281296e51f53f86c44e4c5e4708a501b5942547"}
Jul 28 13:59:50.292062 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.292040    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jc4r7" event={"ID":"ed49a9a2-942e-41b6-bb67-f9c60430dd67","Type":"ContainerStarted","Data":"749fffde9e3cf2d761d8a28aac41e5865ea67401f0d87960731d93a165ee13a2"}
Jul 28 13:59:50.293436 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.293409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbmn2" event={"ID":"539fbdf4-b8da-4852-a4ae-e55d5a98a7da","Type":"ContainerStarted","Data":"d43876f9d19c09b6100abfe55bd0ce56cf11fa48d6dbc77019c5747b3cf13db6"}
Jul 28 13:59:50.300373 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.300334    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-71.ec2.internal" podStartSLOduration=2.300322442 podStartE2EDuration="2.300322442s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:59:50.300127827 +0000 UTC m=+3.534647301" watchObservedRunningTime="2026-07-28 13:59:50.300322442 +0000 UTC m=+3.534841913"
Jul 28 13:59:50.743137 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.743039    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:50.743293 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.743233    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:50.743361 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.743297    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 13:59:52.743276947 +0000 UTC m=+5.977796402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:50.844767 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.844200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:50.844767 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.844363    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:50.844767 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.844423    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 13:59:52.844404655 +0000 UTC m=+6.078924111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:50.945188 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:50.945143    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:50.945362 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.945336    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:50.945362 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.945357    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:50.945469 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.945371    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:50.945469 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:50.945430    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:52.945411872 +0000 UTC m=+6.179931327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:51.157368 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:51.157251    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 13:54:49 +0000 UTC" deadline="2028-03-04 02:50:52.197592077 +0000 UTC"
Jul 28 13:59:51.157368 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:51.157311    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14028h51m1.040285374s"
Jul 28 13:59:51.278629 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:51.278144    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:51.278629 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:51.278281    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 13:59:51.278629 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:51.278328    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:51.278629 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:51.278466    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 13:59:51.308199 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:51.308165    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8301f25eff9497223b95ddd60276ca2" containerID="2170c9c23f5c5c6572aee497ae0b3d07bb45ff33a7c4c3aa9ead5bca37fff6a4" exitCode=0
Jul 28 13:59:51.309135 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:51.309109    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" event={"ID":"d8301f25eff9497223b95ddd60276ca2","Type":"ContainerDied","Data":"2170c9c23f5c5c6572aee497ae0b3d07bb45ff33a7c4c3aa9ead5bca37fff6a4"}
Jul 28 13:59:52.277599 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:52.277081    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:52.277599 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.277212    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 13:59:52.317063 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:52.316527    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" event={"ID":"d8301f25eff9497223b95ddd60276ca2","Type":"ContainerStarted","Data":"25e881f4d8ce082c745c7b85ee9e2f5ef72a43df238e576426bd3bfa542e2de7"}
Jul 28 13:59:52.760674 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:52.760581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:52.760846 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.760736    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:52.760846 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.760802    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 13:59:56.760783945 +0000 UTC m=+9.995303397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:52.861042 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:52.860976    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:52.861237 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.861217    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:52.861326 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.861292    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 13:59:56.861272503 +0000 UTC m=+10.095791958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:52.962190 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:52.962142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:52.962399 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.962314    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:52.962399 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.962336    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:52.962399 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.962349    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:52.962591 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:52.962407    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 13:59:56.962389041 +0000 UTC m=+10.196908492 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:53.277714 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:53.277419    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:53.277714 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:53.277560    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 13:59:53.282748 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:53.280668    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:53.282748 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:53.280857    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 13:59:54.276745 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:54.276713    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:54.276917 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:54.276838    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 13:59:55.276352 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:55.276319    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:55.276867 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:55.276431    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 13:59:55.276867 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:55.276472    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:55.276867 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:55.276602    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 13:59:56.276979 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:56.276524    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:56.276979 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.276646    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 13:59:56.796168 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:56.796121    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:56.796361 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.796337    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:56.796429 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.796404    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:04.796384404 +0000 UTC m=+18.030903869 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 13:59:56.897295 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:56.897196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:56.897471 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.897369    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:56.897471 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.897438    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 14:00:04.897417672 +0000 UTC m=+18.131937126 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 13:59:56.998240 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:56.998197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:56.998473 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.998454    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 13:59:56.998537 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.998482    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 13:59:56.998537 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.998496    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:56.998636 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:56.998564    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:04.998542593 +0000 UTC m=+18.233062059 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 13:59:57.277396 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:57.277338    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:57.277396 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:57.277364    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:57.278066 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:57.277478    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 13:59:57.278066 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:57.277620    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 13:59:58.276802 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:58.276258    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 13:59:58.276802 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:58.276387    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 13:59:59.277109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:59.276748    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 13:59:59.277109 ip-10-0-141-71 kubenswrapper[2558]: I0728 13:59:59.276797    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 13:59:59.277109 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:59.276890    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 13:59:59.277109 ip-10-0-141-71 kubenswrapper[2558]: E0728 13:59:59.277057    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:00.276179 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:00.276147    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:00.276373 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:00.276272    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:01.276539 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:01.276506    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:01.277014 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:01.276507    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:01.277014 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:01.276662    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:01.277014 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:01.276698    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:02.276868 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:02.276837    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:02.277339 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:02.276966    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:03.276152 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:03.276109    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:03.276323 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:03.276109    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:03.276323 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:03.276247    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:03.276456 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:03.276343    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:04.276873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:04.276839    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:04.277467 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:04.276972    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:04.863455 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:04.863418    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:04.863617 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:04.863532    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:04.863617 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:04.863589    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:20.8635751 +0000 UTC m=+34.098094550 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:04.964710 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:04.964672    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:04.964839 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:04.964818    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:04.964895 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:04.964886    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 14:00:20.964870683 +0000 UTC m=+34.199390133 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:05.065464 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:05.065425    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:05.065656 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:05.065584    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 14:00:05.065656 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:05.065607    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 14:00:05.065656 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:05.065619    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:05.065821 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:05.065669    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:21.065656677 +0000 UTC m=+34.300176127 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:05.276034 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:05.275985    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:05.276213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:05.276042    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:05.276213 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:05.276140    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:05.276334 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:05.276283    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:06.275983 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:06.275951    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:06.276442 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:06.276089    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:07.277199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:07.277096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:07.277199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:07.277104    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:07.277691 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:07.277221    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:07.277691 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:07.277329    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:08.276188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:08.276159    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:08.276378 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:08.276281    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:09.276694 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.276521    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:09.277344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.276522    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:09.277344 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:09.276770    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:09.277344 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:09.276901    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:09.352811 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.352771    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nbmn2" event={"ID":"539fbdf4-b8da-4852-a4ae-e55d5a98a7da","Type":"ContainerStarted","Data":"0e3701f8ed46170e271ad1d9bfb15afde94e201b53fc1650834f29907ab5b930"}
Jul 28 14:00:09.354240 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.354213    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4sdxn" event={"ID":"f849cc24-20cf-4f7e-a104-58a9d1ed9a9b","Type":"ContainerStarted","Data":"69f4a15d2da0508785840efaeb193c0790f87d35adf6014fb21c8d1f9ccbd909"}
Jul 28 14:00:09.355580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.355557    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"5556c3cfec26a53f23442b5e40780da18270d0b4984223331e0062e9a4dfabe1"}
Jul 28 14:00:09.356797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.356777    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g" event={"ID":"6a427e57-f24e-4688-bcab-616659927837","Type":"ContainerStarted","Data":"b93b279ba8a64f3cd205fab332950d5bf5ddbcc3279e3b7f24ba752e855bd6cc"}
Jul 28 14:00:09.358093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.358074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lbxcs" event={"ID":"0e467769-8086-4a54-86fd-576aee1b4554","Type":"ContainerStarted","Data":"9b5e86c8e145b9c2da63f884363650db9eed2d4d71768dac2ed49ad3dc6f130e"}
Jul 28 14:00:09.359547 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.359529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c977w" event={"ID":"ba612107-ebfe-4a59-a4ae-7649e3178e63","Type":"ContainerStarted","Data":"5c80d5e656d392ce30a0dd0d29a850178edd6e3c648500c82f09cdd904411253"}
Jul 28 14:00:09.360785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.360766    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-26bqb" event={"ID":"13bd51b3-dfc8-4c90-af9a-d96a4da7a653","Type":"ContainerStarted","Data":"63edea2e9934f18956b7da674da90e9392a7844cf1756a94691b20bc1961e822"}
Jul 28 14:00:09.362184 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.362164    2558 generic.go:356] "Generic (PLEG): container finished" podID="75a367f6-72e8-45c8-9ccd-dbcc78c4f911" containerID="8c404d5f9dc5d955b69fd688f4e8bfebf33642ebeafbfdffee99be07227a9f54" exitCode=0
Jul 28 14:00:09.362304 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.362191    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerDied","Data":"8c404d5f9dc5d955b69fd688f4e8bfebf33642ebeafbfdffee99be07227a9f54"}
Jul 28 14:00:09.369529 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.369480    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nbmn2" podStartSLOduration=3.758470464 podStartE2EDuration="22.369459045s" totalImagesPullingTime="18.610988581s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:09.369347688 +0000 UTC m=+22.603867160" watchObservedRunningTime="2026-07-28 14:00:09.369459045 +0000 UTC m=+22.603978519"
Jul 28 14:00:09.369616 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.369584    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-71.ec2.internal" podStartSLOduration=21.369575936 podStartE2EDuration="21.369575936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 13:59:52.334899852 +0000 UTC m=+5.569419324" watchObservedRunningTime="2026-07-28 14:00:09.369575936 +0000 UTC m=+22.604095411"
Jul 28 14:00:09.409799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.409757    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-4sdxn" podStartSLOduration=3.804240563 podStartE2EDuration="22.409742474s" totalImagesPullingTime="18.605501911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:09.386221389 +0000 UTC m=+22.620740860" watchObservedRunningTime="2026-07-28 14:00:09.409742474 +0000 UTC m=+22.644261937"
Jul 28 14:00:09.427802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.427756    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c977w" podStartSLOduration=3.881249431 podStartE2EDuration="22.427738865s" totalImagesPullingTime="18.546489434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:09.427407842 +0000 UTC m=+22.661927313" watchObservedRunningTime="2026-07-28 14:00:09.427738865 +0000 UTC m=+22.662258337"
Jul 28 14:00:09.447670 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.447629    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lbxcs" podStartSLOduration=3.5293996869999997 podStartE2EDuration="22.447611632s" totalImagesPullingTime="18.918211945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:09.447057651 +0000 UTC m=+22.681577122" watchObservedRunningTime="2026-07-28 14:00:09.447611632 +0000 UTC m=+22.682131103"
Jul 28 14:00:09.464386 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:09.464345    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-26bqb" podStartSLOduration=3.85314231 podStartE2EDuration="22.464330092s" totalImagesPullingTime="18.611187782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:09.464054578 +0000 UTC m=+22.698574042" watchObservedRunningTime="2026-07-28 14:00:09.464330092 +0000 UTC m=+22.698849564"
Jul 28 14:00:10.276254 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.276221    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:10.276438 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:10.276346    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:10.368359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.368326    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:00:10.368976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.368931    2558 generic.go:356] "Generic (PLEG): container finished" podID="c8d4e7a4-f8bf-4673-90bc-fe4f05155d60" containerID="ed54e197fbe1e80e395f5b3b62757520d114aad74e35a18fc09e5f793496f334" exitCode=1
Jul 28 14:00:10.369055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.368990    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"31915cd473d918868dfd6d56b52da737d959cc1d1b0a66e6635d4be1b604d006"}
Jul 28 14:00:10.369162 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.369147    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"a9f9ff57cfd5e7a055e56b2f6bdcf6df50dc9af192fabf3573f1909f781f3259"}
Jul 28 14:00:10.369234 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.369189    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"9153296c4828d941de5054de7bb4aaf204bcafb726605c67de17180020615aee"}
Jul 28 14:00:10.369289 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.369233    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"716bb1e6434d06c4a0a03dcb0ef2bc346a65f64027ba0cec4f61586e1854325a"}
Jul 28 14:00:10.369289 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.369282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerDied","Data":"ed54e197fbe1e80e395f5b3b62757520d114aad74e35a18fc09e5f793496f334"}
Jul 28 14:00:10.371409 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.371314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jc4r7" event={"ID":"ed49a9a2-942e-41b6-bb67-f9c60430dd67","Type":"ContainerStarted","Data":"2e18f2776290e6bc0768318d8483cae7781ae11f7a9ddac63413d27014f1b0cf"}
Jul 28 14:00:10.389038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.388949    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jc4r7" podStartSLOduration=4.786505078 podStartE2EDuration="23.388932025s" totalImagesPullingTime="18.602426947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:10.388218907 +0000 UTC m=+23.622738379" watchObservedRunningTime="2026-07-28 14:00:10.388932025 +0000 UTC m=+23.623451499"
Jul 28 14:00:10.698689 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:10.698662    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 14:00:11.184218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.184091    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T14:00:10.698684112Z","UUID":"3fe290ba-8fe2-4c25-bc78-d228ed4b7491","Handler":null,"Name":"","Endpoint":""}
Jul 28 14:00:11.185685 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.185662    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 14:00:11.185822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.185710    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 14:00:11.276791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.276747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:11.276791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.276747    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:11.277009 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:11.276897    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:11.277112 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:11.277078    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:11.375086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.375048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g" event={"ID":"6a427e57-f24e-4688-bcab-616659927837","Type":"ContainerStarted","Data":"4f0013b68c87bac820fa644461fb4fb65815b0285cabc74665617bc7a19545ba"}
Jul 28 14:00:11.608818 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.608786    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c977w"
Jul 28 14:00:11.609437 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:11.609411    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c977w"
Jul 28 14:00:12.276206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:12.276172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:12.276378 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:12.276281    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:13.276736 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:13.276702    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:13.277122 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:13.276856    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:13.277122 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:13.276911    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:13.277122 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:13.277001    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:13.382444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:13.382290    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:00:13.382808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:13.382783    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"842cf406ecbac51cb1e44b3cb3c15c83cc70b4d74312597c58f3d833e7ef0760"}
Jul 28 14:00:14.276468 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:14.276440    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:14.276617 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:14.276533    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:14.387469 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:14.387434    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g" event={"ID":"6a427e57-f24e-4688-bcab-616659927837","Type":"ContainerStarted","Data":"ce72d35e840abe81dbbd4f85ec558f671aeccae1b5eeb375113a09e5f76bd5a9"}
Jul 28 14:00:14.389244 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:14.389219    2558 generic.go:356] "Generic (PLEG): container finished" podID="75a367f6-72e8-45c8-9ccd-dbcc78c4f911" containerID="5530eafd65ea746e32e97eba778ce42d36cda775103afa8a1aaed6fadb1e537b" exitCode=0
Jul 28 14:00:14.389364 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:14.389259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerDied","Data":"5530eafd65ea746e32e97eba778ce42d36cda775103afa8a1aaed6fadb1e537b"}
Jul 28 14:00:14.408275 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:14.408236    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rks9g" podStartSLOduration=4.043833679 podStartE2EDuration="27.408222385s" totalImagesPullingTime="23.364388706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:14.407829008 +0000 UTC m=+27.642348479" watchObservedRunningTime="2026-07-28 14:00:14.408222385 +0000 UTC m=+27.642741857"
Jul 28 14:00:15.098200 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:15.098170    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c977w"
Jul 28 14:00:15.098374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:15.098322    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 28 14:00:15.098814 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:15.098787    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c977w"
Jul 28 14:00:15.276548 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:15.276510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:15.276548 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:15.276535    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:15.276794 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:15.276650    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:15.276794 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:15.276769    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:16.276170 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.275967    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:16.276741 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:16.276248    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:16.394992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.394952    2558 generic.go:356] "Generic (PLEG): container finished" podID="75a367f6-72e8-45c8-9ccd-dbcc78c4f911" containerID="0c859d29abe90d0bf15898bcc63bf25d0ee49520d4d367867bb4f57938717c6f" exitCode=0
Jul 28 14:00:16.395233 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.395058    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerDied","Data":"0c859d29abe90d0bf15898bcc63bf25d0ee49520d4d367867bb4f57938717c6f"}
Jul 28 14:00:16.398610 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.398594    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:00:16.398944 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.398921    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"c333fe7a67d5a554166441ddb094f6936c5695a1eb6a95ba1eeee21c6e5a5252"}
Jul 28 14:00:16.399231 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.399218    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 14:00:16.399322 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.399271    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 14:00:16.399412 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.399398    2558 scope.go:117] "RemoveContainer" containerID="ed54e197fbe1e80e395f5b3b62757520d114aad74e35a18fc09e5f793496f334"
Jul 28 14:00:16.416321 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:16.416170    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 14:00:17.276723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.276684    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:17.277242 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:17.276801    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:17.277242 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.276845    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:17.277242 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:17.276926    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:17.406912 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.406883    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:00:17.407397 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.407372    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" event={"ID":"c8d4e7a4-f8bf-4673-90bc-fe4f05155d60","Type":"ContainerStarted","Data":"679494023da5e6770fed8fb463b46e00352264347b1d36ed9499ca5a4f4a540b"}
Jul 28 14:00:17.407711 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.407694    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 14:00:17.423801 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.423776    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 14:00:17.438240 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:17.438095    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx" podStartSLOduration=11.390450006 podStartE2EDuration="30.438075201s" totalImagesPullingTime="19.047625195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:17.436772544 +0000 UTC m=+30.671292039" watchObservedRunningTime="2026-07-28 14:00:17.438075201 +0000 UTC m=+30.672594673"
Jul 28 14:00:18.012402 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.012367    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jhwls"]
Jul 28 14:00:18.012575 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.012558    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:18.012704 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:18.012673    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:18.019598 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.019524    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bc5tq"]
Jul 28 14:00:18.019717 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.019646    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:18.019778 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:18.019752    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:18.020029 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.019999    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ndp9"]
Jul 28 14:00:18.020111 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.020100    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:18.020202 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:18.020184    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:18.412162 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.412077    2558 generic.go:356] "Generic (PLEG): container finished" podID="75a367f6-72e8-45c8-9ccd-dbcc78c4f911" containerID="e75e76a96f62276809476c108bccd9804387a0fdd9ff3adfe8434519527ed027" exitCode=0
Jul 28 14:00:18.412615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:18.412159    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerDied","Data":"e75e76a96f62276809476c108bccd9804387a0fdd9ff3adfe8434519527ed027"}
Jul 28 14:00:20.276442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:20.276407    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:20.277139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:20.276453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:20.277139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:20.276453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:20.277139 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.276531    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:20.277139 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.276632    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:20.277139 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.276731    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:20.889075 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:20.889043    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:20.889256 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.889207    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:20.889303 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.889280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs podName:83df7d59-5e78-481b-8a96-61e4c7123aa1 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:52.889260437 +0000 UTC m=+66.123779904 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs") pod "network-metrics-daemon-6ndp9" (UID: "83df7d59-5e78-481b-8a96-61e4c7123aa1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 14:00:20.990198 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:20.990167    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:20.990374 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.990277    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:20.990374 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:20.990339    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret podName:7e8e4996-66ef-4e59-b750-4aaff0ed34da nodeName:}" failed. No retries permitted until 2026-07-28 14:00:52.990322823 +0000 UTC m=+66.224842279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret") pod "global-pull-secret-syncer-bc5tq" (UID: "7e8e4996-66ef-4e59-b750-4aaff0ed34da") : object "kube-system"/"original-pull-secret" not registered
Jul 28 14:00:21.091116 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:21.091085    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:21.091301 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:21.091274    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 14:00:21.091301 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:21.091299    2558 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 14:00:21.091418 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:21.091313    2558 projected.go:196] Error preparing data for projected volume kube-api-access-98fkm for pod openshift-network-diagnostics/network-check-target-jhwls: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:21.091418 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:21.091379    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm podName:bb7ee17f-dbcd-46db-8706-e32e83958f9c nodeName:}" failed. No retries permitted until 2026-07-28 14:00:53.091358856 +0000 UTC m=+66.325878322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-98fkm" (UniqueName: "kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm") pod "network-check-target-jhwls" (UID: "bb7ee17f-dbcd-46db-8706-e32e83958f9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 14:00:22.276812 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.276775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:22.277466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.276775    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:22.277466 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.276894    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jhwls" podUID="bb7ee17f-dbcd-46db-8706-e32e83958f9c"
Jul 28 14:00:22.277466 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.276996    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6ndp9" podUID="83df7d59-5e78-481b-8a96-61e4c7123aa1"
Jul 28 14:00:22.277466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.276779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:22.277466 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.277123    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc5tq" podUID="7e8e4996-66ef-4e59-b750-4aaff0ed34da"
Jul 28 14:00:22.595338 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.595319    2558 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-71.ec2.internal" event="NodeReady"
Jul 28 14:00:22.595449 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.595441    2558 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 14:00:22.649122 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.649077    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-9vh9b"]
Jul 28 14:00:22.651631 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.651611    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f5648477f-28pzp"]
Jul 28 14:00:22.651752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.651733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.654215 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.654189    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 14:00:22.654329 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.654228    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4vfd5\""
Jul 28 14:00:22.654329 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.654245    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 14:00:22.656263 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.656213    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-842zc"]
Jul 28 14:00:22.656490 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.656414    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.658622 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.658606    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 14:00:22.658941 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.658928    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 14:00:22.659484 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.659465    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mljsl\""
Jul 28 14:00:22.659589 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.659497    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 14:00:22.659887 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.659871    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.663945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.663848    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 14:00:22.663945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.663899    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 14:00:22.664123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.664085    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 14:00:22.664300 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.664282    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wzr9c\""
Jul 28 14:00:22.665412 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.665395    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-842zc"]
Jul 28 14:00:22.665667 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.665647    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 14:00:22.666128 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.666109    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vh9b"]
Jul 28 14:00:22.670274 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.670254    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f5648477f-28pzp"]
Jul 28 14:00:22.772579 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.772548    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:22.805709 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805632    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-installation-pull-secrets\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.805709 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ce1244-dcc1-464b-8971-15b4a0363402-cert\") pod \"ingress-canary-842zc\" (UID: \"87ce1244-dcc1-464b-8971-15b4a0363402\") " pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.805709 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805709    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-bound-sa-token\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.805954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805733    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.805954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805814    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4604fc28-4ec7-46ad-bef8-1275763faf66-tmp-dir\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.805954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805847    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f9e9106-6688-4c8e-ae03-493bde7b5643-ca-trust-extracted\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.805954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805871    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-trusted-ca\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.805954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-image-registry-private-configuration\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.806169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.806169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.805996    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jcg8\" (UniqueName: \"kubernetes.io/projected/87ce1244-dcc1-464b-8971-15b4a0363402-kube-api-access-4jcg8\") pod \"ingress-canary-842zc\" (UID: \"87ce1244-dcc1-464b-8971-15b4a0363402\") " pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.806169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.806039    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpkqn\" (UniqueName: \"kubernetes.io/projected/4604fc28-4ec7-46ad-bef8-1275763faf66-kube-api-access-zpkqn\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.806169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.806097    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4604fc28-4ec7-46ad-bef8-1275763faf66-config-volume\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.806169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.806121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-certificates\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.806169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.806145    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnpsb\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-kube-api-access-vnpsb\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.885366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.885338    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:22.907443 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-image-registry-private-configuration\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.907443 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907449    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907470    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jcg8\" (UniqueName: \"kubernetes.io/projected/87ce1244-dcc1-464b-8971-15b4a0363402-kube-api-access-4jcg8\") pod \"ingress-canary-842zc\" (UID: \"87ce1244-dcc1-464b-8971-15b4a0363402\") " pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpkqn\" (UniqueName: \"kubernetes.io/projected/4604fc28-4ec7-46ad-bef8-1275763faf66-kube-api-access-zpkqn\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907504    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4604fc28-4ec7-46ad-bef8-1275763faf66-config-volume\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-certificates\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907536    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnpsb\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-kube-api-access-vnpsb\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907570    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-installation-pull-secrets\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.907572    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 14:00:22.907603 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.907600    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5648477f-28pzp: secret "image-registry-tls" not found
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.907663    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls podName:8f9e9106-6688-4c8e-ae03-493bde7b5643 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:23.407643318 +0000 UTC m=+36.642162778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls") pod "image-registry-f5648477f-28pzp" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643") : secret "image-registry-tls" not found
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ce1244-dcc1-464b-8971-15b4a0363402-cert\") pod \"ingress-canary-842zc\" (UID: \"87ce1244-dcc1-464b-8971-15b4a0363402\") " pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-bound-sa-token\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907841    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4604fc28-4ec7-46ad-bef8-1275763faf66-tmp-dir\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907864    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f9e9106-6688-4c8e-ae03-493bde7b5643-ca-trust-extracted\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.907885    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-trusted-ca\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.907975    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:22.908076 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:22.908045    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls podName:4604fc28-4ec7-46ad-bef8-1275763faf66 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:23.408009865 +0000 UTC m=+36.642529331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls") pod "dns-default-9vh9b" (UID: "4604fc28-4ec7-46ad-bef8-1275763faf66") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:22.908560 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.908294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4604fc28-4ec7-46ad-bef8-1275763faf66-tmp-dir\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.908560 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.908329    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4604fc28-4ec7-46ad-bef8-1275763faf66-config-volume\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.908560 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.908348    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-certificates\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.908560 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.908518    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f9e9106-6688-4c8e-ae03-493bde7b5643-ca-trust-extracted\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.908846 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.908826    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-trusted-ca\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.911621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.911599    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-installation-pull-secrets\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.911734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.911640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-image-registry-private-configuration\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.911734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.911702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/87ce1244-dcc1-464b-8971-15b4a0363402-cert\") pod \"ingress-canary-842zc\" (UID: \"87ce1244-dcc1-464b-8971-15b4a0363402\") " pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.916318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.916291    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpkqn\" (UniqueName: \"kubernetes.io/projected/4604fc28-4ec7-46ad-bef8-1275763faf66-kube-api-access-zpkqn\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:22.916583 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.916555    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-bound-sa-token\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.916917 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.916876    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jcg8\" (UniqueName: \"kubernetes.io/projected/87ce1244-dcc1-464b-8971-15b4a0363402-kube-api-access-4jcg8\") pod \"ingress-canary-842zc\" (UID: \"87ce1244-dcc1-464b-8971-15b4a0363402\") " pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:22.917202 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.917186    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnpsb\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-kube-api-access-vnpsb\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:22.980415 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:22.980375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-842zc"
Jul 28 14:00:23.111998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.111941    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-842zc"]
Jul 28 14:00:23.115473 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:23.115448    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ce1244_dcc1_464b_8971_15b4a0363402.slice/crio-07338749c0856405f6eb469d0f5010c9458559e02cb05577674d43c671197f0f WatchSource:0}: Error finding container 07338749c0856405f6eb469d0f5010c9458559e02cb05577674d43c671197f0f: Status 404 returned error can't find the container with id 07338749c0856405f6eb469d0f5010c9458559e02cb05577674d43c671197f0f
Jul 28 14:00:23.410834 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.410742    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:23.411375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.410880    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:23.411375 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:23.410881    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:23.411375 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:23.410984    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 14:00:23.411375 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:23.411004    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5648477f-28pzp: secret "image-registry-tls" not found
Jul 28 14:00:23.411375 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:23.411055    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls podName:4604fc28-4ec7-46ad-bef8-1275763faf66 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:24.41100517 +0000 UTC m=+37.645524637 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls") pod "dns-default-9vh9b" (UID: "4604fc28-4ec7-46ad-bef8-1275763faf66") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:23.411375 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:23.411075    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls podName:8f9e9106-6688-4c8e-ae03-493bde7b5643 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:24.41106582 +0000 UTC m=+37.645585269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls") pod "image-registry-f5648477f-28pzp" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643") : secret "image-registry-tls" not found
Jul 28 14:00:23.423246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.423217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:23.426944 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.426916    2558 generic.go:356] "Generic (PLEG): container finished" podID="75a367f6-72e8-45c8-9ccd-dbcc78c4f911" containerID="a44abca1125a44cc524bfb0022950dfe73f33be9decfb4254c82d9f830a8f2cc" exitCode=0
Jul 28 14:00:23.427088 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.427006    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerDied","Data":"a44abca1125a44cc524bfb0022950dfe73f33be9decfb4254c82d9f830a8f2cc"}
Jul 28 14:00:23.428343 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.428097    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-842zc" event={"ID":"87ce1244-dcc1-464b-8971-15b4a0363402","Type":"ContainerStarted","Data":"07338749c0856405f6eb469d0f5010c9458559e02cb05577674d43c671197f0f"}
Jul 28 14:00:23.488004 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.487970    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:23.626232 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:23.626195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:24.135467 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.135427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:24.235097 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.235062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:24.276132 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.276096    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:24.276132 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.276118    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:24.276376 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.276233    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:24.279166 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.279141    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 14:00:24.279296 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.279143    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 14:00:24.280200 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.280180    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vgxlf\""
Jul 28 14:00:24.280332 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.280233    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 14:00:24.280332 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.280302    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 14:00:24.280456 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.280326    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96fnv\""
Jul 28 14:00:24.416972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.416896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:24.417337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.416960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:24.417337 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:24.417101    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 14:00:24.417337 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:24.417128    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5648477f-28pzp: secret "image-registry-tls" not found
Jul 28 14:00:24.417337 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:24.417109    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:24.417337 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:24.417250    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls podName:8f9e9106-6688-4c8e-ae03-493bde7b5643 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:26.417230661 +0000 UTC m=+39.651750122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls") pod "image-registry-f5648477f-28pzp" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643") : secret "image-registry-tls" not found
Jul 28 14:00:24.417337 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:24.417267    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls podName:4604fc28-4ec7-46ad-bef8-1275763faf66 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:26.417259737 +0000 UTC m=+39.651779187 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls") pod "dns-default-9vh9b" (UID: "4604fc28-4ec7-46ad-bef8-1275763faf66") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:24.433682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.433644    2558 generic.go:356] "Generic (PLEG): container finished" podID="75a367f6-72e8-45c8-9ccd-dbcc78c4f911" containerID="b6e7927ee743ef03e76113f528e96ede0ad755f095202070d0478f8c8a02d637" exitCode=0
Jul 28 14:00:24.433841 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:24.433706    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerDied","Data":"b6e7927ee743ef03e76113f528e96ede0ad755f095202070d0478f8c8a02d637"}
Jul 28 14:00:25.439765 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:25.439532    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" event={"ID":"75a367f6-72e8-45c8-9ccd-dbcc78c4f911","Type":"ContainerStarted","Data":"acdb975f6b812d9a331a8c3833f7f767960815ae9056b5b1af9e10760080a7dc"}
Jul 28 14:00:25.467300 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:25.467256    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x5h2j" podStartSLOduration=9.161107362 podStartE2EDuration="38.467240739s" totalImagesPullingTime="29.306133377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:25.466799105 +0000 UTC m=+38.701318582" watchObservedRunningTime="2026-07-28 14:00:25.467240739 +0000 UTC m=+38.701760210"
Jul 28 14:00:25.594039 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:25.593995    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:25.692813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:25.692726    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:25.754724 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:25.754685    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:26.430784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:26.430755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:26.430966 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:26.430912    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 14:00:26.430966 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:26.430931    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5648477f-28pzp: secret "image-registry-tls" not found
Jul 28 14:00:26.431123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:26.430914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:26.431123 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:26.430989    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls podName:8f9e9106-6688-4c8e-ae03-493bde7b5643 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:30.430963561 +0000 UTC m=+43.665483016 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls") pod "image-registry-f5648477f-28pzp" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643") : secret "image-registry-tls" not found
Jul 28 14:00:26.431123 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:26.431012    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:26.431123 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:26.431092    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls podName:4604fc28-4ec7-46ad-bef8-1275763faf66 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:30.431074316 +0000 UTC m=+43.665593766 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls") pod "dns-default-9vh9b" (UID: "4604fc28-4ec7-46ad-bef8-1275763faf66") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:26.446309 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:26.446282    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-842zc" event={"ID":"87ce1244-dcc1-464b-8971-15b4a0363402","Type":"ContainerStarted","Data":"c7695980b6ed6a09f659dc2f015c133ff4402b1fabe60da27da9e9bc38d52138"}
Jul 28 14:00:26.464029 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:26.463983    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-842zc" podStartSLOduration=2.24743413 podStartE2EDuration="4.463965443s" totalImagesPullingTime="2.216531313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:26.46344544 +0000 UTC m=+39.697964966" watchObservedRunningTime="2026-07-28 14:00:26.463965443 +0000 UTC m=+39.698484916"
Jul 28 14:00:27.640256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:27.640218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:27.744580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:27.744545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:28.671113 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:28.671075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:28.770523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:28.770492    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:29.961921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:29.961886    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:30.081429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.081392    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7bw4s"]
Jul 28 14:00:30.082791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.081460    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:30.116101 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.116068    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7bw4s"]
Jul 28 14:00:30.116238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.116197    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.118533 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.118503    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 14:00:30.118654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.118592    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 14:00:30.118654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.118624    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 14:00:30.118654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.118636    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-m7nzk\""
Jul 28 14:00:30.119462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.119440    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 14:00:30.159914 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.159886    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq8r7\" (UniqueName: \"kubernetes.io/projected/69e07e8f-f868-4af9-ac6f-75d410526587-kube-api-access-mq8r7\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.160080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.159937    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e07e8f-f868-4af9-ac6f-75d410526587-data-volume\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.160080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.160051    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.160206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.160118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69e07e8f-f868-4af9-ac6f-75d410526587-crio-socket\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.160206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.160147    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.162515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.162494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:30.261231 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69e07e8f-f868-4af9-ac6f-75d410526587-crio-socket\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.261380 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.261380 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261280    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mq8r7\" (UniqueName: \"kubernetes.io/projected/69e07e8f-f868-4af9-ac6f-75d410526587-kube-api-access-mq8r7\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.261380 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261333    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e07e8f-f868-4af9-ac6f-75d410526587-data-volume\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.261537 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261400    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.261537 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.261414    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.261537 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.261507    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.261537 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.261516    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:30.761500985 +0000 UTC m=+43.996020440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.261692 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261412    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/69e07e8f-f868-4af9-ac6f-75d410526587-crio-socket\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.261692 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.261583    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:30.76156603 +0000 UTC m=+43.996085500 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.261760 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.261700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e07e8f-f868-4af9-ac6f-75d410526587-data-volume\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.272182 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.272162    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq8r7\" (UniqueName: \"kubernetes.io/projected/69e07e8f-f868-4af9-ac6f-75d410526587-kube-api-access-mq8r7\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.462661 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.462630    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:30.462820 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.462698    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:30.462820 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.462786    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 14:00:30.462820 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.462797    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:30.462820 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.462802    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5648477f-28pzp: secret "image-registry-tls" not found
Jul 28 14:00:30.462952 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.462870    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls podName:4604fc28-4ec7-46ad-bef8-1275763faf66 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:38.462855374 +0000 UTC m=+51.697374824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls") pod "dns-default-9vh9b" (UID: "4604fc28-4ec7-46ad-bef8-1275763faf66") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:30.462952 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.462884    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls podName:8f9e9106-6688-4c8e-ae03-493bde7b5643 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:38.462878682 +0000 UTC m=+51.697398132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls") pod "image-registry-f5648477f-28pzp" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643") : secret "image-registry-tls" not found
Jul 28 14:00:30.598340 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.598216    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:30.684475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.684419    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:30.764745 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.764711    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.764883 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:30.764763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:30.764883 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.764828    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.764952 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.764886    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:30.764952 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.764893    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:31.764876669 +0000 UTC m=+44.999396122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:30.764952 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:30.764926    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:31.764915125 +0000 UTC m=+44.999434576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:31.057076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.057014    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:31.155955 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.155909    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:31.299320 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.299284    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:31.438114 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.438001    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:31.738277 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.738163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:31.773361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.773322    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:31.773505 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.773375    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:31.773505 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:31.773457    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:31.773505 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:31.773472    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:31.773625 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:31.773524    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:33.773508355 +0000 UTC m=+47.008027805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:31.773625 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:31.773539    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:33.773532197 +0000 UTC m=+47.008051646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:31.837638 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:31.837606    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:32.647207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:32.647178    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4sdxn_f849cc24-20cf-4f7e-a104-58a9d1ed9a9b/dns-node-resolver/0.log"
Jul 28 14:00:32.937129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:32.937054    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:32.997639 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:32.997602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:33.789936 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:33.789894    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:33.790358 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:33.789949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:33.790358 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:33.790049    2558 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 14:00:33.790358 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:33.790110    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:37.790095693 +0000 UTC m=+51.024615143 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : configmap "kube-rbac-proxy" not found
Jul 28 14:00:33.790358 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:33.790175    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:33.790358 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:33.790218    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:37.790207763 +0000 UTC m=+51.024727213 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:33.848993 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:33.848964    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbmn2_539fbdf4-b8da-4852-a4ae-e55d5a98a7da/node-ca/0.log"
Jul 28 14:00:33.920694 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:33.920662    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:34.446738 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:34.446709    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-842zc_87ce1244-dcc1-464b-8971-15b4a0363402/serve-healthcheck-canary/0.log"
Jul 28 14:00:35.127839 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:35.127793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:36.971834 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:36.971795    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:37.707066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:37.707032    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:37.773804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:37.773768    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:37.819918 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:37.819890    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:37.820042 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:37.819937    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:37.820091 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:37.820054    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:37.820125 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:37.820112    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls podName:69e07e8f-f868-4af9-ac6f-75d410526587 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:45.820093335 +0000 UTC m=+59.054612785 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls") pod "insights-runtime-extractor-7bw4s" (UID: "69e07e8f-f868-4af9-ac6f-75d410526587") : secret "insights-runtime-extractor-tls" not found
Jul 28 14:00:37.827779 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:37.827758    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/69e07e8f-f868-4af9-ac6f-75d410526587-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:38.006149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.006118    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:38.107717 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.107682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:38.220489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.220457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:38.306532 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.306459    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:38.367486 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.367444    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:38.525578 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.525540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:38.525768 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.525608    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:38.525768 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:38.525694    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 14:00:38.525768 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:38.525695    2558 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 14:00:38.525768 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:38.525768    2558 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f5648477f-28pzp: secret "image-registry-tls" not found
Jul 28 14:00:38.525899 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:38.525741    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls podName:4604fc28-4ec7-46ad-bef8-1275763faf66 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:54.525729014 +0000 UTC m=+67.760248464 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls") pod "dns-default-9vh9b" (UID: "4604fc28-4ec7-46ad-bef8-1275763faf66") : secret "dns-default-metrics-tls" not found
Jul 28 14:00:38.525899 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:38.525824    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls podName:8f9e9106-6688-4c8e-ae03-493bde7b5643 nodeName:}" failed. No retries permitted until 2026-07-28 14:00:54.525811067 +0000 UTC m=+67.760330517 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls") pod "image-registry-f5648477f-28pzp" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643") : secret "image-registry-tls" not found
Jul 28 14:00:38.644278 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.644204    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:38.971299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:38.971219    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:39.297059 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:39.297010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:39.700308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:39.700226    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:40.054073 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:40.054045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:40.148376 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:40.148344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:40.497281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:40.497247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:41.033235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:41.033198    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:41.133893 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:41.133858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:41.661158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:41.661127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:41.740676 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:41.740637    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:41.890763 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:41.890735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:42.291242 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:42.291209    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:42.493686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:42.493654    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:42.894164 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:42.894134    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:43.695030 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:43.694997    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:43.891147 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:43.891117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:44.097571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:44.097539    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:44.198511 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:44.198482    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:44.300741 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:44.300713    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:45.352587 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:45.352555    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:45.498998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:45.498967    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:45.881717 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:45.881681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:45.883943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:45.883921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/69e07e8f-f868-4af9-ac6f-75d410526587-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7bw4s\" (UID: \"69e07e8f-f868-4af9-ac6f-75d410526587\") " pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:45.895056 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:45.895029    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:46.024906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:46.024870    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7bw4s"
Jul 28 14:00:46.090303 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:46.090275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:46.147984 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:46.147896    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7bw4s"]
Jul 28 14:00:46.492784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:46.492755    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bw4s" event={"ID":"69e07e8f-f868-4af9-ac6f-75d410526587","Type":"ContainerStarted","Data":"3e6e5be6d1a264b2436f78741d39679ea8cf7d81cf1737eb75f7e8b907cd4f50"}
Jul 28 14:00:46.692482 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:46.692441    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:47.539204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:47.539173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:47.820285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:47.820191    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:47.920129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:47.920097    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:48.290427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:48.290388    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:48.497985 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:48.497944    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:48.693376 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:48.693295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:49.426497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:49.426467    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j2qbx"
Jul 28 14:00:51.507833 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:51.507796    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bw4s" event={"ID":"69e07e8f-f868-4af9-ac6f-75d410526587","Type":"ContainerStarted","Data":"cde2ff73099c1d9e4e5ccde75916922a03c8d6ee300b3f48671309564819358c"}
Jul 28 14:00:52.940131 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:52.939857    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:52.944138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:52.944109    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 14:00:52.953224 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:52.953191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83df7d59-5e78-481b-8a96-61e4c7123aa1-metrics-certs\") pod \"network-metrics-daemon-6ndp9\" (UID: \"83df7d59-5e78-481b-8a96-61e4c7123aa1\") " pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:53.040563 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.040513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:53.043742 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.043716    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 14:00:53.053836 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.053810    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7e8e4996-66ef-4e59-b750-4aaff0ed34da-original-pull-secret\") pod \"global-pull-secret-syncer-bc5tq\" (UID: \"7e8e4996-66ef-4e59-b750-4aaff0ed34da\") " pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:53.097468 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.097439    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-96fnv\""
Jul 28 14:00:53.100530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.100509    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc5tq"
Jul 28 14:00:53.105272 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.105254    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6ndp9"
Jul 28 14:00:53.141263 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.141229    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:53.144156 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.144127    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 14:00:53.154807 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.154784    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 14:00:53.165412 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.165386    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fkm\" (UniqueName: \"kubernetes.io/projected/bb7ee17f-dbcd-46db-8706-e32e83958f9c-kube-api-access-98fkm\") pod \"network-check-target-jhwls\" (UID: \"bb7ee17f-dbcd-46db-8706-e32e83958f9c\") " pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:53.391325 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.391295    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vgxlf\""
Jul 28 14:00:53.399437 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.399411    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:00:53.727305 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.727221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:53.777039 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.776994    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"]
Jul 28 14:00:53.845374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.845336    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"]
Jul 28 14:00:53.845691 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.845487    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:53.848399 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.848372    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 14:00:53.848624 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.848609    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 14:00:53.848809 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.848794    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 14:00:53.849046 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.849011    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 28 14:00:53.852297 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.852275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:53.876091 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.876061    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"]
Jul 28 14:00:53.876190 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.876102    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"]
Jul 28 14:00:53.876190 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.876126    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5648477f-28pzp"]
Jul 28 14:00:53.876190 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.876183    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:53.876344 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:00:53.876315    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-f5648477f-28pzp" podUID="8f9e9106-6688-4c8e-ae03-493bde7b5643"
Jul 28 14:00:53.879278 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.879257    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hlmtz\""
Jul 28 14:00:53.879384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.879316    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 28 14:00:53.879880 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.879860    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 28 14:00:53.908963 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.908934    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75c555dd69-mjmpx"]
Jul 28 14:00:53.945500 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.945418    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c555dd69-mjmpx"]
Jul 28 14:00:53.945940 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.945554    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:53.948222 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.948190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8h9h\" (UniqueName: \"kubernetes.io/projected/23aee5dc-8c19-4f87-979b-9acce8e288dd-kube-api-access-r8h9h\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:53.948374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.948327    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d016e616-e01b-470b-9afc-0d78b2660ac8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q5k5p\" (UID: \"d016e616-e01b-470b-9afc-0d78b2660ac8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:53.948446 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.948377    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23aee5dc-8c19-4f87-979b-9acce8e288dd-tmp\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:53.948446 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.948408    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23aee5dc-8c19-4f87-979b-9acce8e288dd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:53.948550 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.948486    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d016e616-e01b-470b-9afc-0d78b2660ac8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q5k5p\" (UID: \"d016e616-e01b-470b-9afc-0d78b2660ac8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:53.952988 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:53.952959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:54.049542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76beab67-f046-43de-9ddd-7f05a4eb7b79-installation-pull-secrets\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.049542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23aee5dc-8c19-4f87-979b-9acce8e288dd-tmp\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.049799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049575    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-bound-sa-token\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.049799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049603    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqz6g\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-kube-api-access-xqz6g\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.049799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049642    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76beab67-f046-43de-9ddd-7f05a4eb7b79-ca-trust-extracted\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.049799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049725    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d016e616-e01b-470b-9afc-0d78b2660ac8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q5k5p\" (UID: \"d016e616-e01b-470b-9afc-0d78b2660ac8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:54.049799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049769    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23aee5dc-8c19-4f87-979b-9acce8e288dd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.050100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049817    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-registry-tls\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.050100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049903    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76beab67-f046-43de-9ddd-7f05a4eb7b79-registry-certificates\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.050100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.049981    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d016e616-e01b-470b-9afc-0d78b2660ac8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q5k5p\" (UID: \"d016e616-e01b-470b-9afc-0d78b2660ac8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:54.050100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.050013    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23aee5dc-8c19-4f87-979b-9acce8e288dd-tmp\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.050310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.050107    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8h9h\" (UniqueName: \"kubernetes.io/projected/23aee5dc-8c19-4f87-979b-9acce8e288dd-kube-api-access-r8h9h\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.050310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.050144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76beab67-f046-43de-9ddd-7f05a4eb7b79-image-registry-private-configuration\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.050310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.050171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76beab67-f046-43de-9ddd-7f05a4eb7b79-trusted-ca\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.050698 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.050670    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d016e616-e01b-470b-9afc-0d78b2660ac8-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-q5k5p\" (UID: \"d016e616-e01b-470b-9afc-0d78b2660ac8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:54.052487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.052451    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d016e616-e01b-470b-9afc-0d78b2660ac8-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-q5k5p\" (UID: \"d016e616-e01b-470b-9afc-0d78b2660ac8\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:54.052905 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.052871    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/23aee5dc-8c19-4f87-979b-9acce8e288dd-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.054158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.054133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:54.061608 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.061588    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8h9h\" (UniqueName: \"kubernetes.io/projected/23aee5dc-8c19-4f87-979b-9acce8e288dd-kube-api-access-r8h9h\") pod \"klusterlet-addon-workmgr-7b6f4c7b68-jmbq8\" (UID: \"23aee5dc-8c19-4f87-979b-9acce8e288dd\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.150593 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76beab67-f046-43de-9ddd-7f05a4eb7b79-image-registry-private-configuration\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.150593 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150598    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76beab67-f046-43de-9ddd-7f05a4eb7b79-trusted-ca\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.150813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76beab67-f046-43de-9ddd-7f05a4eb7b79-installation-pull-secrets\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.150813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-bound-sa-token\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.150813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150805    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqz6g\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-kube-api-access-xqz6g\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.150934 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76beab67-f046-43de-9ddd-7f05a4eb7b79-ca-trust-extracted\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.150934 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150908    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-registry-tls\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.151034 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.150933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76beab67-f046-43de-9ddd-7f05a4eb7b79-registry-certificates\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.151719 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.151686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/76beab67-f046-43de-9ddd-7f05a4eb7b79-trusted-ca\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.151719 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.151726    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/76beab67-f046-43de-9ddd-7f05a4eb7b79-ca-trust-extracted\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.152052 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.152031    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/76beab67-f046-43de-9ddd-7f05a4eb7b79-registry-certificates\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.153437 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.153411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/76beab67-f046-43de-9ddd-7f05a4eb7b79-installation-pull-secrets\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.153558 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.153537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-registry-tls\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.153658 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.153635    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/76beab67-f046-43de-9ddd-7f05a4eb7b79-image-registry-private-configuration\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.155920 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.155891    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:54.156719 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.156698    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:00:54.162477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.162456    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-bound-sa-token\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.162813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.162795    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqz6g\" (UniqueName: \"kubernetes.io/projected/76beab67-f046-43de-9ddd-7f05a4eb7b79-kube-api-access-xqz6g\") pod \"image-registry-75c555dd69-mjmpx\" (UID: \"76beab67-f046-43de-9ddd-7f05a4eb7b79\") " pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.186677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.186636    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"
Jul 28 14:00:54.259027 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.258992    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mljsl\""
Jul 28 14:00:54.266796 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.266772    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:54.409692 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.409622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:54.508719 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.508682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:00:54.515766 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.515705    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:54.544853 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.544827    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:54.553224 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.553196    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:54.553369 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.553248    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:54.555542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.555514    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4604fc28-4ec7-46ad-bef8-1275763faf66-metrics-tls\") pod \"dns-default-9vh9b\" (UID: \"4604fc28-4ec7-46ad-bef8-1275763faf66\") " pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:54.555664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.555649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"image-registry-f5648477f-28pzp\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") " pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:54.653960 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.653927    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.653960 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.653966    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-certificates\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654000    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnpsb\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-kube-api-access-vnpsb\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654051    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-bound-sa-token\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654082    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-image-registry-private-configuration\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654121    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f9e9106-6688-4c8e-ae03-493bde7b5643-ca-trust-extracted\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654158    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-installation-pull-secrets\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654201    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-trusted-ca\") pod \"8f9e9106-6688-4c8e-ae03-493bde7b5643\" (UID: \"8f9e9106-6688-4c8e-ae03-493bde7b5643\") "
Jul 28 14:00:54.654777 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.654749    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:00:54.655492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.655452    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f9e9106-6688-4c8e-ae03-493bde7b5643-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:00:54.655646 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.655623    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:00:54.659172 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.658900    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-kube-api-access-vnpsb" (OuterVolumeSpecName: "kube-api-access-vnpsb") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "kube-api-access-vnpsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:00:54.659293 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.659256    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:00:54.659931 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.659848    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:00:54.660226 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.660197    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:00:54.661860 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.661495    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8f9e9106-6688-4c8e-ae03-493bde7b5643" (UID: "8f9e9106-6688-4c8e-ae03-493bde7b5643"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:00:54.755123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755083    2558 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755136    2558 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-registry-certificates\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755148    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnpsb\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-kube-api-access-vnpsb\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755158    2558 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8f9e9106-6688-4c8e-ae03-493bde7b5643-bound-sa-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755169    2558 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-image-registry-private-configuration\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755178    2558 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8f9e9106-6688-4c8e-ae03-493bde7b5643-ca-trust-extracted\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755190    2558 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8f9e9106-6688-4c8e-ae03-493bde7b5643-installation-pull-secrets\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.755294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.755204    2558 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8f9e9106-6688-4c8e-ae03-493bde7b5643-trusted-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:00:54.768400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.768374    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4vfd5\""
Jul 28 14:00:54.776527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:54.776500    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:00:55.441125 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.440997    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p"]
Jul 28 14:00:55.459221 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.459192    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6ndp9"]
Jul 28 14:00:55.475451 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.475425    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd016e616_e01b_470b_9afc_0d78b2660ac8.slice/crio-7563cec8ff26bc9e8fd129beb7b22f4a61d85b8aa87d59c61e00a9277ff61c10 WatchSource:0}: Error finding container 7563cec8ff26bc9e8fd129beb7b22f4a61d85b8aa87d59c61e00a9277ff61c10: Status 404 returned error can't find the container with id 7563cec8ff26bc9e8fd129beb7b22f4a61d85b8aa87d59c61e00a9277ff61c10
Jul 28 14:00:55.476062 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.476034    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83df7d59_5e78_481b_8a96_61e4c7123aa1.slice/crio-cf2d111e03539e31acf7ac0d332c5057e74abcb553f474dca43ae3ea5b218e2b WatchSource:0}: Error finding container cf2d111e03539e31acf7ac0d332c5057e74abcb553f474dca43ae3ea5b218e2b: Status 404 returned error can't find the container with id cf2d111e03539e31acf7ac0d332c5057e74abcb553f474dca43ae3ea5b218e2b
Jul 28 14:00:55.518567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.518540    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p" event={"ID":"d016e616-e01b-470b-9afc-0d78b2660ac8","Type":"ContainerStarted","Data":"7563cec8ff26bc9e8fd129beb7b22f4a61d85b8aa87d59c61e00a9277ff61c10"}
Jul 28 14:00:55.520136 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.520112    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ndp9" event={"ID":"83df7d59-5e78-481b-8a96-61e4c7123aa1","Type":"ContainerStarted","Data":"cf2d111e03539e31acf7ac0d332c5057e74abcb553f474dca43ae3ea5b218e2b"}
Jul 28 14:00:55.520236 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.520141    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f5648477f-28pzp"
Jul 28 14:00:55.553508 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.553486    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f5648477f-28pzp"]
Jul 28 14:00:55.558063 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.557992    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f5648477f-28pzp"]
Jul 28 14:00:55.680924 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.680894    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bc5tq"]
Jul 28 14:00:55.685377 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.685348    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"]
Jul 28 14:00:55.687430 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.687262    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jhwls"]
Jul 28 14:00:55.687430 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.687316    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-9vh9b"]
Jul 28 14:00:55.687430 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.687380    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e8e4996_66ef_4e59_b750_4aaff0ed34da.slice/crio-de07d3aba3258194c5fd50b0dc41e2bf70fd538ad0dbc216a3d168592837d1cf WatchSource:0}: Error finding container de07d3aba3258194c5fd50b0dc41e2bf70fd538ad0dbc216a3d168592837d1cf: Status 404 returned error can't find the container with id de07d3aba3258194c5fd50b0dc41e2bf70fd538ad0dbc216a3d168592837d1cf
Jul 28 14:00:55.688310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:55.688287    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75c555dd69-mjmpx"]
Jul 28 14:00:55.689651 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.689515    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23aee5dc_8c19_4f87_979b_9acce8e288dd.slice/crio-f30a31fb61d06cb9c49dcae9d42447db0a625d0187d581f531c4686b5a33f221 WatchSource:0}: Error finding container f30a31fb61d06cb9c49dcae9d42447db0a625d0187d581f531c4686b5a33f221: Status 404 returned error can't find the container with id f30a31fb61d06cb9c49dcae9d42447db0a625d0187d581f531c4686b5a33f221
Jul 28 14:00:55.690175 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.690149    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4604fc28_4ec7_46ad_bef8_1275763faf66.slice/crio-10f95d9ef6c262f7e40ae5127ede1f8ac95ddae042c0dcb414a6cdc091b85794 WatchSource:0}: Error finding container 10f95d9ef6c262f7e40ae5127ede1f8ac95ddae042c0dcb414a6cdc091b85794: Status 404 returned error can't find the container with id 10f95d9ef6c262f7e40ae5127ede1f8ac95ddae042c0dcb414a6cdc091b85794
Jul 28 14:00:55.690986 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.690867    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb7ee17f_dbcd_46db_8706_e32e83958f9c.slice/crio-1825ed997c5e107603cd70943d44b6787c4b330cbf0fa4e1c01275a365ab4b94 WatchSource:0}: Error finding container 1825ed997c5e107603cd70943d44b6787c4b330cbf0fa4e1c01275a365ab4b94: Status 404 returned error can't find the container with id 1825ed997c5e107603cd70943d44b6787c4b330cbf0fa4e1c01275a365ab4b94
Jul 28 14:00:55.692004 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:00:55.691926    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76beab67_f046_43de_9ddd_7f05a4eb7b79.slice/crio-c43fa20b40f36c93be9ac0c30540dc7a0e4d150ac1e52d25935246fb9c012491 WatchSource:0}: Error finding container c43fa20b40f36c93be9ac0c30540dc7a0e4d150ac1e52d25935246fb9c012491: Status 404 returned error can't find the container with id c43fa20b40f36c93be9ac0c30540dc7a0e4d150ac1e52d25935246fb9c012491
Jul 28 14:00:56.529264 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.529161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vh9b" event={"ID":"4604fc28-4ec7-46ad-bef8-1275763faf66","Type":"ContainerStarted","Data":"10f95d9ef6c262f7e40ae5127ede1f8ac95ddae042c0dcb414a6cdc091b85794"}
Jul 28 14:00:56.535982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.535948    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx" event={"ID":"76beab67-f046-43de-9ddd-7f05a4eb7b79","Type":"ContainerStarted","Data":"5ffebbf0688762fb4727a1ee7d5003f2d60c1c45fa4ad85939ad1f6dc4f4513a"}
Jul 28 14:00:56.536127 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.536007    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx" event={"ID":"76beab67-f046-43de-9ddd-7f05a4eb7b79","Type":"ContainerStarted","Data":"c43fa20b40f36c93be9ac0c30540dc7a0e4d150ac1e52d25935246fb9c012491"}
Jul 28 14:00:56.536764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.536741    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:00:56.541626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.541554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bw4s" event={"ID":"69e07e8f-f868-4af9-ac6f-75d410526587","Type":"ContainerStarted","Data":"3defd3d3035c5634e5ebf6810aa1a0497b4e6d64263a00ed80a55b27bc769051"}
Jul 28 14:00:56.544338 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.544267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jhwls" event={"ID":"bb7ee17f-dbcd-46db-8706-e32e83958f9c","Type":"ContainerStarted","Data":"1825ed997c5e107603cd70943d44b6787c4b330cbf0fa4e1c01275a365ab4b94"}
Jul 28 14:00:56.545685 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.545613    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bc5tq" event={"ID":"7e8e4996-66ef-4e59-b750-4aaff0ed34da","Type":"ContainerStarted","Data":"de07d3aba3258194c5fd50b0dc41e2bf70fd538ad0dbc216a3d168592837d1cf"}
Jul 28 14:00:56.547867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.547816    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8" event={"ID":"23aee5dc-8c19-4f87-979b-9acce8e288dd","Type":"ContainerStarted","Data":"f30a31fb61d06cb9c49dcae9d42447db0a625d0187d581f531c4686b5a33f221"}
Jul 28 14:00:56.558807 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:56.558255    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx" podStartSLOduration=3.5582362720000003 podStartE2EDuration="3.558236272s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:00:56.55782539 +0000 UTC m=+69.792344863" watchObservedRunningTime="2026-07-28 14:00:56.558236272 +0000 UTC m=+69.792755725"
Jul 28 14:00:57.284659 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:00:57.284449    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f9e9106-6688-4c8e-ae03-493bde7b5643" path="/var/lib/kubelet/pods/8f9e9106-6688-4c8e-ae03-493bde7b5643/volumes"
Jul 28 14:01:00.225415 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.225292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:00.403371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.403339    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"]
Jul 28 14:01:00.409221 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.409195    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:00.411584 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.411561    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 14:01:00.411584 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.411585    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-2mbjc\""
Jul 28 14:01:00.414686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.414661    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"]
Jul 28 14:01:00.508441 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.508392    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ebb7ef2-7412-4435-849c-fcbfe01d7334-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-k4pv8\" (UID: \"3ebb7ef2-7412-4435-849c-fcbfe01d7334\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:00.511454 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.511428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:00.578130 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.578093    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:00.609322 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.609290    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ebb7ef2-7412-4435-849c-fcbfe01d7334-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-k4pv8\" (UID: \"3ebb7ef2-7412-4435-849c-fcbfe01d7334\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:00.609478 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:01:00.609426    2558 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 14:01:00.609538 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:01:00.609500    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ebb7ef2-7412-4435-849c-fcbfe01d7334-tls-certificates podName:3ebb7ef2-7412-4435-849c-fcbfe01d7334 nodeName:}" failed. No retries permitted until 2026-07-28 14:01:01.109473922 +0000 UTC m=+74.343993371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/3ebb7ef2-7412-4435-849c-fcbfe01d7334-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-k4pv8" (UID: "3ebb7ef2-7412-4435-849c-fcbfe01d7334") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 14:01:00.913296 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:00.913217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:01.114212 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:01.114172    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ebb7ef2-7412-4435-849c-fcbfe01d7334-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-k4pv8\" (UID: \"3ebb7ef2-7412-4435-849c-fcbfe01d7334\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:01.116664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:01.116640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/3ebb7ef2-7412-4435-849c-fcbfe01d7334-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-k4pv8\" (UID: \"3ebb7ef2-7412-4435-849c-fcbfe01d7334\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:01.320836 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:01.320805    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:02.595886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.595852    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-z8kgr"]
Jul 28 14:01:02.597819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.597795    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:02.600506 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.600482    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-ltpd6\""
Jul 28 14:01:02.600804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.600771    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 14:01:02.600920 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.600900    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 14:01:02.613268 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.613242    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-z8kgr"]
Jul 28 14:01:02.620562 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.620538    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:02.728224 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.728186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh659\" (UniqueName: \"kubernetes.io/projected/0132ffa9-560b-49b6-be74-c14b4a622c98-kube-api-access-sh659\") pod \"downloads-7c97dc4555-z8kgr\" (UID: \"0132ffa9-560b-49b6-be74-c14b4a622c98\") " pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:02.769089 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.769048    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:02.828982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.828933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh659\" (UniqueName: \"kubernetes.io/projected/0132ffa9-560b-49b6-be74-c14b4a622c98-kube-api-access-sh659\") pod \"downloads-7c97dc4555-z8kgr\" (UID: \"0132ffa9-560b-49b6-be74-c14b4a622c98\") " pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:02.838509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.838479    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh659\" (UniqueName: \"kubernetes.io/projected/0132ffa9-560b-49b6-be74-c14b4a622c98-kube-api-access-sh659\") pod \"downloads-7c97dc4555-z8kgr\" (UID: \"0132ffa9-560b-49b6-be74-c14b4a622c98\") " pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:02.903154 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.903065    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:02.910869 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:02.910832    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:03.266837 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:03.266802    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:03.368403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:03.368372    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:04.241214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:04.241116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:04.342684 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:04.342634    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:04.491737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:04.491707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:04.734137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:04.734101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:05.181048 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.179554    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"]
Jul 28 14:01:05.191710 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:01:05.191668    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ebb7ef2_7412_4435_849c_fcbfe01d7334.slice/crio-ab5780635f076feaf77449124c3648219d383a31cea363a0ea839cd78c556ab1 WatchSource:0}: Error finding container ab5780635f076feaf77449124c3648219d383a31cea363a0ea839cd78c556ab1: Status 404 returned error can't find the container with id ab5780635f076feaf77449124c3648219d383a31cea363a0ea839cd78c556ab1
Jul 28 14:01:05.211695 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.211311    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-z8kgr"]
Jul 28 14:01:05.580598 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.580493    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p" event={"ID":"d016e616-e01b-470b-9afc-0d78b2660ac8","Type":"ContainerStarted","Data":"8c6eadb4a6abb1942c80ba56bc59892d17a1f96021345f3df43eaef2a7a9290d"}
Jul 28 14:01:05.582290 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.582264    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vh9b" event={"ID":"4604fc28-4ec7-46ad-bef8-1275763faf66","Type":"ContainerStarted","Data":"dc0a44888468afddaff77dd2bf7163a655ee2cd8089ed0385c1cb9e7a331601f"}
Jul 28 14:01:05.582428 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.582322    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:01:05.582428 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.582339    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-9vh9b" event={"ID":"4604fc28-4ec7-46ad-bef8-1275763faf66","Type":"ContainerStarted","Data":"f55558026ed1c1327196d688661edcb62d8db73198f5270b96078db446954689"}
Jul 28 14:01:05.584508 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.584482    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7bw4s" event={"ID":"69e07e8f-f868-4af9-ac6f-75d410526587","Type":"ContainerStarted","Data":"c7b5cd0ba829c9ac58bce4ce6ee854755069468257f26fe46277af3757e6ec13"}
Jul 28 14:01:05.586307 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.586270    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ndp9" event={"ID":"83df7d59-5e78-481b-8a96-61e4c7123aa1","Type":"ContainerStarted","Data":"33f58851ad243e85c590021fcadf1136e1cc8a59ca437895173b2145229ddd76"}
Jul 28 14:01:05.586408 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.586336    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6ndp9" event={"ID":"83df7d59-5e78-481b-8a96-61e4c7123aa1","Type":"ContainerStarted","Data":"c3760e9f9946920706c5652c7d1cabbb3f4063beeb404350d0ef43c50747a097"}
Jul 28 14:01:05.588800 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.588769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jhwls" event={"ID":"bb7ee17f-dbcd-46db-8706-e32e83958f9c","Type":"ContainerStarted","Data":"51984acce8962c3b58f0188cf8eea96b3431ab7e41e332f79a11fda2f5936b56"}
Jul 28 14:01:05.589010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.588990    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:01:05.591342 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.591312    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bc5tq" event={"ID":"7e8e4996-66ef-4e59-b750-4aaff0ed34da","Type":"ContainerStarted","Data":"4de7ecbf7340e0c58e18ac6a1f8fbc93cd5ab0b2aeba74f342344198e6c0af45"}
Jul 28 14:01:05.592943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.592918    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8" event={"ID":"3ebb7ef2-7412-4435-849c-fcbfe01d7334","Type":"ContainerStarted","Data":"ab5780635f076feaf77449124c3648219d383a31cea363a0ea839cd78c556ab1"}
Jul 28 14:01:05.594260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.594240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8" event={"ID":"23aee5dc-8c19-4f87-979b-9acce8e288dd","Type":"ContainerStarted","Data":"19f86ad544ea0b1c4c492678420928721ea195343d4dbb5f28fed23e791e44d6"}
Jul 28 14:01:05.594357 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.594344    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:01:05.595405 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.595383    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-z8kgr" event={"ID":"0132ffa9-560b-49b6-be74-c14b4a622c98","Type":"ContainerStarted","Data":"d41d93d3ec9ab1ed5265712c53b55c0ca939543bfb6312be51f7b99409f96557"}
Jul 28 14:01:05.596354 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.596336    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8"
Jul 28 14:01:05.600835 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.600797    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-q5k5p" podStartSLOduration=3.094454046 podStartE2EDuration="12.60078452s" totalImagesPullingTime="9.506330474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.600198418 +0000 UTC m=+78.834717891" watchObservedRunningTime="2026-07-28 14:01:05.60078452 +0000 UTC m=+78.835303970"
Jul 28 14:01:05.619217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.619160    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b6f4c7b68-jmbq8" podStartSLOduration=3.219651212 podStartE2EDuration="12.619142971s" totalImagesPullingTime="9.399491759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.617770585 +0000 UTC m=+78.852290058" watchObservedRunningTime="2026-07-28 14:01:05.619142971 +0000 UTC m=+78.853662444"
Jul 28 14:01:05.633611 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.633570    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bc5tq" podStartSLOduration=69.270127349 podStartE2EDuration="1m18.633562748s" totalImagesPullingTime="9.363435399s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.633344012 +0000 UTC m=+78.867863484" watchObservedRunningTime="2026-07-28 14:01:05.633562748 +0000 UTC m=+78.868082219"
Jul 28 14:01:05.651629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.651588    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jhwls" podStartSLOduration=69.291291234 podStartE2EDuration="1m18.651578063s" totalImagesPullingTime="9.360286829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.651067016 +0000 UTC m=+78.885586489" watchObservedRunningTime="2026-07-28 14:01:05.651578063 +0000 UTC m=+78.886097535"
Jul 28 14:01:05.674374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.674314    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-9vh9b" podStartSLOduration=34.347524817 podStartE2EDuration="43.674295744s" totalImagesPullingTime="9.326770927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:00:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.673247524 +0000 UTC m=+78.907767046" watchObservedRunningTime="2026-07-28 14:01:05.674295744 +0000 UTC m=+78.908815215"
Jul 28 14:01:05.690317 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.690259    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6ndp9" podStartSLOduration=69.173746602 podStartE2EDuration="1m18.690239218s" totalImagesPullingTime="9.516492616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 13:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.689403836 +0000 UTC m=+78.923923307" watchObservedRunningTime="2026-07-28 14:01:05.690239218 +0000 UTC m=+78.924758689"
Jul 28 14:01:05.708063 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:05.707993    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7bw4s" podStartSLOduration=16.974040581 podStartE2EDuration="35.707974218s" totalImagesPullingTime="18.733933637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:00:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:05.707532605 +0000 UTC m=+78.942052092" watchObservedRunningTime="2026-07-28 14:01:05.707974218 +0000 UTC m=+78.942493689"
Jul 28 14:01:06.001216 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:06.001180    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:06.100591 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:06.100558    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:06.280375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:06.280295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:06.380108 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:06.380078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:07.294702 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.294621    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:07.607269 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.607161    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8" event={"ID":"3ebb7ef2-7412-4435-849c-fcbfe01d7334","Type":"ContainerStarted","Data":"d6aa17693c69c79ce3ebf89ce39486c97d94541c693fbad70b2e53ad7b98565b"}
Jul 28 14:01:07.607269 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.607269    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:07.613093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.613067    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8"
Jul 28 14:01:07.626300 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.626252    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-k4pv8" podStartSLOduration=5.796310726 podStartE2EDuration="7.626238484s" totalImagesPullingTime="1.829927758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:07.625705456 +0000 UTC m=+80.860224929" watchObservedRunningTime="2026-07-28 14:01:07.626238484 +0000 UTC m=+80.860757956"
Jul 28 14:01:07.815990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.815956    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:07.915926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:07.915839    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:08.430426 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.430395    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:08.479626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.479586    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"]
Jul 28 14:01:08.481966 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.481946    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.485678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.485425    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 14:01:08.485678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.485499    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 14:01:08.485678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.485525    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 14:01:08.485678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.485537    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bdt5n\""
Jul 28 14:01:08.485678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.485555    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 14:01:08.485678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.485669    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 14:01:08.497738 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.497706    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"]
Jul 28 14:01:08.523401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.523375    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:08.574906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.574872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17585fb8-285e-4756-ac8b-4d20be6d2075-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.575076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.574933    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dqx\" (UniqueName: \"kubernetes.io/projected/17585fb8-285e-4756-ac8b-4d20be6d2075-kube-api-access-w4dqx\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.575076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.575038    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/17585fb8-285e-4756-ac8b-4d20be6d2075-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.575076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.575067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17585fb8-285e-4756-ac8b-4d20be6d2075-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.588636 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.588606    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:08.675891 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.675858    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17585fb8-285e-4756-ac8b-4d20be6d2075-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.676098 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.675905    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dqx\" (UniqueName: \"kubernetes.io/projected/17585fb8-285e-4756-ac8b-4d20be6d2075-kube-api-access-w4dqx\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.676098 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.675933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/17585fb8-285e-4756-ac8b-4d20be6d2075-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.676098 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.675959    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17585fb8-285e-4756-ac8b-4d20be6d2075-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.676727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.676669    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/17585fb8-285e-4756-ac8b-4d20be6d2075-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.678653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.678627    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/17585fb8-285e-4756-ac8b-4d20be6d2075-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.678777 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.678740    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/17585fb8-285e-4756-ac8b-4d20be6d2075-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.688461 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.688403    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dqx\" (UniqueName: \"kubernetes.io/projected/17585fb8-285e-4756-ac8b-4d20be6d2075-kube-api-access-w4dqx\") pod \"prometheus-operator-84d69f794d-wxdcv\" (UID: \"17585fb8-285e-4756-ac8b-4d20be6d2075\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.731155 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.731105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:08.793292 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.793251    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"
Jul 28 14:01:08.940343 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:08.940265    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-wxdcv"]
Jul 28 14:01:08.943357 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:01:08.943327    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17585fb8_285e_4756_ac8b_4d20be6d2075.slice/crio-9ea70972d1ac8b175a4108aec0d54d2680a6bbb9f62469f9e1f2e187d71a93b2 WatchSource:0}: Error finding container 9ea70972d1ac8b175a4108aec0d54d2680a6bbb9f62469f9e1f2e187d71a93b2: Status 404 returned error can't find the container with id 9ea70972d1ac8b175a4108aec0d54d2680a6bbb9f62469f9e1f2e187d71a93b2
Jul 28 14:01:09.617302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:09.617259    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv" event={"ID":"17585fb8-285e-4756-ac8b-4d20be6d2075","Type":"ContainerStarted","Data":"9ea70972d1ac8b175a4108aec0d54d2680a6bbb9f62469f9e1f2e187d71a93b2"}
Jul 28 14:01:10.623725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:10.623693    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv" event={"ID":"17585fb8-285e-4756-ac8b-4d20be6d2075","Type":"ContainerStarted","Data":"682802b51c6a1a0b7d1cbf5bf427e29a5bb955f5f4b66dc70d1ee507ed2d06d6"}
Jul 28 14:01:11.326680 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:11.326648    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:11.629680 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:11.629595    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv" event={"ID":"17585fb8-285e-4756-ac8b-4d20be6d2075","Type":"ContainerStarted","Data":"089af50b64977b1a5331ad11f8d491a417c6185b34cdb18ad334a3970f421571"}
Jul 28 14:01:11.648452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:11.648366    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-wxdcv" podStartSLOduration=2.069250944 podStartE2EDuration="3.648345368s" totalImagesPullingTime="1.579094424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:11.64785222 +0000 UTC m=+84.882371694" watchObservedRunningTime="2026-07-28 14:01:11.648345368 +0000 UTC m=+84.882864840"
Jul 28 14:01:12.321700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.321667    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bdb5bb878-k79qz"]
Jul 28 14:01:12.323688 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.323671    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.326353 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.326330    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 14:01:12.326471 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.326354    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 14:01:12.326471 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.326331    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9vhmj\""
Jul 28 14:01:12.327113 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.327097    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 14:01:12.327296 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.327283    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 14:01:12.327344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.327291    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 14:01:12.334814 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.334794    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdb5bb878-k79qz"]
Jul 28 14:01:12.509554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.509517    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnrtr\" (UniqueName: \"kubernetes.io/projected/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-kube-api-access-cnrtr\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.509554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.509556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-config\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.509749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.509583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-serving-cert\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.509749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.509641    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-oauth-config\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.509749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.509697    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-service-ca\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.509749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.509719    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-oauth-serving-cert\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.610475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.610385    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-service-ca\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.610475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.610439    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-oauth-serving-cert\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.610672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.610489    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnrtr\" (UniqueName: \"kubernetes.io/projected/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-kube-api-access-cnrtr\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.610672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.610520    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-config\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.610672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.610563    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-serving-cert\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.610672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.610592    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-oauth-config\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.611337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.611289    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-service-ca\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.611466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.611375    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-config\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.611466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.611387    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-oauth-serving-cert\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.613263 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.613242    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-oauth-config\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.613389 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.613323    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-serving-cert\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.620317 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.620294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnrtr\" (UniqueName: \"kubernetes.io/projected/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-kube-api-access-cnrtr\") pod \"console-7bdb5bb878-k79qz\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") " pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.632481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.632453    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:12.796806 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.796774    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:12.811571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.811503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bdb5bb878-k79qz"]
Jul 28 14:01:12.815707 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:01:12.815681    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f7d2fd_689a_4db0_9d99_fa07c8238d15.slice/crio-d7ba8a2a8e42c9b6cc0a5df845339ce367a5a2d1f80d64bc553cb3fc311e2942 WatchSource:0}: Error finding container d7ba8a2a8e42c9b6cc0a5df845339ce367a5a2d1f80d64bc553cb3fc311e2942: Status 404 returned error can't find the container with id d7ba8a2a8e42c9b6cc0a5df845339ce367a5a2d1f80d64bc553cb3fc311e2942
Jul 28 14:01:12.897099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:12.896998    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:13.597788 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.597751    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:13.640304 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.640271    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb5bb878-k79qz" event={"ID":"d8f7d2fd-689a-4db0-9d99-fa07c8238d15","Type":"ContainerStarted","Data":"d7ba8a2a8e42c9b6cc0a5df845339ce367a5a2d1f80d64bc553cb3fc311e2942"}
Jul 28 14:01:13.806206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.806101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:13.884125 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.884038    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"]
Jul 28 14:01:13.886765 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.886603    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:13.894182 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.894152    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 14:01:13.896688 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.896558    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jn4pq\""
Jul 28 14:01:13.896688 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.896558    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 14:01:13.905514 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.905458    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"]
Jul 28 14:01:13.920844 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.920821    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:13.928352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.928311    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pmz95"]
Jul 28 14:01:13.931256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.931228    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:13.935617 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.935588    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 14:01:13.935785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.935615    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nh4t2\""
Jul 28 14:01:13.936057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.936037    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 14:01:13.936190 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:13.936152    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 14:01:14.020459 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a2d263-a4cb-484c-8024-4b5afc268431-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.020612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020470    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-sys\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.020612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020526    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5a2d263-a4cb-484c-8024-4b5afc268431-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.020612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020581    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a2d263-a4cb-484c-8024-4b5afc268431-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.020612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-textfile\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.020799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-tls\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.020867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-metrics-client-ca\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.020963 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020940    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2987\" (UniqueName: \"kubernetes.io/projected/a5a2d263-a4cb-484c-8024-4b5afc268431-kube-api-access-d2987\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.020963 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020967    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-wtmp\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.021188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.020988    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.021188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.021079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-root\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.021188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.021141    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.021335 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.021187    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-429ql\" (UniqueName: \"kubernetes.io/projected/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-kube-api-access-429ql\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.041245 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.041212    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:14.121835 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.121801    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-sys\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122007 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.121860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5a2d263-a4cb-484c-8024-4b5afc268431-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.122007 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.121884    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-sys\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122007 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.121902    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a2d263-a4cb-484c-8024-4b5afc268431-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.122007 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.121931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-textfile\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122035    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-tls\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-metrics-client-ca\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122109    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2987\" (UniqueName: \"kubernetes.io/projected/a5a2d263-a4cb-484c-8024-4b5afc268431-kube-api-access-d2987\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122134    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-wtmp\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122158    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-root\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122237    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122471 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122276    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-429ql\" (UniqueName: \"kubernetes.io/projected/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-kube-api-access-429ql\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122471 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-textfile\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122573 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122493    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-wtmp\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.122573 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122491    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a2d263-a4cb-484c-8024-4b5afc268431-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.122670 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-root\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.123123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5a2d263-a4cb-484c-8024-4b5afc268431-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.123123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.122888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-metrics-client-ca\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.123465 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.123440    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-accelerators-collector-config\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.125399 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.125357    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5a2d263-a4cb-484c-8024-4b5afc268431-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.127004 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.126960    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.128137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.128120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-node-exporter-tls\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.128701 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.128537    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/a5a2d263-a4cb-484c-8024-4b5afc268431-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.129312 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.129265    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:14.133066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.133010    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-429ql\" (UniqueName: \"kubernetes.io/projected/4e79cc43-c95e-4d6a-9d97-fa0a71eccce5-kube-api-access-429ql\") pod \"node-exporter-pmz95\" (UID: \"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5\") " pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.133337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.133312    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2987\" (UniqueName: \"kubernetes.io/projected/a5a2d263-a4cb-484c-8024-4b5afc268431-kube-api-access-d2987\") pod \"openshift-state-metrics-b8f49f5c6-8w865\" (UID: \"a5a2d263-a4cb-484c-8024-4b5afc268431\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.198961 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.198874    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"
Jul 28 14:01:14.234197 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.234130    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:14.243863 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.243806    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pmz95"
Jul 28 14:01:14.371827 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.371793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865"]
Jul 28 14:01:14.374577 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:01:14.374544    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a2d263_a4cb_484c_8024_4b5afc268431.slice/crio-4ab1f49d6a9de01501698db95374e9663ed462c25aa304be7213b5e9528012ef WatchSource:0}: Error finding container 4ab1f49d6a9de01501698db95374e9663ed462c25aa304be7213b5e9528012ef: Status 404 returned error can't find the container with id 4ab1f49d6a9de01501698db95374e9663ed462c25aa304be7213b5e9528012ef
Jul 28 14:01:14.404686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.404653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:14.505496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.505245    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:14.645664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.645624    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmz95" event={"ID":"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5","Type":"ContainerStarted","Data":"8dafcd167ec07fd6d5242dca17594732a62c775c56fba4782970ed449dbed3cd"}
Jul 28 14:01:14.648168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.648136    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865" event={"ID":"a5a2d263-a4cb-484c-8024-4b5afc268431","Type":"ContainerStarted","Data":"8a885613d99078e08d9a53317de09136a77ba21b7a3f04e12e787a96998dab0f"}
Jul 28 14:01:14.648331 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.648199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865" event={"ID":"a5a2d263-a4cb-484c-8024-4b5afc268431","Type":"ContainerStarted","Data":"e957e270354258fb9541b29b8874f8e0bba046bf34a867e69549e7d363b8f096"}
Jul 28 14:01:14.648331 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.648229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865" event={"ID":"a5a2d263-a4cb-484c-8024-4b5afc268431","Type":"ContainerStarted","Data":"4ab1f49d6a9de01501698db95374e9663ed462c25aa304be7213b5e9528012ef"}
Jul 28 14:01:14.858750 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:14.858682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:15.000297 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:15.000259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:15.266009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:15.265975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:15.605232 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:15.605160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-9vh9b"
Jul 28 14:01:16.521660 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:16.521618    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:16.642088 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:16.641982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:16.879470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:16.879390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:16.950500 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:16.950470    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:17.362927 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:17.362844    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:17.481400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:17.481362    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:18.420683 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.420651    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6796c67f76-2sml9"]
Jul 28 14:01:18.557698 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.557660    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6796c67f76-2sml9"]
Jul 28 14:01:18.557873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.557808    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.562718 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.562683    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-bdmfb8bisdd7r\""
Jul 28 14:01:18.562976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.562959    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 14:01:18.563249 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.563233    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 14:01:18.563581 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.563562    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gpmg6\""
Jul 28 14:01:18.563919 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.563898    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 14:01:18.564406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.564380    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 14:01:18.565587 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.565560    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75c555dd69-mjmpx"
Jul 28 14:01:18.615439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.615393    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:18.665901 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.665872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-secret-metrics-server-tls\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.666092 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.665917    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-audit-log\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.666092 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.666033    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qhxz\" (UniqueName: \"kubernetes.io/projected/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-kube-api-access-4qhxz\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.666092 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.666073    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-secret-metrics-server-client-certs\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.666257 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.666109    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-metrics-server-audit-profiles\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.666257 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.666247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-client-ca-bundle\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.666355 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.666281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.711381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.711261    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:18.767594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767553    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-audit-log\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.767769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767603    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qhxz\" (UniqueName: \"kubernetes.io/projected/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-kube-api-access-4qhxz\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.767769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767641    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-secret-metrics-server-client-certs\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.767769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767676    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-metrics-server-audit-profiles\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.767769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-client-ca-bundle\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.767769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767755    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.767988 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.767790    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-secret-metrics-server-tls\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.768066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.768040    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-audit-log\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.769251 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.769222    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.770097 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.770048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-metrics-server-audit-profiles\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.770708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.770686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-client-ca-bundle\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.770851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.770832    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-secret-metrics-server-client-certs\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.771194 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.771174    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-secret-metrics-server-tls\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.777505 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.777471    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qhxz\" (UniqueName: \"kubernetes.io/projected/044f6dc2-792c-43e6-a338-94ecbb1c0d4b-kube-api-access-4qhxz\") pod \"metrics-server-6796c67f76-2sml9\" (UID: \"044f6dc2-792c-43e6-a338-94ecbb1c0d4b\") " pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.811915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.811871    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:18.875037 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.874971    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:18.909271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.909239    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:18.976469 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:18.976364    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:19.987500 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:19.987440    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:20.130545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.130499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:20.132795 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.132764    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:01:20.204203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.204166    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:01:20.204377 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.204325    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.209492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.208923    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 14:01:20.209492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.209085    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 14:01:20.209492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.209295    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 14:01:20.209492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.209331    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 14:01:20.209492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.209341    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2hhqv\""
Jul 28 14:01:20.209492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.209295    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 14:01:20.210206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210184    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 14:01:20.210355 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210224    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 14:01:20.210435 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210354    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 14:01:20.210477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210436    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 14:01:20.210545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210477    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 14:01:20.210733 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210715    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7agjc3scdp93p\""
Jul 28 14:01:20.211197 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.210931    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 14:01:20.211197 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.211049    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 14:01:20.211429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.211252    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 14:01:20.212222 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.212203    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 14:01:20.278817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278780    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.278817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278820    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278852    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278880    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278944    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.278998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279029    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279056    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-config\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279166    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279193    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279230    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279258    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279301    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpmbl\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-kube-api-access-jpmbl\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279365    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279419    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279801 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279456    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.279801 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.279494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380068 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380009    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380088    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380117    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-config\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380156    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380180    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380211    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380422    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380462    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380490    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380513    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpmbl\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-kube-api-access-jpmbl\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380543    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380568    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380650    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380722    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.380784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380754    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.381050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380791    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.381050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380826    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.381050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.381050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.380898    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.381324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.381126    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.381822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.381655    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.383855 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.383288    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-config\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.383855 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.383769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.384653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.384422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.384653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.384478    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.386427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.386396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.386922 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.386841    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.387583 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.387544    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.388109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.388084    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.388657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.388634    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.389655 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.389628    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.389738 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.389671    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.389804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.389776    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.390168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.390144    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.390862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.390617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.393142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.392300    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-config-out\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.398306 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.396559    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-web-config\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.398306 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.397216    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.400184 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.400141    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpmbl\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-kube-api-access-jpmbl\") pod \"prometheus-k8s-0\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:20.518312 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:20.518267    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:23.160417 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:23.160382    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:23.261628 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:23.261588    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:23.516694 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:23.516651    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:23.613064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:23.613013    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:23.671789 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:23.671758    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:24.232139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.232069    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6796c67f76-2sml9"]
Jul 28 14:01:24.263921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.263836    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:01:24.405967 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:01:24.405921    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd501ec35_c415_4a5e_965e_46c2fd7968fa.slice/crio-ca19f08ec1c03f627d732fdc04a1f4432c885abd0dc1c862b7f32be3337efee2 WatchSource:0}: Error finding container ca19f08ec1c03f627d732fdc04a1f4432c885abd0dc1c862b7f32be3337efee2: Status 404 returned error can't find the container with id ca19f08ec1c03f627d732fdc04a1f4432c885abd0dc1c862b7f32be3337efee2
Jul 28 14:01:24.406943 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:01:24.406904    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044f6dc2_792c_43e6_a338_94ecbb1c0d4b.slice/crio-73b13d04766c6e9672d8894018a70ac6bcc734a5bdac9a2e18d5cfa9939d57b5 WatchSource:0}: Error finding container 73b13d04766c6e9672d8894018a70ac6bcc734a5bdac9a2e18d5cfa9939d57b5: Status 404 returned error can't find the container with id 73b13d04766c6e9672d8894018a70ac6bcc734a5bdac9a2e18d5cfa9939d57b5
Jul 28 14:01:24.691576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.691531    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb5bb878-k79qz" event={"ID":"d8f7d2fd-689a-4db0-9d99-fa07c8238d15","Type":"ContainerStarted","Data":"0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c"}
Jul 28 14:01:24.695463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.695436    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e79cc43-c95e-4d6a-9d97-fa0a71eccce5" containerID="00b67c91697c1f4b00a0b1d5667816be7e4dc4b2187ba83b49d9b819fd22eb76" exitCode=0
Jul 28 14:01:24.695549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.695514    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmz95" event={"ID":"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5","Type":"ContainerDied","Data":"00b67c91697c1f4b00a0b1d5667816be7e4dc4b2187ba83b49d9b819fd22eb76"}
Jul 28 14:01:24.697033 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.696997    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-z8kgr" event={"ID":"0132ffa9-560b-49b6-be74-c14b4a622c98","Type":"ContainerStarted","Data":"68c34e94b0661ff94c19e46373bcf4eb8ebfe334fd7977872b012afe6d20b230"}
Jul 28 14:01:24.697138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.697088    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:24.698752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.698715    2558 patch_prober.go:28] interesting pod/downloads-7c97dc4555-z8kgr container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body=
Jul 28 14:01:24.698854 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.698775    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-z8kgr" podUID="0132ffa9-560b-49b6-be74-c14b4a622c98" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused"
Jul 28 14:01:24.699433 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.699411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9" event={"ID":"044f6dc2-792c-43e6-a338-94ecbb1c0d4b","Type":"ContainerStarted","Data":"73b13d04766c6e9672d8894018a70ac6bcc734a5bdac9a2e18d5cfa9939d57b5"}
Jul 28 14:01:24.700690 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.700671    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"ca19f08ec1c03f627d732fdc04a1f4432c885abd0dc1c862b7f32be3337efee2"}
Jul 28 14:01:24.733680 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.733624    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bdb5bb878-k79qz" podStartSLOduration=1.4618540979999999 podStartE2EDuration="12.733600966s" totalImagesPullingTime="11.271746868s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:24.733418704 +0000 UTC m=+97.967938176" watchObservedRunningTime="2026-07-28 14:01:24.733600966 +0000 UTC m=+97.968120441"
Jul 28 14:01:24.758195 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:24.758141    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-z8kgr" podStartSLOduration=3.569181361 podStartE2EDuration="22.7581216s" totalImagesPullingTime="19.188940239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:24.756712349 +0000 UTC m=+97.991231822" watchObservedRunningTime="2026-07-28 14:01:24.7581216 +0000 UTC m=+97.992641074"
Jul 28 14:01:25.712570 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:25.711806    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865" event={"ID":"a5a2d263-a4cb-484c-8024-4b5afc268431","Type":"ContainerStarted","Data":"29eb9978976faf852c9dd996e117fd7565be5e3190ec9f9729847b6fc12b91bb"}
Jul 28 14:01:25.718217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:25.717075    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmz95" event={"ID":"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5","Type":"ContainerStarted","Data":"e1b893487f99c6e89dd0d7da9833632d0e4c7115c8da2293075882b127e55ea1"}
Jul 28 14:01:25.718217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:25.717129    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pmz95" event={"ID":"4e79cc43-c95e-4d6a-9d97-fa0a71eccce5","Type":"ContainerStarted","Data":"02a7723eafbfac9c1bce479405a267c99a106d68816794709c5f18419b8a6fe5"}
Jul 28 14:01:25.732752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:25.732692    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-z8kgr"
Jul 28 14:01:25.737484 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:25.737262    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-8w865" podStartSLOduration=2.587881463 podStartE2EDuration="12.737242544s" totalImagesPullingTime="10.149361081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:25.73532065 +0000 UTC m=+98.969840122" watchObservedRunningTime="2026-07-28 14:01:25.737242544 +0000 UTC m=+98.971762018"
Jul 28 14:01:25.760827 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:25.760601    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pmz95" podStartSLOduration=2.851513579 podStartE2EDuration="12.760577894s" totalImagesPullingTime="9.82262486s" totalInitContainerRuntime="86.439455ms" isStatefulPod=true podCreationTimestamp="2026-07-28 14:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:25.75663372 +0000 UTC m=+98.991153194" watchObservedRunningTime="2026-07-28 14:01:25.760577894 +0000 UTC m=+98.995097375"
Jul 28 14:01:27.727958 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:27.727863    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9" event={"ID":"044f6dc2-792c-43e6-a338-94ecbb1c0d4b","Type":"ContainerStarted","Data":"bb76f355abc242611f55a87865a2cc3ea0064922da7e639958addec72c0a8fb1"}
Jul 28 14:01:27.730318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:27.730259    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="4bc871b5be0b30ea39cdfa9f3f6f1e538a71904c7a0f46278432688566f1eaa0" exitCode=0
Jul 28 14:01:27.730452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:27.730349    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"4bc871b5be0b30ea39cdfa9f3f6f1e538a71904c7a0f46278432688566f1eaa0"}
Jul 28 14:01:27.750322 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:27.750268    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9" podStartSLOduration=6.796844062 podStartE2EDuration="9.750250172s" totalImagesPullingTime="2.95340611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:27.747672087 +0000 UTC m=+100.982191559" watchObservedRunningTime="2026-07-28 14:01:27.750250172 +0000 UTC m=+100.984769644"
Jul 28 14:01:29.016403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:29.016356    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:29.115747 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:29.115684    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:29.291755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:29.291571    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:32.633131 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:32.633090    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:32.633616 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:32.633207    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:32.638635 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:32.638606    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:32.759010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:32.758617    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"b99d788bb7beb32807d44efefa863655ce96873bcbf0e2b4e0b8fa8d06e70db2"}
Jul 28 14:01:32.759010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:32.758737    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"41b0f987711307a178d173cbbb8ff633caecae00a7472a5e225ef771e5c6ef15"}
Jul 28 14:01:32.764116 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:32.764087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:01:34.004605 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:34.004570    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdb5bb878-k79qz"]
Jul 28 14:01:35.119068 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.119043    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:35.218460 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.218380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:35.773140 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.773102    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"91484b30245b07dcd76a6dce6d54142edd86488694e21fa4663f3ae31339c5e3"}
Jul 28 14:01:35.773381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.773201    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"f98ffa4baeb8e47807565cfad77b2fce2ff51688042424cd0f250653c0a62694"}
Jul 28 14:01:35.773381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.773229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"0609a4163d0ea0ce3e2e053bbc0ab6111d94acebf4569395abd36398b8bacc96"}
Jul 28 14:01:35.773381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.773252    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerStarted","Data":"e5b1f5a18ebcf0b5b44bce2f9871ec294364b1c2a957bc171818009b072f2dc7"}
Jul 28 14:01:35.811913 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.811857    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.588085248 podStartE2EDuration="15.811837103s" totalImagesPullingTime="9.207061272s" totalInitContainerRuntime="16.690583ms" isStatefulPod=false podCreationTimestamp="2026-07-28 14:01:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:01:35.809775496 +0000 UTC m=+109.044295006" watchObservedRunningTime="2026-07-28 14:01:35.811837103 +0000 UTC m=+109.046356576"
Jul 28 14:01:35.920654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:35.920620    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:36.020767 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:36.020734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:36.604733 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:36.604705    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jhwls"
Jul 28 14:01:36.716246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:36.716196    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:36.785973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:36.785943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:37.719666 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:37.719625    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:37.786324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:37.786292    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:38.875230 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:38.875200    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:38.875598 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:38.875278    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:40.518690 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:40.518649    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:01:53.717427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:53.717395    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:53.817731 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:53.817694    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:57.748635 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:57.748602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:57.813480 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:57.813452    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:01:58.880527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:58.880499    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:58.884221 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:58.884199    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6796c67f76-2sml9"
Jul 28 14:01:59.784289 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:01:59.784237    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7bdb5bb878-k79qz" podUID="d8f7d2fd-689a-4db0-9d99-fa07c8238d15" containerName="console" containerID="cri-o://0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c" gracePeriod=15
Jul 28 14:02:00.019743 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.019717    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:02:00.143749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.143672    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-config\") pod \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") "
Jul 28 14:02:00.143749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.143714    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cnrtr\" (UniqueName: \"kubernetes.io/projected/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-kube-api-access-cnrtr\") pod \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") "
Jul 28 14:02:00.143945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.143763    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-oauth-config\") pod \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") "
Jul 28 14:02:00.143945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.143797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-oauth-serving-cert\") pod \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") "
Jul 28 14:02:00.143945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.143830    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-serving-cert\") pod \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") "
Jul 28 14:02:00.143945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.143865    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-service-ca\") pod \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\" (UID: \"d8f7d2fd-689a-4db0-9d99-fa07c8238d15\") "
Jul 28 14:02:00.144321 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.144286    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-config" (OuterVolumeSpecName: "console-config") pod "d8f7d2fd-689a-4db0-9d99-fa07c8238d15" (UID: "d8f7d2fd-689a-4db0-9d99-fa07c8238d15"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:00.144426 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.144344    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d8f7d2fd-689a-4db0-9d99-fa07c8238d15" (UID: "d8f7d2fd-689a-4db0-9d99-fa07c8238d15"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:00.144426 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.144390    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-service-ca" (OuterVolumeSpecName: "service-ca") pod "d8f7d2fd-689a-4db0-9d99-fa07c8238d15" (UID: "d8f7d2fd-689a-4db0-9d99-fa07c8238d15"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:00.146145 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.146122    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d8f7d2fd-689a-4db0-9d99-fa07c8238d15" (UID: "d8f7d2fd-689a-4db0-9d99-fa07c8238d15"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:00.146344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.146328    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d8f7d2fd-689a-4db0-9d99-fa07c8238d15" (UID: "d8f7d2fd-689a-4db0-9d99-fa07c8238d15"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:00.146405 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.146332    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-kube-api-access-cnrtr" (OuterVolumeSpecName: "kube-api-access-cnrtr") pod "d8f7d2fd-689a-4db0-9d99-fa07c8238d15" (UID: "d8f7d2fd-689a-4db0-9d99-fa07c8238d15"). InnerVolumeSpecName "kube-api-access-cnrtr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:02:00.244553 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.244523    2558 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:00.244553 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.244551    2558 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:00.244553 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.244560    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnrtr\" (UniqueName: \"kubernetes.io/projected/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-kube-api-access-cnrtr\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:00.244751 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.244569    2558 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-oauth-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:00.244751 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.244577    2558 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-oauth-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:00.244751 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.244585    2558 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d8f7d2fd-689a-4db0-9d99-fa07c8238d15-console-serving-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:00.867747 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.867708    2558 generic.go:356] "Generic (PLEG): container finished" podID="d8f7d2fd-689a-4db0-9d99-fa07c8238d15" containerID="0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c" exitCode=0
Jul 28 14:02:00.867917 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.867751    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bdb5bb878-k79qz"
Jul 28 14:02:00.867917 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.867791    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb5bb878-k79qz" event={"ID":"d8f7d2fd-689a-4db0-9d99-fa07c8238d15","Type":"ContainerDied","Data":"0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c"}
Jul 28 14:02:00.867917 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.867848    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bdb5bb878-k79qz" event={"ID":"d8f7d2fd-689a-4db0-9d99-fa07c8238d15","Type":"ContainerDied","Data":"d7ba8a2a8e42c9b6cc0a5df845339ce367a5a2d1f80d64bc553cb3fc311e2942"}
Jul 28 14:02:00.867917 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.867871    2558 scope.go:117] "RemoveContainer" containerID="0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c"
Jul 28 14:02:00.876486 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.876470    2558 scope.go:117] "RemoveContainer" containerID="0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c"
Jul 28 14:02:00.876757 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:02:00.876738    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c\": container with ID starting with 0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c not found: ID does not exist" containerID="0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c"
Jul 28 14:02:00.876835 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.876762    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c"} err="failed to get container status \"0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c\": rpc error: code = NotFound desc = could not find container \"0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c\": container with ID starting with 0934aba882ab8a1ae25b6dcc8a73324afda5c318542a59924bd509c79c074b4c not found: ID does not exist"
Jul 28 14:02:00.889911 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.889887    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bdb5bb878-k79qz"]
Jul 28 14:02:00.894684 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:00.894661    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bdb5bb878-k79qz"]
Jul 28 14:02:01.281153 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:01.281114    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8f7d2fd-689a-4db0-9d99-fa07c8238d15" path="/var/lib/kubelet/pods/d8f7d2fd-689a-4db0-9d99-fa07c8238d15/volumes"
Jul 28 14:02:16.328690 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:16.328650    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:20.519341 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:20.519302    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:20.571785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:20.571757    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:20.983204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:20.983137    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:33.295110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:33.295077    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:33.742813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:33.742783    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:38.801352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.801315    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:02:38.802158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.801700    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="prometheus" containerID="cri-o://41b0f987711307a178d173cbbb8ff633caecae00a7472a5e225ef771e5c6ef15" gracePeriod=600
Jul 28 14:02:38.802158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.801724    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy" containerID="cri-o://f98ffa4baeb8e47807565cfad77b2fce2ff51688042424cd0f250653c0a62694" gracePeriod=600
Jul 28 14:02:38.802158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.801806    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="config-reloader" containerID="cri-o://b99d788bb7beb32807d44efefa863655ce96873bcbf0e2b4e0b8fa8d06e70db2" gracePeriod=600
Jul 28 14:02:38.802158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.801842    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-web" containerID="cri-o://0609a4163d0ea0ce3e2e053bbc0ab6111d94acebf4569395abd36398b8bacc96" gracePeriod=600
Jul 28 14:02:38.802158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.801934    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-thanos" containerID="cri-o://91484b30245b07dcd76a6dce6d54142edd86488694e21fa4663f3ae31339c5e3" gracePeriod=600
Jul 28 14:02:38.802158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:38.802068    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="thanos-sidecar" containerID="cri-o://e5b1f5a18ebcf0b5b44bce2f9871ec294364b1c2a957bc171818009b072f2dc7" gracePeriod=600
Jul 28 14:02:39.038873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038835    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="91484b30245b07dcd76a6dce6d54142edd86488694e21fa4663f3ae31339c5e3" exitCode=0
Jul 28 14:02:39.038873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038870    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="f98ffa4baeb8e47807565cfad77b2fce2ff51688042424cd0f250653c0a62694" exitCode=0
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038881    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="0609a4163d0ea0ce3e2e053bbc0ab6111d94acebf4569395abd36398b8bacc96" exitCode=0
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038891    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="e5b1f5a18ebcf0b5b44bce2f9871ec294364b1c2a957bc171818009b072f2dc7" exitCode=0
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038902    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="b99d788bb7beb32807d44efefa863655ce96873bcbf0e2b4e0b8fa8d06e70db2" exitCode=0
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038912    2558 generic.go:356] "Generic (PLEG): container finished" podID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerID="41b0f987711307a178d173cbbb8ff633caecae00a7472a5e225ef771e5c6ef15" exitCode=0
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.038910    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"91484b30245b07dcd76a6dce6d54142edd86488694e21fa4663f3ae31339c5e3"}
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.039009    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"f98ffa4baeb8e47807565cfad77b2fce2ff51688042424cd0f250653c0a62694"}
Jul 28 14:02:39.039107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.039078    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"0609a4163d0ea0ce3e2e053bbc0ab6111d94acebf4569395abd36398b8bacc96"}
Jul 28 14:02:39.039330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.039120    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"e5b1f5a18ebcf0b5b44bce2f9871ec294364b1c2a957bc171818009b072f2dc7"}
Jul 28 14:02:39.039330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.039162    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"b99d788bb7beb32807d44efefa863655ce96873bcbf0e2b4e0b8fa8d06e70db2"}
Jul 28 14:02:39.039330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.039203    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"41b0f987711307a178d173cbbb8ff633caecae00a7472a5e225ef771e5c6ef15"}
Jul 28 14:02:39.062652 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.062580    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:39.094979 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.094939    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-tls\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.094979 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.094989    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-grpc-tls\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095006    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-tls-assets\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095045    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpmbl\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-kube-api-access-jpmbl\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095161    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-db\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095207    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-config\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095237    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-kubelet-serving-ca-bundle\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095269    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-web-config\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095303    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-trusted-ca-bundle\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095337    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-serving-certs-ca-bundle\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095392    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095416    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-0\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095438    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-config-out\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095461    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-2\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095492    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-metrics-client-certs\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095516    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095540    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-metrics-client-ca\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095556    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.095886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095582    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-1\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095626    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-kube-rbac-proxy\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.095886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095671    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-thanos-prometheus-http-client-file\") pod \"d501ec35-c415-4a5e-965e-46c2fd7968fa\" (UID: \"d501ec35-c415-4a5e-965e-46c2fd7968fa\") "
Jul 28 14:02:39.096210 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.095914    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.096210 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.096186    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:02:39.096525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.096498    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.096615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.096541    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.097537 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.097384    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.097660 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.097635    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.098686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.098657    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.098686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.098672    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:02:39.098840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.098745    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.098840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.098750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-kube-api-access-jpmbl" (OuterVolumeSpecName: "kube-api-access-jpmbl") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "kube-api-access-jpmbl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:02:39.098840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.098797    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:02:39.099481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.099441    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.099908 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.099870    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.100320 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.100295    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.100407 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.100366    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.101154 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.101127    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-config-out" (OuterVolumeSpecName: "config-out") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:02:39.102009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.101987    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-config" (OuterVolumeSpecName: "config") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.102121 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.102043    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.102121 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.102011    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.113082 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.113052    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-web-config" (OuterVolumeSpecName: "web-config") pod "d501ec35-c415-4a5e-965e-46c2fd7968fa" (UID: "d501ec35-c415-4a5e-965e-46c2fd7968fa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:02:39.197261 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197227    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197261 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197257    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197261 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197268    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197277    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197286    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-config-out\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197295    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197304    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-metrics-client-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197312    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197320    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-configmap-metrics-client-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197329    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197338    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-kube-rbac-proxy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197347    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197355    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197363    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-secret-grpc-tls\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197371    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-tls-assets\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197378    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpmbl\" (UniqueName: \"kubernetes.io/projected/d501ec35-c415-4a5e-965e-46c2fd7968fa-kube-api-access-jpmbl\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197386    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d501ec35-c415-4a5e-965e-46c2fd7968fa-prometheus-k8s-db\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197393    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:39.197498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:39.197401    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d501ec35-c415-4a5e-965e-46c2fd7968fa-web-config\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:02:40.049754 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.049720    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d501ec35-c415-4a5e-965e-46c2fd7968fa","Type":"ContainerDied","Data":"ca19f08ec1c03f627d732fdc04a1f4432c885abd0dc1c862b7f32be3337efee2"}
Jul 28 14:02:40.049754 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.049757    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.050242 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.049816    2558 scope.go:117] "RemoveContainer" containerID="91484b30245b07dcd76a6dce6d54142edd86488694e21fa4663f3ae31339c5e3"
Jul 28 14:02:40.057361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.057344    2558 scope.go:117] "RemoveContainer" containerID="f98ffa4baeb8e47807565cfad77b2fce2ff51688042424cd0f250653c0a62694"
Jul 28 14:02:40.064175 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.064152    2558 scope.go:117] "RemoveContainer" containerID="0609a4163d0ea0ce3e2e053bbc0ab6111d94acebf4569395abd36398b8bacc96"
Jul 28 14:02:40.070601 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.070581    2558 scope.go:117] "RemoveContainer" containerID="e5b1f5a18ebcf0b5b44bce2f9871ec294364b1c2a957bc171818009b072f2dc7"
Jul 28 14:02:40.076951 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.076934    2558 scope.go:117] "RemoveContainer" containerID="b99d788bb7beb32807d44efefa863655ce96873bcbf0e2b4e0b8fa8d06e70db2"
Jul 28 14:02:40.083207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.083185    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:02:40.084381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.084367    2558 scope.go:117] "RemoveContainer" containerID="41b0f987711307a178d173cbbb8ff633caecae00a7472a5e225ef771e5c6ef15"
Jul 28 14:02:40.091777 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.091756    2558 scope.go:117] "RemoveContainer" containerID="4bc871b5be0b30ea39cdfa9f3f6f1e538a71904c7a0f46278432688566f1eaa0"
Jul 28 14:02:40.091866 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.091851    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:02:40.128144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128107    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:02:40.128447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128428    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8f7d2fd-689a-4db0-9d99-fa07c8238d15" containerName="console"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128449    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8f7d2fd-689a-4db0-9d99-fa07c8238d15" containerName="console"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128460    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="prometheus"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128468    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="prometheus"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128480    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="thanos-sidecar"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128489    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="thanos-sidecar"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128511    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="init-config-reloader"
Jul 28 14:02:40.128525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128521    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="init-config-reloader"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128535    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128543    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128560    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-thanos"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128569    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-thanos"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128580    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="config-reloader"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128588    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="config-reloader"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128601    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-web"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128610    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-web"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128679    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="config-reloader"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128692    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8f7d2fd-689a-4db0-9d99-fa07c8238d15" containerName="console"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128702    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="thanos-sidecar"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128712    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-web"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128721    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128730    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="kube-rbac-proxy-thanos"
Jul 28 14:02:40.128859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.128740    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" containerName="prometheus"
Jul 28 14:02:40.132958 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.132938    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.139809 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.139785    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 28 14:02:40.139932 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.139832    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 28 14:02:40.140737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140716    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 28 14:02:40.140841 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140742    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 28 14:02:40.140841 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140775    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2hhqv\""
Jul 28 14:02:40.140841 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140821    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 28 14:02:40.140996 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 28 14:02:40.140996 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140890    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 28 14:02:40.140996 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.140883    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-7agjc3scdp93p\""
Jul 28 14:02:40.141139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.141124    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 28 14:02:40.141626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.141610    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 28 14:02:40.141664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.141610    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 28 14:02:40.143419 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.143403    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 28 14:02:40.143730 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.143714    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 28 14:02:40.145817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.145799    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 28 14:02:40.156706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.156689    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 28 14:02:40.190473 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.190441    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:02:40.204053 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204061    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204079    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204099    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kl597\" (UniqueName: \"kubernetes.io/projected/3d24f14a-150e-407a-b2f7-4ac402291712-kube-api-access-kl597\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204123    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204151    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204195    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204211    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204274    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204326    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-config\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204391    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d24f14a-150e-407a-b2f7-4ac402291712-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204426    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204457    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d24f14a-150e-407a-b2f7-4ac402291712-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204506    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204591    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204621    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.204755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.204652    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.305748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305691    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.305748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305740    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.305748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305804    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305933    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.305975    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kl597\" (UniqueName: \"kubernetes.io/projected/3d24f14a-150e-407a-b2f7-4ac402291712-kube-api-access-kl597\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306041    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306110 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306080    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306148    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306178    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306208    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-config\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306236    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306264    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d24f14a-150e-407a-b2f7-4ac402291712-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306329    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d24f14a-150e-407a-b2f7-4ac402291712-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306376    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306744    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.306982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.306782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.308522 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.307407    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.309104 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.308930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.309104 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.308952    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.309268    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.309457    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-config\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.309502    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.309860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.310052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.310061    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.310058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.310088    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3d24f14a-150e-407a-b2f7-4ac402291712-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.310225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3d24f14a-150e-407a-b2f7-4ac402291712-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.310787 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.310735    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.311740 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.311716    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3d24f14a-150e-407a-b2f7-4ac402291712-config-out\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.311808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.311720    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.312077 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.312058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.312449 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.312434    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3d24f14a-150e-407a-b2f7-4ac402291712-web-config\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.318090 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.318070    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kl597\" (UniqueName: \"kubernetes.io/projected/3d24f14a-150e-407a-b2f7-4ac402291712-kube-api-access-kl597\") pod \"prometheus-k8s-0\" (UID: \"3d24f14a-150e-407a-b2f7-4ac402291712\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.442577 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.442485    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:40.601608 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:40.601582    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 28 14:02:40.604806 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:02:40.604133    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d24f14a_150e_407a_b2f7_4ac402291712.slice/crio-aecfd914af4828fed292401fbc826298940e0144fe7ddb7d464ddb5a94030eff WatchSource:0}: Error finding container aecfd914af4828fed292401fbc826298940e0144fe7ddb7d464ddb5a94030eff: Status 404 returned error can't find the container with id aecfd914af4828fed292401fbc826298940e0144fe7ddb7d464ddb5a94030eff
Jul 28 14:02:41.054783 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:41.054747    2558 generic.go:356] "Generic (PLEG): container finished" podID="3d24f14a-150e-407a-b2f7-4ac402291712" containerID="dc21ad7d09fde0256c78a09328673f641e3cd1e88f9e799ab2185ba8ecfa9b4c" exitCode=0
Jul 28 14:02:41.055246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:41.054828    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerDied","Data":"dc21ad7d09fde0256c78a09328673f641e3cd1e88f9e799ab2185ba8ecfa9b4c"}
Jul 28 14:02:41.055246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:41.054899    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"aecfd914af4828fed292401fbc826298940e0144fe7ddb7d464ddb5a94030eff"}
Jul 28 14:02:41.284040 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:41.283964    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d501ec35-c415-4a5e-965e-46c2fd7968fa" path="/var/lib/kubelet/pods/d501ec35-c415-4a5e-965e-46c2fd7968fa/volumes"
Jul 28 14:02:42.063370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.063328    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"a4a616c039a1cff2e3c0c9fd79521de0d204b872d784bf069e336965bdb942f9"}
Jul 28 14:02:42.063829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.063429    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"b10a75473a25af9b72e32b4a908ebd206dfea8be23e7498ecad8ae7f9275cf61"}
Jul 28 14:02:42.063829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.063455    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"19203eda6b2753cf997ea7de27c9c84384ffe443c6c5f32a6a6ed7ec42039aab"}
Jul 28 14:02:42.063829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.063481    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"29f203e1ebb143b17aa2987b48432b9d0711ed766ccb7531879c7c92f13a4f8c"}
Jul 28 14:02:42.063829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.063504    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"d65ad378e88ea5b0610f6388a0f700bc273cb31f817a7935244d747a9880071b"}
Jul 28 14:02:42.063829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.063529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3d24f14a-150e-407a-b2f7-4ac402291712","Type":"ContainerStarted","Data":"821d7c34ba3e3b275d0461b845d962263e9103a8e20c0bf1c83d28f3ee0fc6ce"}
Jul 28 14:02:42.105474 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.105387    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.086037557 podStartE2EDuration="2.105348955s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.311398ms" isStatefulPod=false podCreationTimestamp="2026-07-28 14:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:02:42.103592319 +0000 UTC m=+175.338111791" watchObservedRunningTime="2026-07-28 14:02:42.105348955 +0000 UTC m=+175.339868465"
Jul 28 14:02:42.456592 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.456486    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:42.538330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:42.538293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:45.443456 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:45.443421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:02:53.540797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:53.540764    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:53.641937 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:53.641897    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:02:53.733388 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:02:53.733350    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:24.583978 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:24.583933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:40.443551 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:40.443510    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:03:40.458657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:40.458633    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:03:41.291119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:41.291096    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 28 14:03:48.736409 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:48.736373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:48.811202 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:48.811170    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:50.330696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:50.330656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:50.430995 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:50.430965    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:50.510318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:50.510284    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:51.072954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:51.072919    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:03:51.172579 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:03:51.172545    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:00.806260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:00.806221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:00.871557 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:00.871527    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:01.792069 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:01.792010    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:01.864454 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:01.864414    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:08.634569 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:08.634531    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:08.737779 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:08.737742    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:09.231973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:09.231937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:04:47.122797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:47.122763    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:04:47.128236 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:47.128202    2558 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 14:04:47.130886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:04:47.130865    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:05:17.386981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:17.386933    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:20.495800 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:20.495765    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:39.540773 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:39.540688    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:40.587959 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:40.587926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:43.349990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:43.349957    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:43.454301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:43.454271    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:44.613914 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:44.613879    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:44.740771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:44.740738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:44.862861 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:44.862831    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:47.121435 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:47.121390    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:47.568283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:47.568244    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:49.970058 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:49.970008    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"]
Jul 28 14:05:49.972401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:49.972384    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:49.975228 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:49.975210    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 28 14:05:49.976163 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:49.976149    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 28 14:05:49.976220 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:49.976181    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-96j6t\""
Jul 28 14:05:49.987788 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:49.987765    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"]
Jul 28 14:05:50.062967 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.062934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmvz5\" (UniqueName: \"kubernetes.io/projected/26c9de16-eb94-4b2d-ac83-d48a0f76ef8d-kube-api-access-jmvz5\") pod \"cert-manager-cainjector-559cdd8c87-jrhm7\" (UID: \"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.063099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.062992    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c9de16-eb94-4b2d-ac83-d48a0f76ef8d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jrhm7\" (UID: \"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.164307 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.164275    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c9de16-eb94-4b2d-ac83-d48a0f76ef8d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jrhm7\" (UID: \"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.164434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.164351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmvz5\" (UniqueName: \"kubernetes.io/projected/26c9de16-eb94-4b2d-ac83-d48a0f76ef8d-kube-api-access-jmvz5\") pod \"cert-manager-cainjector-559cdd8c87-jrhm7\" (UID: \"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.174904 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.174872    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmvz5\" (UniqueName: \"kubernetes.io/projected/26c9de16-eb94-4b2d-ac83-d48a0f76ef8d-kube-api-access-jmvz5\") pod \"cert-manager-cainjector-559cdd8c87-jrhm7\" (UID: \"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.175014 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.174878    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c9de16-eb94-4b2d-ac83-d48a0f76ef8d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jrhm7\" (UID: \"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.294149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.294115    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"
Jul 28 14:05:50.346410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.346383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:50.422325 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.422200    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7"]
Jul 28 14:05:50.424947 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:05:50.424914    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26c9de16_eb94_4b2d_ac83_d48a0f76ef8d.slice/crio-bf4808cb9dee65c521605f6000e7aed519ae405a153a213a041d89ac7415b3da WatchSource:0}: Error finding container bf4808cb9dee65c521605f6000e7aed519ae405a153a213a041d89ac7415b3da: Status 404 returned error can't find the container with id bf4808cb9dee65c521605f6000e7aed519ae405a153a213a041d89ac7415b3da
Jul 28 14:05:50.426716 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.426693    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:05:50.427818 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.427793    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:50.737263 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:50.737173    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7" event={"ID":"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d","Type":"ContainerStarted","Data":"bf4808cb9dee65c521605f6000e7aed519ae405a153a213a041d89ac7415b3da"}
Jul 28 14:05:53.751909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:53.751878    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7" event={"ID":"26c9de16-eb94-4b2d-ac83-d48a0f76ef8d","Type":"ContainerStarted","Data":"dec6ec262a94526f36ff6de318abf651d63c5ecc48f0bb74c80939c9473cf67c"}
Jul 28 14:05:53.775438 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:53.775385    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jrhm7" podStartSLOduration=1.904761407 podStartE2EDuration="4.775369736s" totalImagesPullingTime="2.870608329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:05:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:05:53.773580528 +0000 UTC m=+367.008100000" watchObservedRunningTime="2026-07-28 14:05:53.775369736 +0000 UTC m=+367.009889209"
Jul 28 14:05:54.087506 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:54.087428    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:54.153669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:54.153633    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:54.298995 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:54.298955    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:55.168554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.168522    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pxzkw"]
Jul 28 14:05:55.171127 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.171110    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.174178 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.174158    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rd6n9\""
Jul 28 14:05:55.187949 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.187927    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pxzkw"]
Jul 28 14:05:55.308458 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.308425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vklrm\" (UniqueName: \"kubernetes.io/projected/9444244d-f6c0-471c-a434-990bd16c8fb7-kube-api-access-vklrm\") pod \"cert-manager-55b4d954d5-pxzkw\" (UID: \"9444244d-f6c0-471c-a434-990bd16c8fb7\") " pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.308614 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.308474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9444244d-f6c0-471c-a434-990bd16c8fb7-bound-sa-token\") pod \"cert-manager-55b4d954d5-pxzkw\" (UID: \"9444244d-f6c0-471c-a434-990bd16c8fb7\") " pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.408949 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.408914    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vklrm\" (UniqueName: \"kubernetes.io/projected/9444244d-f6c0-471c-a434-990bd16c8fb7-kube-api-access-vklrm\") pod \"cert-manager-55b4d954d5-pxzkw\" (UID: \"9444244d-f6c0-471c-a434-990bd16c8fb7\") " pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.409176 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.408961    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9444244d-f6c0-471c-a434-990bd16c8fb7-bound-sa-token\") pod \"cert-manager-55b4d954d5-pxzkw\" (UID: \"9444244d-f6c0-471c-a434-990bd16c8fb7\") " pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.419551 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.419484    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vklrm\" (UniqueName: \"kubernetes.io/projected/9444244d-f6c0-471c-a434-990bd16c8fb7-kube-api-access-vklrm\") pod \"cert-manager-55b4d954d5-pxzkw\" (UID: \"9444244d-f6c0-471c-a434-990bd16c8fb7\") " pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.419799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.419777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9444244d-f6c0-471c-a434-990bd16c8fb7-bound-sa-token\") pod \"cert-manager-55b4d954d5-pxzkw\" (UID: \"9444244d-f6c0-471c-a434-990bd16c8fb7\") " pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.479497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.479471    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-pxzkw"
Jul 28 14:05:55.607581 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.607480    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-pxzkw"]
Jul 28 14:05:55.610147 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:05:55.610115    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9444244d_f6c0_471c_a434_990bd16c8fb7.slice/crio-42e0f701a69dddefce3b77cda56a4d6a10e79181c066b30f10e574cbd8ac670c WatchSource:0}: Error finding container 42e0f701a69dddefce3b77cda56a4d6a10e79181c066b30f10e574cbd8ac670c: Status 404 returned error can't find the container with id 42e0f701a69dddefce3b77cda56a4d6a10e79181c066b30f10e574cbd8ac670c
Jul 28 14:05:55.760406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.760367    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pxzkw" event={"ID":"9444244d-f6c0-471c-a434-990bd16c8fb7","Type":"ContainerStarted","Data":"d6f85d1642a9b361161a4726275590232c2877062b420cafd2e2ef6877e6dab0"}
Jul 28 14:05:55.760565 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.760417    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-pxzkw" event={"ID":"9444244d-f6c0-471c-a434-990bd16c8fb7","Type":"ContainerStarted","Data":"42e0f701a69dddefce3b77cda56a4d6a10e79181c066b30f10e574cbd8ac670c"}
Jul 28 14:05:55.782439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:55.782398    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-pxzkw" podStartSLOduration=0.782385049 podStartE2EDuration="782.385049ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:05:55.781806499 +0000 UTC m=+369.016325971" watchObservedRunningTime="2026-07-28 14:05:55.782385049 +0000 UTC m=+369.016904520"
Jul 28 14:05:57.480273 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:57.480242    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:05:57.594059 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:05:57.594002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:03.419404 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:03.419328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:03.521204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:03.521174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:05.544204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:05.544169    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:19.979393 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:19.979359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:20.084065 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:20.083970    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:21.027782 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.027743    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"]
Jul 28 14:06:21.030934 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.030913    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.034281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.034260    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 28 14:06:21.034794 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.034770    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 28 14:06:21.034844 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.034825    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fp77x\""
Jul 28 14:06:21.034882 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.034846    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 28 14:06:21.035129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.035114    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 28 14:06:21.054210 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.054184    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"]
Jul 28 14:06:21.117963 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.117924    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08c2d094-31ad-4774-8620-310d1e0bf6c9-tmp\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.118157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.117968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08c2d094-31ad-4774-8620-310d1e0bf6c9-manifests\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.118157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.117999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjp47\" (UniqueName: \"kubernetes.io/projected/08c2d094-31ad-4774-8620-310d1e0bf6c9-kube-api-access-pjp47\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.118157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.118121    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08c2d094-31ad-4774-8620-310d1e0bf6c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.118301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.118157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08c2d094-31ad-4774-8620-310d1e0bf6c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.219044 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.218991    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08c2d094-31ad-4774-8620-310d1e0bf6c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.219044 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.219044    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08c2d094-31ad-4774-8620-310d1e0bf6c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.219292 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.219150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08c2d094-31ad-4774-8620-310d1e0bf6c9-tmp\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.219359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.219315    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08c2d094-31ad-4774-8620-310d1e0bf6c9-manifests\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.219434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.219377    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjp47\" (UniqueName: \"kubernetes.io/projected/08c2d094-31ad-4774-8620-310d1e0bf6c9-kube-api-access-pjp47\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.219706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.219681    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/08c2d094-31ad-4774-8620-310d1e0bf6c9-manifests\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.221341 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.221319    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/08c2d094-31ad-4774-8620-310d1e0bf6c9-tmp\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.221554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.221535    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08c2d094-31ad-4774-8620-310d1e0bf6c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.221603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.221589    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08c2d094-31ad-4774-8620-310d1e0bf6c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.231005 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.230980    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjp47\" (UniqueName: \"kubernetes.io/projected/08c2d094-31ad-4774-8620-310d1e0bf6c9-kube-api-access-pjp47\") pod \"opendatahub-operator-controller-manager-6b59958787-rk69m\" (UID: \"08c2d094-31ad-4774-8620-310d1e0bf6c9\") " pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.341992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.341904    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:21.487007 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.486979    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"]
Jul 28 14:06:21.489880 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:06:21.489854    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c2d094_31ad_4774_8620_310d1e0bf6c9.slice/crio-27b2a307c196eb0b0efa23f41b735686dbbfb0ee7ac972b478aa2bec7f18ef14 WatchSource:0}: Error finding container 27b2a307c196eb0b0efa23f41b735686dbbfb0ee7ac972b478aa2bec7f18ef14: Status 404 returned error can't find the container with id 27b2a307c196eb0b0efa23f41b735686dbbfb0ee7ac972b478aa2bec7f18ef14
Jul 28 14:06:21.854887 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.854853    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m" event={"ID":"08c2d094-31ad-4774-8620-310d1e0bf6c9","Type":"ContainerStarted","Data":"27b2a307c196eb0b0efa23f41b735686dbbfb0ee7ac972b478aa2bec7f18ef14"}
Jul 28 14:06:21.870904 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.870873    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:21.963542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:21.963504    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:24.871053 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:24.870939    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m" event={"ID":"08c2d094-31ad-4774-8620-310d1e0bf6c9","Type":"ContainerStarted","Data":"b328248b7b993e7145d3c664dd9eda6d1faa587e477296365aea7c5c799c63db"}
Jul 28 14:06:25.877875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:25.877836    2558 generic.go:356] "Generic (PLEG): container finished" podID="08c2d094-31ad-4774-8620-310d1e0bf6c9" containerID="b328248b7b993e7145d3c664dd9eda6d1faa587e477296365aea7c5c799c63db" exitCode=0
Jul 28 14:06:25.877875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:25.877876    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m" event={"ID":"08c2d094-31ad-4774-8620-310d1e0bf6c9","Type":"ContainerDied","Data":"b328248b7b993e7145d3c664dd9eda6d1faa587e477296365aea7c5c799c63db"}
Jul 28 14:06:26.885188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:26.885143    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m" event={"ID":"08c2d094-31ad-4774-8620-310d1e0bf6c9","Type":"ContainerStarted","Data":"ae7bf18993a5a0378efb993257359cde6dbe744f891353c8252abc3aa6c314fc"}
Jul 28 14:06:26.885620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:26.885242    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:26.915577 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:26.915524    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m" podStartSLOduration=2.445395651 podStartE2EDuration="6.915505501s" totalImagesPullingTime="3.452209739s" totalInitContainerRuntime="1.017900111s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:26.914930961 +0000 UTC m=+400.149450432" watchObservedRunningTime="2026-07-28 14:06:26.915505501 +0000 UTC m=+400.150024973"
Jul 28 14:06:28.888351 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:28.888319    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:28.985796 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:28.985760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:37.892269 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:37.892239    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b59958787-rk69m"
Jul 28 14:06:40.736393 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:40.736363    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:40.872371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:40.872335    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:41.344365 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:41.344328    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:41.655089 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:41.654959    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:41.798317 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:41.798270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:41.918552 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:41.918468    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:42.051626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:42.051591    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:42.432206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:42.432174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:42.657873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:42.657837    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:43.251149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:43.251108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:43.329270 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:43.329232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:44.964449 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:44.964411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:48.898909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:48.898865    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:49.006009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:49.005973    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:49.999652 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:49.999620    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"]
Jul 28 14:06:50.002874 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.002856    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.006059 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.006036    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-v5dkw\""
Jul 28 14:06:50.006529 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.006510    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 14:06:50.007872 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.007850    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 14:06:50.007982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.007850    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 28 14:06:50.046963 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.046928    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"]
Jul 28 14:06:50.060734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.060707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:50.083924 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.083890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jc7\" (UniqueName: \"kubernetes.io/projected/dacc540f-b0d0-41ac-a720-5ea6f71a433d-kube-api-access-h7jc7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.083941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.083966    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.084009    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.084070    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.084105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.084137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.084159    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.084181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.084180    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185253 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185216    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185262    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185351    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jc7\" (UniqueName: \"kubernetes.io/projected/dacc540f-b0d0-41ac-a720-5ea6f71a433d-kube-api-access-h7jc7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185423    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185465    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185673    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185702    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185983 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185853    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.185983 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.185875    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.186268 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.186241    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.187786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.187764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.187915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.187764    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.201799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.201777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jc7\" (UniqueName: \"kubernetes.io/projected/dacc540f-b0d0-41ac-a720-5ea6f71a433d-kube-api-access-h7jc7\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.202776 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.202759    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dacc540f-b0d0-41ac-a720-5ea6f71a433d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ccflh6\" (UID: \"dacc540f-b0d0-41ac-a720-5ea6f71a433d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.217499 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.217476    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:50.313225 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.313135    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:50.351187 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.351154    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:50.458371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.458329    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"]
Jul 28 14:06:50.458589 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:06:50.458559    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddacc540f_b0d0_41ac_a720_5ea6f71a433d.slice/crio-dadc6c45861caf8c5aa8db3e50fe0f6cc4bc0edd2475d4cf15590361050f41d4 WatchSource:0}: Error finding container dadc6c45861caf8c5aa8db3e50fe0f6cc4bc0edd2475d4cf15590361050f41d4: Status 404 returned error can't find the container with id dadc6c45861caf8c5aa8db3e50fe0f6cc4bc0edd2475d4cf15590361050f41d4
Jul 28 14:06:50.688761 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.688680    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"]
Jul 28 14:06:50.691969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.691954    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.695518 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.695498    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 28 14:06:50.696212 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.696123    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qmc27\""
Jul 28 14:06:50.696576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.696556    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 28 14:06:50.696668 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.696612    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 28 14:06:50.696668 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.696562    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 28 14:06:50.696668 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.696660    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 28 14:06:50.707292 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.707266    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"]
Jul 28 14:06:50.790669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.790634    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6adb5a07-1307-44cc-b051-193a47556b65-manager-config\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.790669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.790668    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6adb5a07-1307-44cc-b051-193a47556b65-cert\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.790851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.790693    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mthq7\" (UniqueName: \"kubernetes.io/projected/6adb5a07-1307-44cc-b051-193a47556b65-kube-api-access-mthq7\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.790851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.790774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6adb5a07-1307-44cc-b051-193a47556b65-metrics-cert\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.892103 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.892066    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6adb5a07-1307-44cc-b051-193a47556b65-manager-config\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.892103 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.892105    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6adb5a07-1307-44cc-b051-193a47556b65-cert\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.892499 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.892131    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mthq7\" (UniqueName: \"kubernetes.io/projected/6adb5a07-1307-44cc-b051-193a47556b65-kube-api-access-mthq7\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.892499 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.892190    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6adb5a07-1307-44cc-b051-193a47556b65-metrics-cert\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.892819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.892797    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6adb5a07-1307-44cc-b051-193a47556b65-manager-config\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.894654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.894631    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6adb5a07-1307-44cc-b051-193a47556b65-cert\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.894765 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.894696    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6adb5a07-1307-44cc-b051-193a47556b65-metrics-cert\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.903890 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.903867    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mthq7\" (UniqueName: \"kubernetes.io/projected/6adb5a07-1307-44cc-b051-193a47556b65-kube-api-access-mthq7\") pod \"lws-controller-manager-84947845b-pnrwl\" (UID: \"6adb5a07-1307-44cc-b051-193a47556b65\") " pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:50.987154 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:50.987069    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6" event={"ID":"dacc540f-b0d0-41ac-a720-5ea6f71a433d","Type":"ContainerStarted","Data":"dadc6c45861caf8c5aa8db3e50fe0f6cc4bc0edd2475d4cf15590361050f41d4"}
Jul 28 14:06:51.001302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:51.001275    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:51.160323 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:51.160293    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"]
Jul 28 14:06:51.161411 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:06:51.161381    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6adb5a07_1307_44cc_b051_193a47556b65.slice/crio-1cf062062ac88443f8e833e3866742e65d128ac61f96f4f09fe1bd4cb0fb2f77 WatchSource:0}: Error finding container 1cf062062ac88443f8e833e3866742e65d128ac61f96f4f09fe1bd4cb0fb2f77: Status 404 returned error can't find the container with id 1cf062062ac88443f8e833e3866742e65d128ac61f96f4f09fe1bd4cb0fb2f77
Jul 28 14:06:52.013234 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:52.013193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl" event={"ID":"6adb5a07-1307-44cc-b051-193a47556b65","Type":"ContainerStarted","Data":"1cf062062ac88443f8e833e3866742e65d128ac61f96f4f09fe1bd4cb0fb2f77"}
Jul 28 14:06:53.008720 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.008683    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:53.109940 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.109877    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:53.124959 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.124919    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"]
Jul 28 14:06:53.130769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.130732    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.138666 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.138612    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 28 14:06:53.138981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.138934    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-gf574\""
Jul 28 14:06:53.158323 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.158287    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"]
Jul 28 14:06:53.214465 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.214427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4w5z\" (UniqueName: \"kubernetes.io/projected/b44ea676-341a-43dc-8573-38af58216cad-kube-api-access-t4w5z\") pod \"llmisvc-controller-manager-777c6bd7d5-h585h\" (UID: \"b44ea676-341a-43dc-8573-38af58216cad\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.214602 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.214504    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b44ea676-341a-43dc-8573-38af58216cad-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h585h\" (UID: \"b44ea676-341a-43dc-8573-38af58216cad\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.233743 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.233709    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:53.305935 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.305844    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:53.315036 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.314984    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4w5z\" (UniqueName: \"kubernetes.io/projected/b44ea676-341a-43dc-8573-38af58216cad-kube-api-access-t4w5z\") pod \"llmisvc-controller-manager-777c6bd7d5-h585h\" (UID: \"b44ea676-341a-43dc-8573-38af58216cad\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.315189 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.315082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b44ea676-341a-43dc-8573-38af58216cad-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h585h\" (UID: \"b44ea676-341a-43dc-8573-38af58216cad\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.317768 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.317746    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b44ea676-341a-43dc-8573-38af58216cad-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h585h\" (UID: \"b44ea676-341a-43dc-8573-38af58216cad\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.326789 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.326768    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4w5z\" (UniqueName: \"kubernetes.io/projected/b44ea676-341a-43dc-8573-38af58216cad-kube-api-access-t4w5z\") pod \"llmisvc-controller-manager-777c6bd7d5-h585h\" (UID: \"b44ea676-341a-43dc-8573-38af58216cad\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:53.443180 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:53.443140    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:54.348659 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.348619    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:54.449470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.449430    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:54.533188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.533157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:54.611611 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.611557    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:06:54.611720 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.611661    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:06:54.611720 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.611706    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:06:54.629953 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.629921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:06:54.763441 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:54.763406    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"]
Jul 28 14:06:54.766833 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:06:54.766804    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb44ea676_341a_43dc_8573_38af58216cad.slice/crio-eb126ecccb0cd639e98ee5c1640e55e848b38dff50237417eac395ef11085501 WatchSource:0}: Error finding container eb126ecccb0cd639e98ee5c1640e55e848b38dff50237417eac395ef11085501: Status 404 returned error can't find the container with id eb126ecccb0cd639e98ee5c1640e55e848b38dff50237417eac395ef11085501
Jul 28 14:06:55.027100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.027062    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl" event={"ID":"6adb5a07-1307-44cc-b051-193a47556b65","Type":"ContainerStarted","Data":"d52458e612d77f0851b8df5930a02bc7d23598e5fe8db98ad5b3d19e60c2a677"}
Jul 28 14:06:55.027306 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.027148    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:06:55.028348 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.028321    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h" event={"ID":"b44ea676-341a-43dc-8573-38af58216cad","Type":"ContainerStarted","Data":"eb126ecccb0cd639e98ee5c1640e55e848b38dff50237417eac395ef11085501"}
Jul 28 14:06:55.029707 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.029684    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6" event={"ID":"dacc540f-b0d0-41ac-a720-5ea6f71a433d","Type":"ContainerStarted","Data":"a1f27b314f6f1226d2ca15f09d9d669c5b7a927c22ed17bc13a7d0af712dfcb1"}
Jul 28 14:06:55.067237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.067182    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl" podStartSLOduration=1.6248045009999998 podStartE2EDuration="5.067163534s" totalImagesPullingTime="3.442359033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:55.066469667 +0000 UTC m=+428.300989139" watchObservedRunningTime="2026-07-28 14:06:55.067163534 +0000 UTC m=+428.301682983"
Jul 28 14:06:55.122329 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.122268    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6" podStartSLOduration=1.971701982 podStartE2EDuration="6.122249528s" totalImagesPullingTime="4.150547546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:55.121619847 +0000 UTC m=+428.356139319" watchObservedRunningTime="2026-07-28 14:06:55.122249528 +0000 UTC m=+428.356768999"
Jul 28 14:06:55.313688 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.313596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:55.318192 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:55.318166    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:56.035884 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:56.035820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:56.037098 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:56.037072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ccflh6"
Jul 28 14:06:58.046326 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:58.046214    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h" event={"ID":"b44ea676-341a-43dc-8573-38af58216cad","Type":"ContainerStarted","Data":"475690d106432a0be36d5b32797ef4865d8707a6febd951582310203471e1609"}
Jul 28 14:06:58.046746 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:58.046546    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:06:58.084038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:06:58.083957    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h" podStartSLOduration=2.101818769 podStartE2EDuration="5.083937376s" totalImagesPullingTime="2.982118607s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:06:58.078235681 +0000 UTC m=+431.312755154" watchObservedRunningTime="2026-07-28 14:06:58.083937376 +0000 UTC m=+431.318456901"
Jul 28 14:07:06.037856 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:06.037821    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-84947845b-pnrwl"
Jul 28 14:07:20.446659 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:20.446574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:20.517593 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:20.517559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:29.052238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:29.052200    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h585h"
Jul 28 14:07:42.207730 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.207682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:42.301499 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.301464    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:42.696841 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.696807    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:42.917817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.917784    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqjzf"]
Jul 28 14:07:42.920571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.920555    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:42.924604 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.924578    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 28 14:07:42.925161 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.925144    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 28 14:07:42.925689 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.925670    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-nvrz6\""
Jul 28 14:07:42.935812 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.935779    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqjzf"]
Jul 28 14:07:42.946407 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:42.946380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mrmt\" (UniqueName: \"kubernetes.io/projected/a5aa37fb-19ba-4976-be35-7cd723a7b43b-kube-api-access-8mrmt\") pod \"kuadrant-operator-catalog-nqjzf\" (UID: \"a5aa37fb-19ba-4976-be35-7cd723a7b43b\") " pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:43.046992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:43.046963    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mrmt\" (UniqueName: \"kubernetes.io/projected/a5aa37fb-19ba-4976-be35-7cd723a7b43b-kube-api-access-8mrmt\") pod \"kuadrant-operator-catalog-nqjzf\" (UID: \"a5aa37fb-19ba-4976-be35-7cd723a7b43b\") " pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:43.058883 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:43.058860    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mrmt\" (UniqueName: \"kubernetes.io/projected/a5aa37fb-19ba-4976-be35-7cd723a7b43b-kube-api-access-8mrmt\") pod \"kuadrant-operator-catalog-nqjzf\" (UID: \"a5aa37fb-19ba-4976-be35-7cd723a7b43b\") " pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:43.231254 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:43.231220    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:43.370343 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:43.370316    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-nqjzf"]
Jul 28 14:07:43.371690 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:07:43.371667    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5aa37fb_19ba_4976_be35_7cd723a7b43b.slice/crio-1765aa9f20474a6c653914885a676816ad9d9ea7c8b853ff20763d8a604e8b53 WatchSource:0}: Error finding container 1765aa9f20474a6c653914885a676816ad9d9ea7c8b853ff20763d8a604e8b53: Status 404 returned error can't find the container with id 1765aa9f20474a6c653914885a676816ad9d9ea7c8b853ff20763d8a604e8b53
Jul 28 14:07:44.249634 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:44.249600    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf" event={"ID":"a5aa37fb-19ba-4976-be35-7cd723a7b43b","Type":"ContainerStarted","Data":"1765aa9f20474a6c653914885a676816ad9d9ea7c8b853ff20763d8a604e8b53"}
Jul 28 14:07:45.255623 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:45.255579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf" event={"ID":"a5aa37fb-19ba-4976-be35-7cd723a7b43b","Type":"ContainerStarted","Data":"ab4b14a4fcad1bdd9b31392b4e91140cec476a0eea8ec3e3006e94f00990e7f8"}
Jul 28 14:07:45.276755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:45.276688    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf" podStartSLOduration=1.5733374549999999 podStartE2EDuration="3.276674586s" totalImagesPullingTime="1.703337131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:07:45.275140708 +0000 UTC m=+478.509660190" watchObservedRunningTime="2026-07-28 14:07:45.276674586 +0000 UTC m=+478.511194057"
Jul 28 14:07:53.231795 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:53.231755    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:53.232342 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:53.231826    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:53.253391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:53.253363    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:53.308808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:53.308780    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-nqjzf"
Jul 28 14:07:57.505374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.505339    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69c445bf58-scldl"]
Jul 28 14:07:57.508360 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.508344    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.512620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.512587    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 14:07:57.512746 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.512630    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9vhmj\""
Jul 28 14:07:57.512746 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.512633    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 14:07:57.513833 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.513811    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 14:07:57.513982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.513955    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 14:07:57.514065 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.514033    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 14:07:57.517253 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.517233    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 14:07:57.524560 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.524537    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c445bf58-scldl"]
Jul 28 14:07:57.567620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.567590    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:57.572699 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572677    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-service-ca\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.572764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572712    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-config\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.572764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572736    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zm84\" (UniqueName: \"kubernetes.io/projected/769cccca-e76b-4d78-8bcf-2cf789115c9a-kube-api-access-9zm84\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.572829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572819    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-oauth-serving-cert\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.572863 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-oauth-config\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.572899 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572889    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-serving-cert\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.572973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.572956    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-trusted-ca-bundle\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.645967 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.645931    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:07:57.674338 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674310    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-trusted-ca-bundle\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.674489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674364    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-service-ca\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.674489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674459    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-config\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.674489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674477    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zm84\" (UniqueName: \"kubernetes.io/projected/769cccca-e76b-4d78-8bcf-2cf789115c9a-kube-api-access-9zm84\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.674655 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674502    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-oauth-serving-cert\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.674655 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674524    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-oauth-config\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.674780 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.674659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-serving-cert\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.675299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.675237    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-service-ca\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.675414 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.675314    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-config\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.675481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.675447    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-oauth-serving-cert\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.675540 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.675486    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769cccca-e76b-4d78-8bcf-2cf789115c9a-trusted-ca-bundle\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.676980 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.676956    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-serving-cert\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.677077 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.676985    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769cccca-e76b-4d78-8bcf-2cf789115c9a-console-oauth-config\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.685303 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.685284    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zm84\" (UniqueName: \"kubernetes.io/projected/769cccca-e76b-4d78-8bcf-2cf789115c9a-kube-api-access-9zm84\") pod \"console-69c445bf58-scldl\" (UID: \"769cccca-e76b-4d78-8bcf-2cf789115c9a\") " pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.817703 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.817625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:07:57.947086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:57.947036    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c445bf58-scldl"]
Jul 28 14:07:57.949254 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:07:57.949227    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769cccca_e76b_4d78_8bcf_2cf789115c9a.slice/crio-e08ba6c32805479063f3a53bde36fb7fece3fac98605b09e56dfc564b6d30426 WatchSource:0}: Error finding container e08ba6c32805479063f3a53bde36fb7fece3fac98605b09e56dfc564b6d30426: Status 404 returned error can't find the container with id e08ba6c32805479063f3a53bde36fb7fece3fac98605b09e56dfc564b6d30426
Jul 28 14:07:58.309894 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:58.309854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c445bf58-scldl" event={"ID":"769cccca-e76b-4d78-8bcf-2cf789115c9a","Type":"ContainerStarted","Data":"e7bd1bb7baed74e61ce86c2e1687669ba5bc5c84bd516215719cc435355f8bcf"}
Jul 28 14:07:58.310087 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:58.309911    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c445bf58-scldl" event={"ID":"769cccca-e76b-4d78-8bcf-2cf789115c9a","Type":"ContainerStarted","Data":"e08ba6c32805479063f3a53bde36fb7fece3fac98605b09e56dfc564b6d30426"}
Jul 28 14:07:58.332813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:07:58.332764    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69c445bf58-scldl" podStartSLOduration=1.332747267 podStartE2EDuration="1.332747267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:07:58.331146654 +0000 UTC m=+491.565666128" watchObservedRunningTime="2026-07-28 14:07:58.332747267 +0000 UTC m=+491.567266818"
Jul 28 14:08:06.187553 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:06.187508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:06.796902 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:06.796866    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:07.818573 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:07.818540    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:08:07.818994 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:07.818634    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:08:07.823515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:07.823495    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:08:07.856882 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:07.856849    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:08.361252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:08.361219    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69c445bf58-scldl"
Jul 28 14:08:08.569132 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:08.569092    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:08.672938 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:08.672862    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:08.768983 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:08.768949    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:11.204940 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:11.204903    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:13.102526 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.102488    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"]
Jul 28 14:08:13.104938 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.104915    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:13.112837 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.112820    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-vlnsd\""
Jul 28 14:08:13.113169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.113152    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 28 14:08:13.132175 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.132148    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"]
Jul 28 14:08:13.214690 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.214659    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdrp7\" (UniqueName: \"kubernetes.io/projected/0d9be928-788a-4960-af4e-eaaf4ec45b39-kube-api-access-rdrp7\") pod \"dns-operator-controller-manager-864dd78c4c-kf29k\" (UID: \"0d9be928-788a-4960-af4e-eaaf4ec45b39\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:13.315590 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.315548    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdrp7\" (UniqueName: \"kubernetes.io/projected/0d9be928-788a-4960-af4e-eaaf4ec45b39-kube-api-access-rdrp7\") pod \"dns-operator-controller-manager-864dd78c4c-kf29k\" (UID: \"0d9be928-788a-4960-af4e-eaaf4ec45b39\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:13.334010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.333978    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdrp7\" (UniqueName: \"kubernetes.io/projected/0d9be928-788a-4960-af4e-eaaf4ec45b39-kube-api-access-rdrp7\") pod \"dns-operator-controller-manager-864dd78c4c-kf29k\" (UID: \"0d9be928-788a-4960-af4e-eaaf4ec45b39\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:13.416037 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.415939    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:13.571076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.571050    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"]
Jul 28 14:08:13.573103 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:08:13.573080    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d9be928_788a_4960_af4e_eaaf4ec45b39.slice/crio-941ab486c3c48011837e505040f07854d83082e5f77bba0020cdcfb22829fec5 WatchSource:0}: Error finding container 941ab486c3c48011837e505040f07854d83082e5f77bba0020cdcfb22829fec5: Status 404 returned error can't find the container with id 941ab486c3c48011837e505040f07854d83082e5f77bba0020cdcfb22829fec5
Jul 28 14:08:13.816637 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:13.816600    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:14.067730 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:14.067618    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:14.384154 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:14.384079    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k" event={"ID":"0d9be928-788a-4960-af4e-eaaf4ec45b39","Type":"ContainerStarted","Data":"941ab486c3c48011837e505040f07854d83082e5f77bba0020cdcfb22829fec5"}
Jul 28 14:08:15.823107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:15.823070    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"]
Jul 28 14:08:15.825528 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:15.825510    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:15.829099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:15.829077    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6w6bq\""
Jul 28 14:08:15.843676 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:15.843655    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"]
Jul 28 14:08:15.942045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:15.941925    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qx2j\" (UniqueName: \"kubernetes.io/projected/e2f642a5-97c9-4e8c-85ff-237bb13711bd-kube-api-access-2qx2j\") pod \"limitador-operator-controller-manager-859d7b78bd-p2v2h\" (UID: \"e2f642a5-97c9-4e8c-85ff-237bb13711bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:16.043376 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.043338    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qx2j\" (UniqueName: \"kubernetes.io/projected/e2f642a5-97c9-4e8c-85ff-237bb13711bd-kube-api-access-2qx2j\") pod \"limitador-operator-controller-manager-859d7b78bd-p2v2h\" (UID: \"e2f642a5-97c9-4e8c-85ff-237bb13711bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:16.055068 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.055041    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qx2j\" (UniqueName: \"kubernetes.io/projected/e2f642a5-97c9-4e8c-85ff-237bb13711bd-kube-api-access-2qx2j\") pod \"limitador-operator-controller-manager-859d7b78bd-p2v2h\" (UID: \"e2f642a5-97c9-4e8c-85ff-237bb13711bd\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:16.135512 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.135477    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:16.272791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.272770    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"]
Jul 28 14:08:16.274983 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:08:16.274944    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2f642a5_97c9_4e8c_85ff_237bb13711bd.slice/crio-61394e0e0e173af4f9d946106e38a906c3f43fc7bb1249a151e2c09b1ce7f2b3 WatchSource:0}: Error finding container 61394e0e0e173af4f9d946106e38a906c3f43fc7bb1249a151e2c09b1ce7f2b3: Status 404 returned error can't find the container with id 61394e0e0e173af4f9d946106e38a906c3f43fc7bb1249a151e2c09b1ce7f2b3
Jul 28 14:08:16.395793 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.395761    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k" event={"ID":"0d9be928-788a-4960-af4e-eaaf4ec45b39","Type":"ContainerStarted","Data":"dc04257bd04dbfedd6d631423ac937fad260369d9455dfa5bf24bffcc819378d"}
Jul 28 14:08:16.395960 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.395824    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:16.397139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.397112    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h" event={"ID":"e2f642a5-97c9-4e8c-85ff-237bb13711bd","Type":"ContainerStarted","Data":"61394e0e0e173af4f9d946106e38a906c3f43fc7bb1249a151e2c09b1ce7f2b3"}
Jul 28 14:08:16.417225 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:16.417181    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k" podStartSLOduration=1.308962733 podStartE2EDuration="3.417165934s" totalImagesPullingTime="2.108203201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:16.415312973 +0000 UTC m=+509.649832446" watchObservedRunningTime="2026-07-28 14:08:16.417165934 +0000 UTC m=+509.651685405"
Jul 28 14:08:17.421954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:17.421916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:17.530362 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:17.530330    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:18.407172 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:18.407132    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h" event={"ID":"e2f642a5-97c9-4e8c-85ff-237bb13711bd","Type":"ContainerStarted","Data":"4bfd486be0f6ee7c766565fcb1031e6a3e877f66e02044e0fb330356490353ff"}
Jul 28 14:08:18.407343 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:18.407261    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:18.443581 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:18.443529    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h" podStartSLOduration=1.729737297 podStartE2EDuration="3.443513593s" totalImagesPullingTime="1.713776296s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:18.442031295 +0000 UTC m=+511.676550768" watchObservedRunningTime="2026-07-28 14:08:18.443513593 +0000 UTC m=+511.678033065"
Jul 28 14:08:18.916682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:18.916649    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:21.440148 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:21.440117    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:21.608245 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:21.608217    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:21.716946 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:21.716858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:21.818208 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:21.818177    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:25.241631 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:25.241597    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:25.339651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:25.339616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:27.403499 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:27.403461    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-kf29k"
Jul 28 14:08:29.265852 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:29.265817    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:29.364366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:29.364314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:29.414150 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:29.414121    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:29.729041 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:29.728941    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:29.882875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:29.882843    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:32.812701 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:32.812670    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:32.916713 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:32.916682    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:39.700428 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.700335    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"]
Jul 28 14:08:39.705177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.705153    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:39.708859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.708836    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mv7mq\""
Jul 28 14:08:39.708988 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.708888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swrmz\" (UniqueName: \"kubernetes.io/projected/10076469-7862-44af-8f0a-062ab743cf1b-kube-api-access-swrmz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:39.708988 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.708962    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10076469-7862-44af-8f0a-062ab743cf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:39.720767 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.720744    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"]
Jul 28 14:08:39.810000 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.809958    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swrmz\" (UniqueName: \"kubernetes.io/projected/10076469-7862-44af-8f0a-062ab743cf1b-kube-api-access-swrmz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:39.810203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.810053    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10076469-7862-44af-8f0a-062ab743cf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:39.810433 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.810416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10076469-7862-44af-8f0a-062ab743cf1b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:39.824389 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:39.824355    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swrmz\" (UniqueName: \"kubernetes.io/projected/10076469-7862-44af-8f0a-062ab743cf1b-kube-api-access-swrmz\") pod \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:40.015982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.015948    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:40.165980 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.165954    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"]
Jul 28 14:08:40.167649 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:08:40.167615    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10076469_7862_44af_8f0a_062ab743cf1b.slice/crio-5f3d6686bb185a187f641b74de8fb8801b5506f9fa763f43af7bfb5a8551af96 WatchSource:0}: Error finding container 5f3d6686bb185a187f641b74de8fb8801b5506f9fa763f43af7bfb5a8551af96: Status 404 returned error can't find the container with id 5f3d6686bb185a187f641b74de8fb8801b5506f9fa763f43af7bfb5a8551af96
Jul 28 14:08:40.245211 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.245184    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"]
Jul 28 14:08:40.247838 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.247815    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"]
Jul 28 14:08:40.323347 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.323278    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"]
Jul 28 14:08:40.323504 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.323482    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" containerName="manager" containerID="cri-o://4bfd486be0f6ee7c766565fcb1031e6a3e877f66e02044e0fb330356490353ff" gracePeriod=2
Jul 28 14:08:40.330302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.330278    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"]
Jul 28 14:08:40.350106 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.350081    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"]
Jul 28 14:08:40.350425 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.350412    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" containerName="manager"
Jul 28 14:08:40.350425 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.350425    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" containerName="manager"
Jul 28 14:08:40.350509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.350487    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" containerName="manager"
Jul 28 14:08:40.353842 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.353823    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.358225 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:40.358197    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2v2h\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:40.362944 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.362924    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"]
Jul 28 14:08:40.366354 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.366337    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:40.373927 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.373904    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"]
Jul 28 14:08:40.379780 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.379755    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"]
Jul 28 14:08:40.414575 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.414544    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkbdw\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.414670 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.414647    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-kube-api-access-8htm9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkbdw\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.434050 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:40.434006    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2v2h\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:40.510687 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.510657    2558 generic.go:356] "Generic (PLEG): container finished" podID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" containerID="4bfd486be0f6ee7c766565fcb1031e6a3e877f66e02044e0fb330356490353ff" exitCode=0
Jul 28 14:08:40.515906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.515878    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-kube-api-access-8htm9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkbdw\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.516059 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.515964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8v9\" (UniqueName: \"kubernetes.io/projected/0901b206-c5dd-40e4-b7b2-8413c4af59f0-kube-api-access-qz8v9\") pod \"limitador-operator-controller-manager-859d7b78bd-4hmks\" (UID: \"0901b206-c5dd-40e4-b7b2-8413c4af59f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:40.516131 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.516082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkbdw\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.516417 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.516396    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkbdw\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.526482 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.526460    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-kube-api-access-8htm9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zkbdw\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.550915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.550895    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:40.553478 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:40.553451    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p2v2h\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:40.616937 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.616849    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qx2j\" (UniqueName: \"kubernetes.io/projected/e2f642a5-97c9-4e8c-85ff-237bb13711bd-kube-api-access-2qx2j\") pod \"e2f642a5-97c9-4e8c-85ff-237bb13711bd\" (UID: \"e2f642a5-97c9-4e8c-85ff-237bb13711bd\") "
Jul 28 14:08:40.617107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.617051    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8v9\" (UniqueName: \"kubernetes.io/projected/0901b206-c5dd-40e4-b7b2-8413c4af59f0-kube-api-access-qz8v9\") pod \"limitador-operator-controller-manager-859d7b78bd-4hmks\" (UID: \"0901b206-c5dd-40e4-b7b2-8413c4af59f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:40.619028 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.618994    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2f642a5-97c9-4e8c-85ff-237bb13711bd-kube-api-access-2qx2j" (OuterVolumeSpecName: "kube-api-access-2qx2j") pod "e2f642a5-97c9-4e8c-85ff-237bb13711bd" (UID: "e2f642a5-97c9-4e8c-85ff-237bb13711bd"). InnerVolumeSpecName "kube-api-access-2qx2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:08:40.627396 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.627370    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8v9\" (UniqueName: \"kubernetes.io/projected/0901b206-c5dd-40e4-b7b2-8413c4af59f0-kube-api-access-qz8v9\") pod \"limitador-operator-controller-manager-859d7b78bd-4hmks\" (UID: \"0901b206-c5dd-40e4-b7b2-8413c4af59f0\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:40.700952 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.700914    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:40.710057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.710001    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:40.718156 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.718129    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qx2j\" (UniqueName: \"kubernetes.io/projected/e2f642a5-97c9-4e8c-85ff-237bb13711bd-kube-api-access-2qx2j\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:08:40.864133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.864098    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"]
Jul 28 14:08:40.867525 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:08:40.867465    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6ae9b8_1558_4e57_adcc_d2c53a0ecb08.slice/crio-a7bae0f5b4336e0ddfc2822ce8feb3189dffb260775cf659ca775b297fcaab2d WatchSource:0}: Error finding container a7bae0f5b4336e0ddfc2822ce8feb3189dffb260775cf659ca775b297fcaab2d: Status 404 returned error can't find the container with id a7bae0f5b4336e0ddfc2822ce8feb3189dffb260775cf659ca775b297fcaab2d
Jul 28 14:08:40.892688 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:40.892428    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"]
Jul 28 14:08:40.894837 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:08:40.894806    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0901b206_c5dd_40e4_b7b2_8413c4af59f0.slice/crio-8156f6d57ab4f58685440c2ddc1b5fce43af325d0e7998e97eb858a625c60102 WatchSource:0}: Error finding container 8156f6d57ab4f58685440c2ddc1b5fce43af325d0e7998e97eb858a625c60102: Status 404 returned error can't find the container with id 8156f6d57ab4f58685440c2ddc1b5fce43af325d0e7998e97eb858a625c60102
Jul 28 14:08:41.002339 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.002309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:41.223651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.223567    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:41.283116 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.283076    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2f642a5-97c9-4e8c-85ff-237bb13711bd" path="/var/lib/kubelet/pods/e2f642a5-97c9-4e8c-85ff-237bb13711bd/volumes"
Jul 28 14:08:41.521346 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.521302    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks" event={"ID":"0901b206-c5dd-40e4-b7b2-8413c4af59f0","Type":"ContainerStarted","Data":"983fd2842765df0a01b9f510ee803087542d811236d0a7d682e6850bda4ceb50"}
Jul 28 14:08:41.521582 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.521375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks" event={"ID":"0901b206-c5dd-40e4-b7b2-8413c4af59f0","Type":"ContainerStarted","Data":"8156f6d57ab4f58685440c2ddc1b5fce43af325d0e7998e97eb858a625c60102"}
Jul 28 14:08:41.521582 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.521455    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:41.522768 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.522742    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p2v2h"
Jul 28 14:08:41.522880 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.522747    2558 scope.go:117] "RemoveContainer" containerID="4bfd486be0f6ee7c766565fcb1031e6a3e877f66e02044e0fb330356490353ff"
Jul 28 14:08:41.524395 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.524369    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw" event={"ID":"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08","Type":"ContainerStarted","Data":"a7bae0f5b4336e0ddfc2822ce8feb3189dffb260775cf659ca775b297fcaab2d"}
Jul 28 14:08:41.537965 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.537937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:41.546172 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.546135    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks" podStartSLOduration=1.546118957 podStartE2EDuration="1.546118957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:41.543823394 +0000 UTC m=+534.778342866" watchObservedRunningTime="2026-07-28 14:08:41.546118957 +0000 UTC m=+534.780638431"
Jul 28 14:08:41.641795 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:41.641756    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:43.738567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:43.738526    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:43.844471 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:43.844432    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:45.549462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.549425    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw" event={"ID":"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08","Type":"ContainerStarted","Data":"27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e"}
Jul 28 14:08:45.549894 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.549584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:45.551208 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.551179    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv" podUID="10076469-7862-44af-8f0a-062ab743cf1b" containerName="manager" containerID="cri-o://a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5" gracePeriod=2
Jul 28 14:08:45.578700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.578653    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw" podStartSLOduration=1.775126953 podStartE2EDuration="5.578600732s" totalImagesPullingTime="3.803473779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:45.577888079 +0000 UTC m=+538.812407562" watchObservedRunningTime="2026-07-28 14:08:45.578600732 +0000 UTC m=+538.813120205"
Jul 28 14:08:45.800327 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.800259    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:45.802572 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:45.802546    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="10076469-7862-44af-8f0a-062ab743cf1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:45.859519 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.859490    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swrmz\" (UniqueName: \"kubernetes.io/projected/10076469-7862-44af-8f0a-062ab743cf1b-kube-api-access-swrmz\") pod \"10076469-7862-44af-8f0a-062ab743cf1b\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") "
Jul 28 14:08:45.859682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.859562    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10076469-7862-44af-8f0a-062ab743cf1b-extensions-socket-volume\") pod \"10076469-7862-44af-8f0a-062ab743cf1b\" (UID: \"10076469-7862-44af-8f0a-062ab743cf1b\") "
Jul 28 14:08:45.859822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.859801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10076469-7862-44af-8f0a-062ab743cf1b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "10076469-7862-44af-8f0a-062ab743cf1b" (UID: "10076469-7862-44af-8f0a-062ab743cf1b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:08:45.861527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.861506    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10076469-7862-44af-8f0a-062ab743cf1b-kube-api-access-swrmz" (OuterVolumeSpecName: "kube-api-access-swrmz") pod "10076469-7862-44af-8f0a-062ab743cf1b" (UID: "10076469-7862-44af-8f0a-062ab743cf1b"). InnerVolumeSpecName "kube-api-access-swrmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:08:45.960136 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.960100    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swrmz\" (UniqueName: \"kubernetes.io/projected/10076469-7862-44af-8f0a-062ab743cf1b-kube-api-access-swrmz\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:08:45.960136 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:45.960130    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/10076469-7862-44af-8f0a-062ab743cf1b-extensions-socket-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:08:46.557320 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:46.557285    2558 generic.go:356] "Generic (PLEG): container finished" podID="10076469-7862-44af-8f0a-062ab743cf1b" containerID="a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5" exitCode=2
Jul 28 14:08:46.557736 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:46.557332    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:46.557736 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:46.557380    2558 scope.go:117] "RemoveContainer" containerID="a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5"
Jul 28 14:08:46.559989 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:46.559961    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="10076469-7862-44af-8f0a-062ab743cf1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:46.567283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:46.567265    2558 scope.go:117] "RemoveContainer" containerID="a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5"
Jul 28 14:08:46.567555 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:46.567540    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5\": container with ID starting with a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5 not found: ID does not exist" containerID="a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5"
Jul 28 14:08:46.567594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:46.567563    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5"} err="failed to get container status \"a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5\": rpc error: code = NotFound desc = could not find container \"a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5\": container with ID starting with a33a1a4e2442959d5275dc81c668fd959593198edccb91110e35d71d3891cae5 not found: ID does not exist"
Jul 28 14:08:46.568470 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:46.568447    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="10076469-7862-44af-8f0a-062ab743cf1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:47.282625 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:47.282580    2558 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bv2lv\" is forbidden: User \"system:node:ip-10-0-141-71.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-71.ec2.internal' and this object" podUID="10076469-7862-44af-8f0a-062ab743cf1b" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bv2lv"
Jul 28 14:08:47.284396 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:47.284373    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10076469-7862-44af-8f0a-062ab743cf1b" path="/var/lib/kubelet/pods/10076469-7862-44af-8f0a-062ab743cf1b/volumes"
Jul 28 14:08:49.144957 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:49.144921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:49.878219 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:49.878187    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:52.312689 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.312656    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"]
Jul 28 14:08:52.313133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.312863    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw" podUID="2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" containerName="manager" containerID="cri-o://27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e" gracePeriod=10
Jul 28 14:08:52.314770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.314745    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:52.534318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.534291    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4hmks"
Jul 28 14:08:52.568915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.568855    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:52.582635 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.582607    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:52.587156 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.587124    2558 generic.go:356] "Generic (PLEG): container finished" podID="2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" containerID="27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e" exitCode=0
Jul 28 14:08:52.587302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.587167    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"
Jul 28 14:08:52.587302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.587182    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw" event={"ID":"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08","Type":"ContainerDied","Data":"27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e"}
Jul 28 14:08:52.587302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.587237    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw" event={"ID":"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08","Type":"ContainerDied","Data":"a7bae0f5b4336e0ddfc2822ce8feb3189dffb260775cf659ca775b297fcaab2d"}
Jul 28 14:08:52.587302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.587269    2558 scope.go:117] "RemoveContainer" containerID="27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e"
Jul 28 14:08:52.597146 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.597123    2558 scope.go:117] "RemoveContainer" containerID="27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e"
Jul 28 14:08:52.597435 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:08:52.597410    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e\": container with ID starting with 27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e not found: ID does not exist" containerID="27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e"
Jul 28 14:08:52.597522 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.597448    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e"} err="failed to get container status \"27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e\": rpc error: code = NotFound desc = could not find container \"27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e\": container with ID starting with 27375a757202d7ba5454ab96b055324b286b368a41874242cdb1819a95b82d3e not found: ID does not exist"
Jul 28 14:08:52.610894 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.610868    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-extensions-socket-volume\") pod \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") "
Jul 28 14:08:52.611057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.610948    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-kube-api-access-8htm9\") pod \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\" (UID: \"2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08\") "
Jul 28 14:08:52.611284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.611263    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" (UID: "2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:08:52.613458 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.613435    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-kube-api-access-8htm9" (OuterVolumeSpecName: "kube-api-access-8htm9") pod "2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" (UID: "2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08"). InnerVolumeSpecName "kube-api-access-8htm9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.708351    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"]
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.709323    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10076469-7862-44af-8f0a-062ab743cf1b" containerName="manager"
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.709373    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="10076469-7862-44af-8f0a-062ab743cf1b" containerName="manager"
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.709407    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" containerName="manager"
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.709416    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" containerName="manager"
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.709637    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" containerName="manager"
Jul 28 14:08:52.711923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.709650    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="10076469-7862-44af-8f0a-062ab743cf1b" containerName="manager"
Jul 28 14:08:52.714255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.714227    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-extensions-socket-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:08:52.714255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.714252    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8htm9\" (UniqueName: \"kubernetes.io/projected/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08-kube-api-access-8htm9\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:08:52.716538 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.716512    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:52.717530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.717491    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:08:52.724489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.724463    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"]
Jul 28 14:08:52.815458 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.815420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e83c704e-4eff-43f9-8ea5-171370ad7458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n5wbf\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:52.815458 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.815474    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29885\" (UniqueName: \"kubernetes.io/projected/e83c704e-4eff-43f9-8ea5-171370ad7458-kube-api-access-29885\") pod \"kuadrant-operator-controller-manager-86878c769f-n5wbf\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:52.912925 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.912892    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"]
Jul 28 14:08:52.916336 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.916303    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e83c704e-4eff-43f9-8ea5-171370ad7458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n5wbf\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:52.916487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.916360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29885\" (UniqueName: \"kubernetes.io/projected/e83c704e-4eff-43f9-8ea5-171370ad7458-kube-api-access-29885\") pod \"kuadrant-operator-controller-manager-86878c769f-n5wbf\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:52.916873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.916847    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e83c704e-4eff-43f9-8ea5-171370ad7458-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n5wbf\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:52.921682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.921657    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zkbdw"]
Jul 28 14:08:52.931406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:52.931383    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29885\" (UniqueName: \"kubernetes.io/projected/e83c704e-4eff-43f9-8ea5-171370ad7458-kube-api-access-29885\") pod \"kuadrant-operator-controller-manager-86878c769f-n5wbf\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:53.028101 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.028070    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:53.168822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.168793    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"]
Jul 28 14:08:53.174593 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:08:53.174563    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode83c704e_4eff_43f9_8ea5_171370ad7458.slice/crio-5fb4fad99c33acb599fd1ebe39110eb730aa435bff6d2b16b5c794728f99c3c0 WatchSource:0}: Error finding container 5fb4fad99c33acb599fd1ebe39110eb730aa435bff6d2b16b5c794728f99c3c0: Status 404 returned error can't find the container with id 5fb4fad99c33acb599fd1ebe39110eb730aa435bff6d2b16b5c794728f99c3c0
Jul 28 14:08:53.282665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.282634    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08" path="/var/lib/kubelet/pods/2f6ae9b8-1558-4e57-adcc-d2c53a0ecb08/volumes"
Jul 28 14:08:53.594292 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.594257    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf" event={"ID":"e83c704e-4eff-43f9-8ea5-171370ad7458","Type":"ContainerStarted","Data":"df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740"}
Jul 28 14:08:53.594737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.594314    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf" event={"ID":"e83c704e-4eff-43f9-8ea5-171370ad7458","Type":"ContainerStarted","Data":"5fb4fad99c33acb599fd1ebe39110eb730aa435bff6d2b16b5c794728f99c3c0"}
Jul 28 14:08:53.594737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.594344    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:08:53.620676 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:08:53.620618    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf" podStartSLOduration=1.620603382 podStartE2EDuration="1.620603382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:08:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:08:53.620143102 +0000 UTC m=+546.854662573" watchObservedRunningTime="2026-07-28 14:08:53.620603382 +0000 UTC m=+546.855122854"
Jul 28 14:09:02.634987 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:02.634943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:02.741629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:02.741565    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:04.602781 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:04.602748    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:09:09.247167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:09.247128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:09.857219 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:09.857184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:17.636172 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:17.636133    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:17.725883 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:17.725848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:22.507167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:22.507132    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:22.870762 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:22.870669    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:23.000987 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:23.000946    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:23.448753 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:23.448701    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:23.550203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:23.550152    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:47.151045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:47.150988    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:09:47.157137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:47.157114    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:09:58.125549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:58.125480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:58.916523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:58.916493    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:59.015915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:59.015883    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:09:59.490608 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:09:59.490572    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:12.043497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:12.043457    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:12.313566 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:12.313482    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:15.862509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:15.862417    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:18.694933 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:18.694897    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:20.089969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:20.089932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:20.262164 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:20.262119    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:20.383937 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:20.383836    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:20.569151 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:20.569120    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:23.909065 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:23.909033    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:27.901227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:27.901189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:35.938840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:35.938801    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:42.712123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:42.712082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:55.916141 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:55.916095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:56.016319 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:56.016243    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:56.600628 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:56.600589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:56.896045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:56.895932    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:57.334463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:57.334405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:10:57.450239 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:10:57.450189    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:06.874547 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:06.874510    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:06.973786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:06.973751    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:15.032210 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.032173    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"]
Jul 28 14:11:15.035768 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.035744    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.038536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.038510    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 28 14:11:15.039558 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.039543    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nxn8f\""
Jul 28 14:11:15.039620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.039580    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 28 14:11:15.039706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.039693    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 28 14:11:15.046838 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.046817    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"]
Jul 28 14:11:15.070352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.070321    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.070489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.070376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.070489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.070403    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dwdc\" (UniqueName: \"kubernetes.io/projected/58bb9286-0173-4b0a-8664-f09bee78a551-kube-api-access-6dwdc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.070489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.070427    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.070621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.070505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bb9286-0173-4b0a-8664-f09bee78a551-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.070621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.070534    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171005 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.170972    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bb9286-0173-4b0a-8664-f09bee78a551-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171036    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171082    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171217    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dwdc\" (UniqueName: \"kubernetes.io/projected/58bb9286-0173-4b0a-8664-f09bee78a551-kube-api-access-6dwdc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171260    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171507 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171477    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171563 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171515    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171569    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.171933 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.171908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:15.173660 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.173629    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58bb9286-0173-4b0a-8664-f09bee78a551-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.174140 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.174116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58bb9286-0173-4b0a-8664-f09bee78a551-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.181890 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.181869    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dwdc\" (UniqueName: \"kubernetes.io/projected/58bb9286-0173-4b0a-8664-f09bee78a551-kube-api-access-6dwdc\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9\" (UID: \"58bb9286-0173-4b0a-8664-f09bee78a551\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.347085 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.346991    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:15.499882 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.499859    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"]
Jul 28 14:11:15.502044 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:11:15.501995    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58bb9286_0173_4b0a_8664_f09bee78a551.slice/crio-919b407d3a2d4546a6fab170506de1901eb8e6be5f02f5edd084a9d42e8b89f8 WatchSource:0}: Error finding container 919b407d3a2d4546a6fab170506de1901eb8e6be5f02f5edd084a9d42e8b89f8: Status 404 returned error can't find the container with id 919b407d3a2d4546a6fab170506de1901eb8e6be5f02f5edd084a9d42e8b89f8
Jul 28 14:11:15.503390 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:15.503371    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:11:16.251344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:16.251304    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9" event={"ID":"58bb9286-0173-4b0a-8664-f09bee78a551","Type":"ContainerStarted","Data":"919b407d3a2d4546a6fab170506de1901eb8e6be5f02f5edd084a9d42e8b89f8"}
Jul 28 14:11:19.266593 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:19.266555    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9" event={"ID":"58bb9286-0173-4b0a-8664-f09bee78a551","Type":"ContainerStarted","Data":"72c9b027bf610fc1ccffdc4139bc58e2936a6376656835ebf6a91c1393270220"}
Jul 28 14:11:19.292213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:19.292166    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9" podStartSLOduration=0.909587105 podStartE2EDuration="4.292151218s" totalImagesPullingTime="3.382564113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:11:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:19.290658442 +0000 UTC m=+692.525177918" watchObservedRunningTime="2026-07-28 14:11:19.292151218 +0000 UTC m=+692.526670690"
Jul 28 14:11:22.958180 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:22.958140    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:25.347642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:25.347605    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:25.348011 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:25.347667    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:25.360185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:25.360160    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:26.310309 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:26.310282    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9"
Jul 28 14:11:36.156791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.156747    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"]
Jul 28 14:11:36.165109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.165084    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.168902 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.168876    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 28 14:11:36.180401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.180378    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"]
Jul 28 14:11:36.219095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.219041    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:36.266403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.266369    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb119198-9c19-49f3-bf2d-f36aa6322a3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.266403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.266406    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.266651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.266465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.266651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.266586    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.266651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.266623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.266796 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.266656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2nzg\" (UniqueName: \"kubernetes.io/projected/cb119198-9c19-49f3-bf2d-f36aa6322a3f-kube-api-access-t2nzg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367347 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367318    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb119198-9c19-49f3-bf2d-f36aa6322a3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367347 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367352    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367388    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367430    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367446    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2nzg\" (UniqueName: \"kubernetes.io/projected/cb119198-9c19-49f3-bf2d-f36aa6322a3f-kube-api-access-t2nzg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367880 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367788    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367880 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367834    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.367953 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.367922    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.369782 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.369755    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cb119198-9c19-49f3-bf2d-f36aa6322a3f-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.369915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.369899    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cb119198-9c19-49f3-bf2d-f36aa6322a3f-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.378535 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.378504    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2nzg\" (UniqueName: \"kubernetes.io/projected/cb119198-9c19-49f3-bf2d-f36aa6322a3f-kube-api-access-t2nzg\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gzt2k\" (UID: \"cb119198-9c19-49f3-bf2d-f36aa6322a3f\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.475130 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.475012    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:36.616078 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:36.616047    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"]
Jul 28 14:11:36.617659 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:11:36.617632    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb119198_9c19_49f3_bf2d_f36aa6322a3f.slice/crio-5adcfb68ddeb8275ce6095970efebe469e5eeb51c8c4b6b5b844a2a1727d3c6f WatchSource:0}: Error finding container 5adcfb68ddeb8275ce6095970efebe469e5eeb51c8c4b6b5b844a2a1727d3c6f: Status 404 returned error can't find the container with id 5adcfb68ddeb8275ce6095970efebe469e5eeb51c8c4b6b5b844a2a1727d3c6f
Jul 28 14:11:37.356067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:37.356031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k" event={"ID":"cb119198-9c19-49f3-bf2d-f36aa6322a3f","Type":"ContainerStarted","Data":"4bb61f084769d37917795ca92ed7a70450bc8b91eeb38501f04f7c98b649637c"}
Jul 28 14:11:37.356475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:37.356101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k" event={"ID":"cb119198-9c19-49f3-bf2d-f36aa6322a3f","Type":"ContainerStarted","Data":"5adcfb68ddeb8275ce6095970efebe469e5eeb51c8c4b6b5b844a2a1727d3c6f"}
Jul 28 14:11:37.379178 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:37.379127    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k" podStartSLOduration=1.149111229 podStartE2EDuration="1.37910808s" totalImagesPullingTime="229.996851ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:11:37.378544823 +0000 UTC m=+710.613064295" watchObservedRunningTime="2026-07-28 14:11:37.37910808 +0000 UTC m=+710.613627554"
Jul 28 14:11:41.706135 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:41.706052    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:44.903224 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:44.903188    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:11:46.475261 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:46.475219    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:46.475760 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:46.475421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:46.490974 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:46.490947    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:47.417939 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:47.417913    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gzt2k"
Jul 28 14:11:56.135574 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:11:56.135536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:12:08.435780 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:12:08.435738    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:13:42.000798 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:13:42.000707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:13:42.084411 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:13:42.084376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:13:42.629269 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:13:42.629236    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:13:43.897447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:13:43.897410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:14:35.342181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:14:35.342145    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:14:47.180981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:14:47.180952    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:14:47.184765 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:14:47.184738    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:15:00.154559 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:00.154518    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"]
Jul 28 14:15:00.158451 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:00.158433    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"
Jul 28 14:15:00.161185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:00.161167    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:15:00.168673 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:00.168650    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"]
Jul 28 14:15:00.168673 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:00.168667    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"
Jul 28 14:15:00.513302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:00.513278    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"]
Jul 28 14:15:00.515575 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:15:00.515552    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0f53e1e_9549_4c66_b7ba_c8325e4b801b.slice/crio-c48ee35635a75a14234d55ab9934070ab0200197a102b3e4c319a3f7b98be695 WatchSource:0}: Error finding container c48ee35635a75a14234d55ab9934070ab0200197a102b3e4c319a3f7b98be695: Status 404 returned error can't find the container with id c48ee35635a75a14234d55ab9934070ab0200197a102b3e4c319a3f7b98be695
Jul 28 14:15:01.312529 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:01.312484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62" event={"ID":"d0f53e1e-9549-4c66-b7ba-c8325e4b801b","Type":"ContainerStarted","Data":"c48ee35635a75a14234d55ab9934070ab0200197a102b3e4c319a3f7b98be695"}
Jul 28 14:15:04.330727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:04.330689    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62" event={"ID":"d0f53e1e-9549-4c66-b7ba-c8325e4b801b","Type":"ContainerStarted","Data":"9d3178543f29d4866c0f28949eaf51aed3560f8a7d4670a7b13510fbf755eb46"}
Jul 28 14:15:04.349975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:04.349920    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62" podStartSLOduration=1.496131096 podStartE2EDuration="4.349903521s" totalImagesPullingTime="2.853772425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:15:04.348270449 +0000 UTC m=+917.582789922" watchObservedRunningTime="2026-07-28 14:15:04.349903521 +0000 UTC m=+917.584422992"
Jul 28 14:15:05.336436 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:05.336398    2558 generic.go:356] "Generic (PLEG): container finished" podID="d0f53e1e-9549-4c66-b7ba-c8325e4b801b" containerID="9d3178543f29d4866c0f28949eaf51aed3560f8a7d4670a7b13510fbf755eb46" exitCode=0
Jul 28 14:15:05.336815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:05.336478    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62" event={"ID":"d0f53e1e-9549-4c66-b7ba-c8325e4b801b","Type":"ContainerDied","Data":"9d3178543f29d4866c0f28949eaf51aed3560f8a7d4670a7b13510fbf755eb46"}
Jul 28 14:15:06.473453 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:06.473429    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"
Jul 28 14:15:07.347675 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:07.347641    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62"
Jul 28 14:15:07.347675 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:07.347663    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754135-7qb62" event={"ID":"d0f53e1e-9549-4c66-b7ba-c8325e4b801b","Type":"ContainerDied","Data":"c48ee35635a75a14234d55ab9934070ab0200197a102b3e4c319a3f7b98be695"}
Jul 28 14:15:07.347862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:07.347743    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c48ee35635a75a14234d55ab9934070ab0200197a102b3e4c319a3f7b98be695"
Jul 28 14:15:32.235947 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:32.235904    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:15:52.818485 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:52.818449    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:15:54.283778 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:15:54.283737    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:30.114768 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:30.114675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:30.214364 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:30.214333    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:30.360424 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:30.360391    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:38.395062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:38.395004    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:38.503935 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:38.503899    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:38.598964 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:38.598926    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:39.106611 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:39.106576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:40.051140 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:40.051105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:40.142340 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:40.142306    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:45.567235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:45.567195    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:16:45.664349 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:16:45.664310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:18:25.006337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:18:25.006300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:19:44.726623 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:19:44.726532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:19:47.216120 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:19:47.216090    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:19:47.217013 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:19:47.216994    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:20:44.057301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:20:44.057254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:20:46.643107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:20:46.643071    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:21:01.780516 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:01.780472    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"]
Jul 28 14:21:01.780963 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:01.780742    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf" podUID="e83c704e-4eff-43f9-8ea5-171370ad7458" containerName="manager" containerID="cri-o://df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740" gracePeriod=10
Jul 28 14:21:05.033253 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.033228    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:21:05.078656 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.078617    2558 generic.go:356] "Generic (PLEG): container finished" podID="e83c704e-4eff-43f9-8ea5-171370ad7458" containerID="df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740" exitCode=0
Jul 28 14:21:05.078834 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.078668    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"
Jul 28 14:21:05.078834 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.078696    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf" event={"ID":"e83c704e-4eff-43f9-8ea5-171370ad7458","Type":"ContainerDied","Data":"df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740"}
Jul 28 14:21:05.078834 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.078752    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf" event={"ID":"e83c704e-4eff-43f9-8ea5-171370ad7458","Type":"ContainerDied","Data":"5fb4fad99c33acb599fd1ebe39110eb730aa435bff6d2b16b5c794728f99c3c0"}
Jul 28 14:21:05.078834 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.078779    2558 scope.go:117] "RemoveContainer" containerID="df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740"
Jul 28 14:21:05.089220 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.089201    2558 scope.go:117] "RemoveContainer" containerID="df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740"
Jul 28 14:21:05.089496 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:21:05.089476    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740\": container with ID starting with df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740 not found: ID does not exist" containerID="df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740"
Jul 28 14:21:05.089561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.089505    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740"} err="failed to get container status \"df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740\": rpc error: code = NotFound desc = could not find container \"df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740\": container with ID starting with df103af46ec5a2836c422a72b271c8a8e7424f875e93373ffde22070f2733740 not found: ID does not exist"
Jul 28 14:21:05.099923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.099902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29885\" (UniqueName: \"kubernetes.io/projected/e83c704e-4eff-43f9-8ea5-171370ad7458-kube-api-access-29885\") pod \"e83c704e-4eff-43f9-8ea5-171370ad7458\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") "
Jul 28 14:21:05.100060 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.099992    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e83c704e-4eff-43f9-8ea5-171370ad7458-extensions-socket-volume\") pod \"e83c704e-4eff-43f9-8ea5-171370ad7458\" (UID: \"e83c704e-4eff-43f9-8ea5-171370ad7458\") "
Jul 28 14:21:05.100410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.100388    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e83c704e-4eff-43f9-8ea5-171370ad7458-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e83c704e-4eff-43f9-8ea5-171370ad7458" (UID: "e83c704e-4eff-43f9-8ea5-171370ad7458"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:21:05.101916 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.101895    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e83c704e-4eff-43f9-8ea5-171370ad7458-kube-api-access-29885" (OuterVolumeSpecName: "kube-api-access-29885") pod "e83c704e-4eff-43f9-8ea5-171370ad7458" (UID: "e83c704e-4eff-43f9-8ea5-171370ad7458"). InnerVolumeSpecName "kube-api-access-29885". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:21:05.200764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.200677    2558 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e83c704e-4eff-43f9-8ea5-171370ad7458-extensions-socket-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:21:05.200764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.200703    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29885\" (UniqueName: \"kubernetes.io/projected/e83c704e-4eff-43f9-8ea5-171370ad7458-kube-api-access-29885\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:21:05.400499 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.400466    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"]
Jul 28 14:21:05.407408 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:05.407382    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n5wbf"]
Jul 28 14:21:07.282524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:21:07.282488    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e83c704e-4eff-43f9-8ea5-171370ad7458" path="/var/lib/kubelet/pods/e83c704e-4eff-43f9-8ea5-171370ad7458/volumes"
Jul 28 14:22:03.038716 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.038679    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"]
Jul 28 14:22:03.039138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.039053    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e83c704e-4eff-43f9-8ea5-171370ad7458" containerName="manager"
Jul 28 14:22:03.039138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.039067    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="e83c704e-4eff-43f9-8ea5-171370ad7458" containerName="manager"
Jul 28 14:22:03.039138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.039080    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f53e1e-9549-4c66-b7ba-c8325e4b801b" containerName="cleanup"
Jul 28 14:22:03.039138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.039086    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f53e1e-9549-4c66-b7ba-c8325e4b801b" containerName="cleanup"
Jul 28 14:22:03.039275 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.039168    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f53e1e-9549-4c66-b7ba-c8325e4b801b" containerName="cleanup"
Jul 28 14:22:03.039275 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.039178    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="e83c704e-4eff-43f9-8ea5-171370ad7458" containerName="manager"
Jul 28 14:22:03.043252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.043236    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.046874 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.046851    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mv7mq\""
Jul 28 14:22:03.068310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.068284    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"]
Jul 28 14:22:03.134383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.134350    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f8cec3-192d-4833-aae1-6a4b7f8b022f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-24c9h\" (UID: \"44f8cec3-192d-4833-aae1-6a4b7f8b022f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.134535 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.134435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbqzr\" (UniqueName: \"kubernetes.io/projected/44f8cec3-192d-4833-aae1-6a4b7f8b022f-kube-api-access-qbqzr\") pod \"kuadrant-operator-controller-manager-86878c769f-24c9h\" (UID: \"44f8cec3-192d-4833-aae1-6a4b7f8b022f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.235182 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.235150    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f8cec3-192d-4833-aae1-6a4b7f8b022f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-24c9h\" (UID: \"44f8cec3-192d-4833-aae1-6a4b7f8b022f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.235391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.235244    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbqzr\" (UniqueName: \"kubernetes.io/projected/44f8cec3-192d-4833-aae1-6a4b7f8b022f-kube-api-access-qbqzr\") pod \"kuadrant-operator-controller-manager-86878c769f-24c9h\" (UID: \"44f8cec3-192d-4833-aae1-6a4b7f8b022f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.235539 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.235512    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/44f8cec3-192d-4833-aae1-6a4b7f8b022f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-24c9h\" (UID: \"44f8cec3-192d-4833-aae1-6a4b7f8b022f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.246772 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.246746    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbqzr\" (UniqueName: \"kubernetes.io/projected/44f8cec3-192d-4833-aae1-6a4b7f8b022f-kube-api-access-qbqzr\") pod \"kuadrant-operator-controller-manager-86878c769f-24c9h\" (UID: \"44f8cec3-192d-4833-aae1-6a4b7f8b022f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.353146 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.353069    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:03.499451 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:03.499425    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"]
Jul 28 14:22:03.501364 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:22:03.501333    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f8cec3_192d_4833_aae1_6a4b7f8b022f.slice/crio-cf78663b3a54b73f6b54dfe0e6385fcb2b618290e0f44d2f7414129dff1dcb52 WatchSource:0}: Error finding container cf78663b3a54b73f6b54dfe0e6385fcb2b618290e0f44d2f7414129dff1dcb52: Status 404 returned error can't find the container with id cf78663b3a54b73f6b54dfe0e6385fcb2b618290e0f44d2f7414129dff1dcb52
Jul 28 14:22:04.355657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:04.355616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h" event={"ID":"44f8cec3-192d-4833-aae1-6a4b7f8b022f","Type":"ContainerStarted","Data":"6c6affb1e9edf21712472f8309e5f0031d11373329184da78277c2a430b80aa6"}
Jul 28 14:22:04.356106 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:04.355678    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h" event={"ID":"44f8cec3-192d-4833-aae1-6a4b7f8b022f","Type":"ContainerStarted","Data":"cf78663b3a54b73f6b54dfe0e6385fcb2b618290e0f44d2f7414129dff1dcb52"}
Jul 28 14:22:04.356106 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:04.355705    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:04.382894 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:04.382841    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h" podStartSLOduration=1.382822899 podStartE2EDuration="1.382822899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:22:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:22:04.379582955 +0000 UTC m=+1337.614102429" watchObservedRunningTime="2026-07-28 14:22:04.382822899 +0000 UTC m=+1337.617342370"
Jul 28 14:22:15.363837 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:15.363754    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-24c9h"
Jul 28 14:22:36.727820 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:22:36.727784    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:24:41.121588 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:41.121551    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:24:47.246159 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:47.246127    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:24:47.246862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:47.246842    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:24:54.489204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.489167    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"]
Jul 28 14:24:54.492527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.492509    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.498383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.498356    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-cf6bb795-kserve-self-signed-certs\""
Jul 28 14:24:54.501153 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.501129    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:24:54.577561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.577525    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"]
Jul 28 14:24:54.600646 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.600612    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-tmp-dir\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.600771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.600655    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-dshm\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.600771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.600711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5559b940-058c-4885-94bd-4d016c48fc98-tls-certs\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.600771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.600734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76wgp\" (UniqueName: \"kubernetes.io/projected/5559b940-058c-4885-94bd-4d016c48fc98-kube-api-access-76wgp\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.600771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.600767    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-model-cache\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.600920 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.600872    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-home\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.701826 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.701786    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5559b940-058c-4885-94bd-4d016c48fc98-tls-certs\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.701998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.701830    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76wgp\" (UniqueName: \"kubernetes.io/projected/5559b940-058c-4885-94bd-4d016c48fc98-kube-api-access-76wgp\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.701998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.701869    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-model-cache\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.701998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.701924    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-home\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.701998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.701987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-tmp-dir\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.702251 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.702013    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-dshm\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.702335 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.702316    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-model-cache\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.702395 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.702377    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-home\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.702454 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.702406    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-tmp-dir\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.704139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.704120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-dshm\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.704326 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.704308    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5559b940-058c-4885-94bd-4d016c48fc98-tls-certs\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.712775 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.712750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76wgp\" (UniqueName: \"kubernetes.io/projected/5559b940-058c-4885-94bd-4d016c48fc98-kube-api-access-76wgp\") pod \"e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") " pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.802384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.802354    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:24:54.946779 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:54.946753    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"]
Jul 28 14:24:54.948454 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:24:54.948425    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5559b940_058c_4885_94bd_4d016c48fc98.slice/crio-dbb5d39bf82251353a2713bd635805d872c0fc717938c31bbf0b1473fb0337df WatchSource:0}: Error finding container dbb5d39bf82251353a2713bd635805d872c0fc717938c31bbf0b1473fb0337df: Status 404 returned error can't find the container with id dbb5d39bf82251353a2713bd635805d872c0fc717938c31bbf0b1473fb0337df
Jul 28 14:24:55.169149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:55.169053    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn" event={"ID":"5559b940-058c-4885-94bd-4d016c48fc98","Type":"ContainerStarted","Data":"eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61"}
Jul 28 14:24:55.169149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:55.169101    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn" event={"ID":"5559b940-058c-4885-94bd-4d016c48fc98","Type":"ContainerStarted","Data":"dbb5d39bf82251353a2713bd635805d872c0fc717938c31bbf0b1473fb0337df"}
Jul 28 14:24:55.200872 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:24:55.200818    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn" podStartSLOduration=1.200801515 podStartE2EDuration="1.200801515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:24:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:24:55.199057502 +0000 UTC m=+1508.433576974" watchObservedRunningTime="2026-07-28 14:24:55.200801515 +0000 UTC m=+1508.435320987"
Jul 28 14:25:00.761379 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.761345    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"]
Jul 28 14:25:00.764984 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.764964    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.769213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.769195    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-cf6bb795-kserve-self-signed-certs\""
Jul 28 14:25:00.783104 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.783078    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"]
Jul 28 14:25:00.804265 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.804235    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:25:00.861279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.861240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-dshm\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.861432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.861283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457pv\" (UniqueName: \"kubernetes.io/projected/20f5cf8c-1927-4738-95dc-343e1060eccc-kube-api-access-457pv\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.861432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.861312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-home\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.861432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.861355    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-tmp-dir\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.861432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.861418    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f5cf8c-1927-4738-95dc-343e1060eccc-tls-certs\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.861597 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.861483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-model-cache\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962414 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962372    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-dshm\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962414 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962415    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457pv\" (UniqueName: \"kubernetes.io/projected/20f5cf8c-1927-4738-95dc-343e1060eccc-kube-api-access-457pv\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-home\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962613    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-tmp-dir\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f5cf8c-1927-4738-95dc-343e1060eccc-tls-certs\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962830 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962715    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-model-cache\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962907 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962888    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-home\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.962975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.962950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-tmp-dir\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.963067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.963008    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-model-cache\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.964716 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.964692    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-dshm\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.965080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.965062    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f5cf8c-1927-4738-95dc-343e1060eccc-tls-certs\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:00.974447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:00.974420    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-457pv\" (UniqueName: \"kubernetes.io/projected/20f5cf8c-1927-4738-95dc-343e1060eccc-kube-api-access-457pv\") pod \"e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") " pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:01.075167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:01.075081    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:01.213109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:01.213086    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"]
Jul 28 14:25:01.214872 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:25:01.214844    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod20f5cf8c_1927_4738_95dc_343e1060eccc.slice/crio-e712aca383e609dcdcb39579d7dfaeea487ec721025a647addc29bd1003b7410 WatchSource:0}: Error finding container e712aca383e609dcdcb39579d7dfaeea487ec721025a647addc29bd1003b7410: Status 404 returned error can't find the container with id e712aca383e609dcdcb39579d7dfaeea487ec721025a647addc29bd1003b7410
Jul 28 14:25:02.205272 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:02.205230    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn" event={"ID":"20f5cf8c-1927-4738-95dc-343e1060eccc","Type":"ContainerStarted","Data":"6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff"}
Jul 28 14:25:02.205652 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:02.205284    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn" event={"ID":"20f5cf8c-1927-4738-95dc-343e1060eccc","Type":"ContainerStarted","Data":"e712aca383e609dcdcb39579d7dfaeea487ec721025a647addc29bd1003b7410"}
Jul 28 14:25:02.230041 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:02.227891    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn" podStartSLOduration=2.22787132 podStartE2EDuration="2.22787132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:25:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:25:02.226461805 +0000 UTC m=+1515.460981274" watchObservedRunningTime="2026-07-28 14:25:02.22787132 +0000 UTC m=+1515.462390793"
Jul 28 14:25:04.802967 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:04.802932    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:25:04.803458 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:04.802982    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:25:04.815545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:04.815516    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:25:05.230515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:05.230421    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:25:11.075317 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:11.075226    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:11.075723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:11.075547    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:11.087462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:11.087425    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:11.258106 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:11.258068    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:16.310657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:16.310616    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:25:31.566445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:31.566406    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"]
Jul 28 14:25:31.615311 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:31.615275    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:25:33.558691 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:33.558657    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"]
Jul 28 14:25:33.580824 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:33.580792    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:25:35.977957 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:35.977923    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:25:38.886236 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:38.886202    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:25:46.586119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.586053    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn" podUID="5559b940-058c-4885-94bd-4d016c48fc98" containerName="main" containerID="cri-o://eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61" gracePeriod=45
Jul 28 14:25:46.850533 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.850471    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:25:46.991550 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991513    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-model-cache\") pod \"5559b940-058c-4885-94bd-4d016c48fc98\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") "
Jul 28 14:25:46.991757 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991649    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5559b940-058c-4885-94bd-4d016c48fc98-tls-certs\") pod \"5559b940-058c-4885-94bd-4d016c48fc98\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") "
Jul 28 14:25:46.991757 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991688    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-dshm\") pod \"5559b940-058c-4885-94bd-4d016c48fc98\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") "
Jul 28 14:25:46.991757 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991723    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76wgp\" (UniqueName: \"kubernetes.io/projected/5559b940-058c-4885-94bd-4d016c48fc98-kube-api-access-76wgp\") pod \"5559b940-058c-4885-94bd-4d016c48fc98\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") "
Jul 28 14:25:46.991929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991779    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-tmp-dir\") pod \"5559b940-058c-4885-94bd-4d016c48fc98\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") "
Jul 28 14:25:46.991929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991807    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-home\") pod \"5559b940-058c-4885-94bd-4d016c48fc98\" (UID: \"5559b940-058c-4885-94bd-4d016c48fc98\") "
Jul 28 14:25:46.991929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.991823    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-model-cache" (OuterVolumeSpecName: "model-cache") pod "5559b940-058c-4885-94bd-4d016c48fc98" (UID: "5559b940-058c-4885-94bd-4d016c48fc98"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:46.992152 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.992136    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-model-cache\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:46.992331 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.992302    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-home" (OuterVolumeSpecName: "home") pod "5559b940-058c-4885-94bd-4d016c48fc98" (UID: "5559b940-058c-4885-94bd-4d016c48fc98"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:46.992415 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.992353    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5559b940-058c-4885-94bd-4d016c48fc98" (UID: "5559b940-058c-4885-94bd-4d016c48fc98"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:46.994278 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.994248    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5559b940-058c-4885-94bd-4d016c48fc98-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5559b940-058c-4885-94bd-4d016c48fc98" (UID: "5559b940-058c-4885-94bd-4d016c48fc98"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:25:46.994390 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.994344    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5559b940-058c-4885-94bd-4d016c48fc98-kube-api-access-76wgp" (OuterVolumeSpecName: "kube-api-access-76wgp") pod "5559b940-058c-4885-94bd-4d016c48fc98" (UID: "5559b940-058c-4885-94bd-4d016c48fc98"). InnerVolumeSpecName "kube-api-access-76wgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:25:46.994512 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:46.994492    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-dshm" (OuterVolumeSpecName: "dshm") pod "5559b940-058c-4885-94bd-4d016c48fc98" (UID: "5559b940-058c-4885-94bd-4d016c48fc98"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:47.093673 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.093632    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5559b940-058c-4885-94bd-4d016c48fc98-tls-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:47.093673 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.093671    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-dshm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:47.093978 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.093687    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76wgp\" (UniqueName: \"kubernetes.io/projected/5559b940-058c-4885-94bd-4d016c48fc98-kube-api-access-76wgp\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:47.093978 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.093699    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-tmp-dir\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:47.093978 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.093711    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5559b940-058c-4885-94bd-4d016c48fc98-home\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:47.441108 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.441074    2558 generic.go:356] "Generic (PLEG): container finished" podID="5559b940-058c-4885-94bd-4d016c48fc98" containerID="eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61" exitCode=0
Jul 28 14:25:47.441281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.441134    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"
Jul 28 14:25:47.441281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.441139    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn" event={"ID":"5559b940-058c-4885-94bd-4d016c48fc98","Type":"ContainerDied","Data":"eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61"}
Jul 28 14:25:47.441281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.441174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn" event={"ID":"5559b940-058c-4885-94bd-4d016c48fc98","Type":"ContainerDied","Data":"dbb5d39bf82251353a2713bd635805d872c0fc717938c31bbf0b1473fb0337df"}
Jul 28 14:25:47.441281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.441194    2558 scope.go:117] "RemoveContainer" containerID="eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61"
Jul 28 14:25:47.450545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.450525    2558 scope.go:117] "RemoveContainer" containerID="eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61"
Jul 28 14:25:47.450835 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:25:47.450811    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61\": container with ID starting with eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61 not found: ID does not exist" containerID="eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61"
Jul 28 14:25:47.450934 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.450842    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61"} err="failed to get container status \"eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61\": rpc error: code = NotFound desc = could not find container \"eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61\": container with ID starting with eaadd9a3ba773098457aaada1a316ab7ad64af5831b27e15242b2fcda396df61 not found: ID does not exist"
Jul 28 14:25:47.463656 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.463627    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"]
Jul 28 14:25:47.466560 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:47.466537    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-cf6bb795-kserve-78bd88b78c-lpnxn"]
Jul 28 14:25:48.580164 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.580104    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn" podUID="20f5cf8c-1927-4738-95dc-343e1060eccc" containerName="main" containerID="cri-o://6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff" gracePeriod=45
Jul 28 14:25:48.839009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.838940    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:48.910995 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.910963    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-home\") pod \"20f5cf8c-1927-4738-95dc-343e1060eccc\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") "
Jul 28 14:25:48.911218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911009    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-model-cache\") pod \"20f5cf8c-1927-4738-95dc-343e1060eccc\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") "
Jul 28 14:25:48.911218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911070    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-dshm\") pod \"20f5cf8c-1927-4738-95dc-343e1060eccc\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") "
Jul 28 14:25:48.911218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911086    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-tmp-dir\") pod \"20f5cf8c-1927-4738-95dc-343e1060eccc\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") "
Jul 28 14:25:48.911218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911142    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-457pv\" (UniqueName: \"kubernetes.io/projected/20f5cf8c-1927-4738-95dc-343e1060eccc-kube-api-access-457pv\") pod \"20f5cf8c-1927-4738-95dc-343e1060eccc\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") "
Jul 28 14:25:48.911218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911165    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f5cf8c-1927-4738-95dc-343e1060eccc-tls-certs\") pod \"20f5cf8c-1927-4738-95dc-343e1060eccc\" (UID: \"20f5cf8c-1927-4738-95dc-343e1060eccc\") "
Jul 28 14:25:48.911456 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911321    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-model-cache" (OuterVolumeSpecName: "model-cache") pod "20f5cf8c-1927-4738-95dc-343e1060eccc" (UID: "20f5cf8c-1927-4738-95dc-343e1060eccc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:48.911591 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911566    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-model-cache\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:48.911712 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911594    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-home" (OuterVolumeSpecName: "home") pod "20f5cf8c-1927-4738-95dc-343e1060eccc" (UID: "20f5cf8c-1927-4738-95dc-343e1060eccc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:48.911712 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.911609    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "20f5cf8c-1927-4738-95dc-343e1060eccc" (UID: "20f5cf8c-1927-4738-95dc-343e1060eccc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:48.913259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.913229    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/20f5cf8c-1927-4738-95dc-343e1060eccc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "20f5cf8c-1927-4738-95dc-343e1060eccc" (UID: "20f5cf8c-1927-4738-95dc-343e1060eccc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:25:48.913682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.913661    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-dshm" (OuterVolumeSpecName: "dshm") pod "20f5cf8c-1927-4738-95dc-343e1060eccc" (UID: "20f5cf8c-1927-4738-95dc-343e1060eccc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:25:48.913747 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:48.913675    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20f5cf8c-1927-4738-95dc-343e1060eccc-kube-api-access-457pv" (OuterVolumeSpecName: "kube-api-access-457pv") pod "20f5cf8c-1927-4738-95dc-343e1060eccc" (UID: "20f5cf8c-1927-4738-95dc-343e1060eccc"). InnerVolumeSpecName "kube-api-access-457pv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:25:49.013129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.013097    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-457pv\" (UniqueName: \"kubernetes.io/projected/20f5cf8c-1927-4738-95dc-343e1060eccc-kube-api-access-457pv\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:49.013129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.013127    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20f5cf8c-1927-4738-95dc-343e1060eccc-tls-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:49.013328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.013142    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-home\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:49.013328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.013151    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-dshm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:49.013328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.013180    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20f5cf8c-1927-4738-95dc-343e1060eccc-tmp-dir\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:25:49.286863 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.286827    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5559b940-058c-4885-94bd-4d016c48fc98" path="/var/lib/kubelet/pods/5559b940-058c-4885-94bd-4d016c48fc98/volumes"
Jul 28 14:25:49.453969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.453933    2558 generic.go:356] "Generic (PLEG): container finished" podID="20f5cf8c-1927-4738-95dc-343e1060eccc" containerID="6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff" exitCode=0
Jul 28 14:25:49.453969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.453974    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"
Jul 28 14:25:49.454193 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.454027    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn" event={"ID":"20f5cf8c-1927-4738-95dc-343e1060eccc","Type":"ContainerDied","Data":"6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff"}
Jul 28 14:25:49.454193 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.454076    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn" event={"ID":"20f5cf8c-1927-4738-95dc-343e1060eccc","Type":"ContainerDied","Data":"e712aca383e609dcdcb39579d7dfaeea487ec721025a647addc29bd1003b7410"}
Jul 28 14:25:49.454193 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.454109    2558 scope.go:117] "RemoveContainer" containerID="6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff"
Jul 28 14:25:49.462307 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.462279    2558 scope.go:117] "RemoveContainer" containerID="6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff"
Jul 28 14:25:49.462549 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:25:49.462530    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff\": container with ID starting with 6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff not found: ID does not exist" containerID="6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff"
Jul 28 14:25:49.462626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.462559    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff"} err="failed to get container status \"6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff\": rpc error: code = NotFound desc = could not find container \"6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff\": container with ID starting with 6955b9dc16b0312ded349b4059cc2012bf06565ed2ebaf1997a85667e2a876ff not found: ID does not exist"
Jul 28 14:25:49.483681 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.483653    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"]
Jul 28 14:25:49.497090 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:49.497062    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-cf6bb795-kserve-7f96c664b7-8qppn"]
Jul 28 14:25:51.283155 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:25:51.283122    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20f5cf8c-1927-4738-95dc-343e1060eccc" path="/var/lib/kubelet/pods/20f5cf8c-1927-4738-95dc-343e1060eccc/volumes"
Jul 28 14:28:47.945641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:28:47.945536    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:07.700460 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:07.700418    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:10.862681 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:10.862623    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:10.959173 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:10.959123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:11.348345 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:11.348310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:18.610252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:18.610214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:18.719384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:18.719349    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:18.859138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:18.859105    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:19.210069 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210029    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"]
Jul 28 14:29:19.210459 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210443    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5559b940-058c-4885-94bd-4d016c48fc98" containerName="main"
Jul 28 14:29:19.210525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210464    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5559b940-058c-4885-94bd-4d016c48fc98" containerName="main"
Jul 28 14:29:19.210525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210477    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20f5cf8c-1927-4738-95dc-343e1060eccc" containerName="main"
Jul 28 14:29:19.210525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210482    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="20f5cf8c-1927-4738-95dc-343e1060eccc" containerName="main"
Jul 28 14:29:19.210634 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210533    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="20f5cf8c-1927-4738-95dc-343e1060eccc" containerName="main"
Jul 28 14:29:19.210634 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.210548    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5559b940-058c-4885-94bd-4d016c48fc98" containerName="main"
Jul 28 14:29:19.214807 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.214779    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.221197 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.221175    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7d901975-openshift-default-dockercfg-x2p5p\""
Jul 28 14:29:19.228373 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.228347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:19.271608 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.271569    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"]
Jul 28 14:29:19.382927 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.382887    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-socket\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.382935    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-certs\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.382959    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-podinfo\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.382984    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-data\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.383080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-credential-socket\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.383118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpmpz\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-kube-api-access-wpmpz\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.383160    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-envoy\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.383229    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09bcd52-5108-46b3-acdd-ca0f467e7648-istiod-ca-cert\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.383481 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.383389    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-token\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.454688 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.454652    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:19.484093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.483987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-token\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484038    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-socket\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484060    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-certs\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484079    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-podinfo\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-data\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484132    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-credential-socket\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484270    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpmpz\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-kube-api-access-wpmpz\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484342    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-envoy\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484390    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09bcd52-5108-46b3-acdd-ca0f467e7648-istiod-ca-cert\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484674 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484508    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-certs\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484674 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484563    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-socket\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484674 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484572    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-data\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.484846 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.484777    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-credential-socket\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.485066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.485048    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09bcd52-5108-46b3-acdd-ca0f467e7648-istiod-ca-cert\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.486563 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.486543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-envoy\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.486656 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.486636    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-podinfo\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.495290 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.495260    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpmpz\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-kube-api-access-wpmpz\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.495423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.495294    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-token\") pod \"e2e-ait-7d901975-openshift-default-5c55959888-kf7cx\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") " pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.527406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.527375    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:19.670092 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.670067    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"]
Jul 28 14:29:19.671203 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:29:19.671178    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd09bcd52_5108_46b3_acdd_ca0f467e7648.slice/crio-2c5d2ffcd2ff109023b6a85c32e1c7bce66e237f3f67222e17e08b12fbcce28c WatchSource:0}: Error finding container 2c5d2ffcd2ff109023b6a85c32e1c7bce66e237f3f67222e17e08b12fbcce28c: Status 404 returned error can't find the container with id 2c5d2ffcd2ff109023b6a85c32e1c7bce66e237f3f67222e17e08b12fbcce28c
Jul 28 14:29:19.673594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.673561    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:19.673705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.673641    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:19.673705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:19.673687    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:20.477610 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:20.477576    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" event={"ID":"d09bcd52-5108-46b3-acdd-ca0f467e7648","Type":"ContainerStarted","Data":"d9c5297351a780a21195499655e41a4f2ddcdee102b025515375043b3a651721"}
Jul 28 14:29:20.477800 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:20.477633    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" event={"ID":"d09bcd52-5108-46b3-acdd-ca0f467e7648","Type":"ContainerStarted","Data":"2c5d2ffcd2ff109023b6a85c32e1c7bce66e237f3f67222e17e08b12fbcce28c"}
Jul 28 14:29:20.528363 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:20.528326    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:20.533706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:20.533680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:20.562898 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:20.562841    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podStartSLOduration=1.56282077 podStartE2EDuration="1.56282077s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:20.509148958 +0000 UTC m=+1773.743668431" watchObservedRunningTime="2026-07-28 14:29:20.56282077 +0000 UTC m=+1773.797340242"
Jul 28 14:29:21.483329 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:21.483296    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:21.484347 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:21.484324    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:21.959750 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:21.959715    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:22.089145 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:22.089108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:22.323336 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:22.323293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:22.472255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:22.472220    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:23.020427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:23.020394    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:23.140014 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:23.139983    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:36.811137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:36.810374    2558 patch_prober.go:28] interesting pod/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:55208->10.133.0.41:15021: read: connection reset by peer" start-of-body=
Jul 28 14:29:36.811137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:36.810489    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": read tcp 10.133.0.2:55208->10.133.0.41:15021: read: connection reset by peer"
Jul 28 14:29:37.562711 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:37.562676    2558 generic.go:356] "Generic (PLEG): container finished" podID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerID="d9c5297351a780a21195499655e41a4f2ddcdee102b025515375043b3a651721" exitCode=0
Jul 28 14:29:37.562890 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:37.562749    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" event={"ID":"d09bcd52-5108-46b3-acdd-ca0f467e7648","Type":"ContainerDied","Data":"d9c5297351a780a21195499655e41a4f2ddcdee102b025515375043b3a651721"}
Jul 28 14:29:37.563227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:37.563210    2558 scope.go:117] "RemoveContainer" containerID="d9c5297351a780a21195499655e41a4f2ddcdee102b025515375043b3a651721"
Jul 28 14:29:37.564216 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:37.564189    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:37.564280 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:37.564259    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:37.564332 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:37.564295    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:38.569538 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:38.569497    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" event={"ID":"d09bcd52-5108-46b3-acdd-ca0f467e7648","Type":"ContainerStarted","Data":"157e7800908c6c9ae99c5e4fbe6453b5598caf1a5994b4a7c82dbb4317977dcb"}
Jul 28 14:29:39.528279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:39.528237    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:39.528556 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:39.528531    2558 patch_prober.go:28] interesting pod/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 14:29:39.528608 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:39.528582    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 14:29:40.528749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:40.528711    2558 patch_prober.go:28] interesting pod/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 14:29:40.529186 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:40.528768    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 14:29:41.528324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:41.528282    2558 patch_prober.go:28] interesting pod/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 28 14:29:41.528523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:41.528345    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 28 14:29:42.540756 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:42.540721    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:42.541172 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:42.540972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:42.541780 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:42.541763    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:47.274980 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.274942    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:29:47.277203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.277175    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:29:47.601965 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.601867    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"]
Jul 28 14:29:47.605346 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.605323    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:47.608147 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.608127    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:29:47.608377 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.608359    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:29:47.616420 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.616385    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"]
Jul 28 14:29:47.663684 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.663656    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/803ab5ba-7901-44af-bee7-51c9003e5bc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d901975-5h6lt\" (UID: \"803ab5ba-7901-44af-bee7-51c9003e5bc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:47.764329 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.764289    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/803ab5ba-7901-44af-bee7-51c9003e5bc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d901975-5h6lt\" (UID: \"803ab5ba-7901-44af-bee7-51c9003e5bc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:47.764955 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.764926    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/803ab5ba-7901-44af-bee7-51c9003e5bc2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d901975-5h6lt\" (UID: \"803ab5ba-7901-44af-bee7-51c9003e5bc2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:47.917262 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:47.917172    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:48.060511 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:48.060482    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"]
Jul 28 14:29:48.062403 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:29:48.062372    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803ab5ba_7901_44af_bee7_51c9003e5bc2.slice/crio-19fb144bcb94ab55f3a940a209e63a693fe6571f03fbedf17a7335d2b4ee5eac WatchSource:0}: Error finding container 19fb144bcb94ab55f3a940a209e63a693fe6571f03fbedf17a7335d2b4ee5eac: Status 404 returned error can't find the container with id 19fb144bcb94ab55f3a940a209e63a693fe6571f03fbedf17a7335d2b4ee5eac
Jul 28 14:29:48.628630 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:48.628589    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt" event={"ID":"803ab5ba-7901-44af-bee7-51c9003e5bc2","Type":"ContainerStarted","Data":"4bbb9df7e561c6c345839cd98d68f2253cba7bfa0b7c6445d43cb06833bbcf55"}
Jul 28 14:29:48.629073 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:48.628650    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt" event={"ID":"803ab5ba-7901-44af-bee7-51c9003e5bc2","Type":"ContainerStarted","Data":"19fb144bcb94ab55f3a940a209e63a693fe6571f03fbedf17a7335d2b4ee5eac"}
Jul 28 14:29:48.650478 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:48.650427    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt" podStartSLOduration=1.650409072 podStartE2EDuration="1.650409072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:48.648624843 +0000 UTC m=+1801.883144315" watchObservedRunningTime="2026-07-28 14:29:48.650409072 +0000 UTC m=+1801.884928543"
Jul 28 14:29:49.635426 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:49.635390    2558 generic.go:356] "Generic (PLEG): container finished" podID="803ab5ba-7901-44af-bee7-51c9003e5bc2" containerID="4bbb9df7e561c6c345839cd98d68f2253cba7bfa0b7c6445d43cb06833bbcf55" exitCode=0
Jul 28 14:29:49.635830 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:49.635483    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt" event={"ID":"803ab5ba-7901-44af-bee7-51c9003e5bc2","Type":"ContainerDied","Data":"4bbb9df7e561c6c345839cd98d68f2253cba7bfa0b7c6445d43cb06833bbcf55"}
Jul 28 14:29:50.775998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:50.775971    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:50.894605 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:50.894519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/803ab5ba-7901-44af-bee7-51c9003e5bc2-maas-api-service-ca\") pod \"803ab5ba-7901-44af-bee7-51c9003e5bc2\" (UID: \"803ab5ba-7901-44af-bee7-51c9003e5bc2\") "
Jul 28 14:29:50.894892 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:50.894867    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/803ab5ba-7901-44af-bee7-51c9003e5bc2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "803ab5ba-7901-44af-bee7-51c9003e5bc2" (UID: "803ab5ba-7901-44af-bee7-51c9003e5bc2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:29:50.996159 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:50.996123    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/803ab5ba-7901-44af-bee7-51c9003e5bc2-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:51.646862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:51.646770    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt" event={"ID":"803ab5ba-7901-44af-bee7-51c9003e5bc2","Type":"ContainerDied","Data":"19fb144bcb94ab55f3a940a209e63a693fe6571f03fbedf17a7335d2b4ee5eac"}
Jul 28 14:29:51.646862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:51.646826    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19fb144bcb94ab55f3a940a209e63a693fe6571f03fbedf17a7335d2b4ee5eac"
Jul 28 14:29:51.646862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:51.646792    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"
Jul 28 14:29:52.674355 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:52.674314    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:53.061310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.061277    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:53.158012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.157980    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:53.242108 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.242070    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:53.309470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.309434    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"]
Jul 28 14:29:53.313411 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.313346    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d901975-5h6lt"]
Jul 28 14:29:53.359743 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.359706    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:53.453523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.453490    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"]
Jul 28 14:29:53.453707 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.453686    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy" containerID="cri-o://157e7800908c6c9ae99c5e4fbe6453b5598caf1a5994b4a7c82dbb4317977dcb" gracePeriod=30
Jul 28 14:29:53.488669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.488635    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:53.739307 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:53.739221    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:54.004647 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.004615    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:54.100482 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.100448    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:54.273329 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.273235    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:54.657199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.657119    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"]
Jul 28 14:29:54.657556 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.657541    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803ab5ba-7901-44af-bee7-51c9003e5bc2" containerName="revoke-keys"
Jul 28 14:29:54.657556 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.657557    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="803ab5ba-7901-44af-bee7-51c9003e5bc2" containerName="revoke-keys"
Jul 28 14:29:54.657703 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.657629    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="803ab5ba-7901-44af-bee7-51c9003e5bc2" containerName="revoke-keys"
Jul 28 14:29:54.660929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.660908    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.667264 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.667233    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-d2089a60-gw-openshift-default-dockercfg-6qxcx\""
Jul 28 14:29:54.673519 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.673494    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:54.689799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.689770    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"]
Jul 28 14:29:54.831285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/926ad771-c29d-47de-bf54-c20c92c8b3c2-istiod-ca-cert\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831290    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-credential-socket\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-data\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th4gb\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-kube-api-access-th4gb\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-token\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831454    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-socket\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831548    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-certs\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831608    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-envoy\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.831677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.831650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-podinfo\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932721 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932624    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-certs\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932721 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932685    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-envoy\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932728    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-podinfo\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932758    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/926ad771-c29d-47de-bf54-c20c92c8b3c2-istiod-ca-cert\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932784    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-credential-socket\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932811    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-data\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932855    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-th4gb\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-kube-api-access-th4gb\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932883    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-token\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.932972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.932923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-socket\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.933385 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.933181    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-certs\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.933385 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.933283    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-credential-socket\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.933385 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.933327    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-socket\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.933599 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.933581    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/926ad771-c29d-47de-bf54-c20c92c8b3c2-istiod-ca-cert\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.933734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.933709    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-data\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.935127 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.935105    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-envoy\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.935273 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.935256    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-podinfo\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.943142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.943115    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-th4gb\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-kube-api-access-th4gb\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.943495 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.943475    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-token\") pod \"e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") " pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:54.952501 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.952467    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:54.972199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:54.972168    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:55.129537 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.129509    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"]
Jul 28 14:29:55.131472 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:29:55.131445    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod926ad771_c29d_47de_bf54_c20c92c8b3c2.slice/crio-49ca314e3317b2d522d5c97a7e5546fecb3d6fee3fc986fa0f2471afd7fb143f WatchSource:0}: Error finding container 49ca314e3317b2d522d5c97a7e5546fecb3d6fee3fc986fa0f2471afd7fb143f: Status 404 returned error can't find the container with id 49ca314e3317b2d522d5c97a7e5546fecb3d6fee3fc986fa0f2471afd7fb143f
Jul 28 14:29:55.134057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.134002    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:55.134157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.134133    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:55.134202 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.134176    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:29:55.287874 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.287835    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="803ab5ba-7901-44af-bee7-51c9003e5bc2" path="/var/lib/kubelet/pods/803ab5ba-7901-44af-bee7-51c9003e5bc2/volumes"
Jul 28 14:29:55.668359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.668323    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" event={"ID":"926ad771-c29d-47de-bf54-c20c92c8b3c2","Type":"ContainerStarted","Data":"61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"}
Jul 28 14:29:55.668542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.668375    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" event={"ID":"926ad771-c29d-47de-bf54-c20c92c8b3c2","Type":"ContainerStarted","Data":"49ca314e3317b2d522d5c97a7e5546fecb3d6fee3fc986fa0f2471afd7fb143f"}
Jul 28 14:29:55.709255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.709202    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podStartSLOduration=1.709186215 podStartE2EDuration="1.709186215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:29:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:29:55.708257625 +0000 UTC m=+1808.942777098" watchObservedRunningTime="2026-07-28 14:29:55.709186215 +0000 UTC m=+1808.943705687"
Jul 28 14:29:55.973162 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:55.973056    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:56.977759 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:56.977722    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:57.250399 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.250366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:57.396194 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.396156    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:57.543397 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.543308    2558 patch_prober.go:28] interesting pod/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 14:29:57.543397 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.543371    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 14:29:57.620919 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.620878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:57.678546 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.678517    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:57.679434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:57.679414    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:29:58.051989 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.051953    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:58.156197 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.156163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:29:58.686230 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.686197    2558 generic.go:356] "Generic (PLEG): container finished" podID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerID="157e7800908c6c9ae99c5e4fbe6453b5598caf1a5994b4a7c82dbb4317977dcb" exitCode=0
Jul 28 14:29:58.686418 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.686267    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" event={"ID":"d09bcd52-5108-46b3-acdd-ca0f467e7648","Type":"ContainerDied","Data":"157e7800908c6c9ae99c5e4fbe6453b5598caf1a5994b4a7c82dbb4317977dcb"}
Jul 28 14:29:58.686418 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.686330    2558 scope.go:117] "RemoveContainer" containerID="d9c5297351a780a21195499655e41a4f2ddcdee102b025515375043b3a651721"
Jul 28 14:29:58.720831 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.720772    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:58.873627 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873589    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-certs\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.873797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873636    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wpmpz\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-kube-api-access-wpmpz\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.873797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873693    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-credential-socket\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.873797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873731    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-envoy\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.873797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873793    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-data\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.874062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873874    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-socket\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.874062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873898    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-podinfo\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.874062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873922    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09bcd52-5108-46b3-acdd-ca0f467e7648-istiod-ca-cert\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.874062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873931    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:29:58.874062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.873958    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-token\") pod \"d09bcd52-5108-46b3-acdd-ca0f467e7648\" (UID: \"d09bcd52-5108-46b3-acdd-ca0f467e7648\") "
Jul 28 14:29:58.874311 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.874087    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:29:58.874311 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.874175    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:29:58.874410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.874352    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.874410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.874371    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.874410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.874397    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.875239 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.875212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-data" (OuterVolumeSpecName: "istio-data") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:29:58.876571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.876049    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d09bcd52-5108-46b3-acdd-ca0f467e7648-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:29:58.877704 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.877588    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:29:58.877704 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.877632    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-token" (OuterVolumeSpecName: "istio-token") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:29:58.877704 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.877654    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-kube-api-access-wpmpz" (OuterVolumeSpecName: "kube-api-access-wpmpz") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "kube-api-access-wpmpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:29:58.878168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.878152    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d09bcd52-5108-46b3-acdd-ca0f467e7648" (UID: "d09bcd52-5108-46b3-acdd-ca0f467e7648"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:29:58.975462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.975299    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.975462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.975331    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.975462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.975347    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d09bcd52-5108-46b3-acdd-ca0f467e7648-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.975462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.975359    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.975462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.975373    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wpmpz\" (UniqueName: \"kubernetes.io/projected/d09bcd52-5108-46b3-acdd-ca0f467e7648-kube-api-access-wpmpz\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:58.975462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:58.975386    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d09bcd52-5108-46b3-acdd-ca0f467e7648-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:29:59.692725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:59.692638    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"
Jul 28 14:29:59.692725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:59.692675    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx" event={"ID":"d09bcd52-5108-46b3-acdd-ca0f467e7648","Type":"ContainerDied","Data":"2c5d2ffcd2ff109023b6a85c32e1c7bce66e237f3f67222e17e08b12fbcce28c"}
Jul 28 14:29:59.693252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:59.692732    2558 scope.go:117] "RemoveContainer" containerID="157e7800908c6c9ae99c5e4fbe6453b5598caf1a5994b4a7c82dbb4317977dcb"
Jul 28 14:29:59.724456 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:59.724430    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"]
Jul 28 14:29:59.729709 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:29:59.729680    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7d901975-openshift-default-5c55959888-kf7cx"]
Jul 28 14:30:00.144555 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.144509    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"]
Jul 28 14:30:00.144969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.144948    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy"
Jul 28 14:30:00.145097 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.144972    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy"
Jul 28 14:30:00.145169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.145132    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy"
Jul 28 14:30:00.149950 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.149927    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"
Jul 28 14:30:00.151754 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.151726    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"]
Jul 28 14:30:00.152183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.152167    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy"
Jul 28 14:30:00.152246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.152186    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy"
Jul 28 14:30:00.152293 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.152261    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" containerName="istio-proxy"
Jul 28 14:30:00.154070 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.154051    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:30:00.155243 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.155227    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"
Jul 28 14:30:00.162764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.162732    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"
Jul 28 14:30:00.163272 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.163242    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"]
Jul 28 14:30:00.169008 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.168981    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"]
Jul 28 14:30:00.174771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.174584    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"
Jul 28 14:30:00.344879 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.344856    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"]
Jul 28 14:30:00.347316 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:30:00.347269    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615a6bb6_cbf0_463d_996c_9fdce25d3734.slice/crio-b23223ba804ded916a0f911485f921464b7c1e8fff496bcaded869f890846ab4 WatchSource:0}: Error finding container b23223ba804ded916a0f911485f921464b7c1e8fff496bcaded869f890846ab4: Status 404 returned error can't find the container with id b23223ba804ded916a0f911485f921464b7c1e8fff496bcaded869f890846ab4
Jul 28 14:30:00.366365 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.366341    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"]
Jul 28 14:30:00.369244 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:30:00.369213    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ae34c7a_3fd1_4e2a_9ae8_4409a48b18e2.slice/crio-aabed61d1b6e58853746adec8f8344fa2fc530e9750d082baf320c6d18162d56 WatchSource:0}: Error finding container aabed61d1b6e58853746adec8f8344fa2fc530e9750d082baf320c6d18162d56: Status 404 returned error can't find the container with id aabed61d1b6e58853746adec8f8344fa2fc530e9750d082baf320c6d18162d56
Jul 28 14:30:00.698991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.698958    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q" event={"ID":"5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2","Type":"ContainerStarted","Data":"afc36415b3a9a5f2bf6143d96efc4ab168e6442e83382ff986b2ae8649015251"}
Jul 28 14:30:00.699399 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.699033    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q" event={"ID":"5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2","Type":"ContainerStarted","Data":"aabed61d1b6e58853746adec8f8344fa2fc530e9750d082baf320c6d18162d56"}
Jul 28 14:30:00.700393 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.700369    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" event={"ID":"615a6bb6-cbf0-463d-996c-9fdce25d3734","Type":"ContainerStarted","Data":"882bcf10c4bc396f59fcaad2f952d6154c3de45be3a3efec4568df707576cbb3"}
Jul 28 14:30:00.700478 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.700415    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" event={"ID":"615a6bb6-cbf0-463d-996c-9fdce25d3734","Type":"ContainerStarted","Data":"b23223ba804ded916a0f911485f921464b7c1e8fff496bcaded869f890846ab4"}
Jul 28 14:30:00.722494 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.722446    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q" podStartSLOduration=0.722431938 podStartE2EDuration="722.431938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:30:00.720516081 +0000 UTC m=+1813.955035553" watchObservedRunningTime="2026-07-28 14:30:00.722431938 +0000 UTC m=+1813.956951410"
Jul 28 14:30:00.745429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:00.745384    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" podStartSLOduration=0.745370331 podStartE2EDuration="745.370331ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:30:00.742873832 +0000 UTC m=+1813.977393304" watchObservedRunningTime="2026-07-28 14:30:00.745370331 +0000 UTC m=+1813.979889803"
Jul 28 14:30:01.285682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:01.285644    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d09bcd52-5108-46b3-acdd-ca0f467e7648" path="/var/lib/kubelet/pods/d09bcd52-5108-46b3-acdd-ca0f467e7648/volumes"
Jul 28 14:30:01.709345 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:01.709238    2558 generic.go:356] "Generic (PLEG): container finished" podID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerID="882bcf10c4bc396f59fcaad2f952d6154c3de45be3a3efec4568df707576cbb3" exitCode=7
Jul 28 14:30:01.709345 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:01.709322    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" event={"ID":"615a6bb6-cbf0-463d-996c-9fdce25d3734","Type":"ContainerDied","Data":"882bcf10c4bc396f59fcaad2f952d6154c3de45be3a3efec4568df707576cbb3"}
Jul 28 14:30:01.709854 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:01.709494    2558 scope.go:117] "RemoveContainer" containerID="882bcf10c4bc396f59fcaad2f952d6154c3de45be3a3efec4568df707576cbb3"
Jul 28 14:30:01.710891 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:01.710869    2558 generic.go:356] "Generic (PLEG): container finished" podID="5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2" containerID="afc36415b3a9a5f2bf6143d96efc4ab168e6442e83382ff986b2ae8649015251" exitCode=0
Jul 28 14:30:01.710969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:01.710898    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q" event={"ID":"5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2","Type":"ContainerDied","Data":"afc36415b3a9a5f2bf6143d96efc4ab168e6442e83382ff986b2ae8649015251"}
Jul 28 14:30:02.718748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:02.718653    2558 generic.go:356] "Generic (PLEG): container finished" podID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerID="524e2504198bf37181296115891160d4f54f2d7d511d95e256cdc0da162e6739" exitCode=7
Jul 28 14:30:02.718748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:02.718732    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" event={"ID":"615a6bb6-cbf0-463d-996c-9fdce25d3734","Type":"ContainerDied","Data":"524e2504198bf37181296115891160d4f54f2d7d511d95e256cdc0da162e6739"}
Jul 28 14:30:02.719227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:02.718797    2558 scope.go:117] "RemoveContainer" containerID="882bcf10c4bc396f59fcaad2f952d6154c3de45be3a3efec4568df707576cbb3"
Jul 28 14:30:02.719227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:02.718959    2558 scope.go:117] "RemoveContainer" containerID="524e2504198bf37181296115891160d4f54f2d7d511d95e256cdc0da162e6739"
Jul 28 14:30:02.719574 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:30:02.719232    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6_odh-ai-gateway-infra(615a6bb6-cbf0-463d-996c-9fdce25d3734)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734"
Jul 28 14:30:02.856929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:02.856899    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"
Jul 28 14:30:03.725230 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:03.725141    2558 scope.go:117] "RemoveContainer" containerID="524e2504198bf37181296115891160d4f54f2d7d511d95e256cdc0da162e6739"
Jul 28 14:30:03.725650 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:30:03.725347    2558 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6_odh-ai-gateway-infra(615a6bb6-cbf0-463d-996c-9fdce25d3734)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734"
Jul 28 14:30:03.726267 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:03.726243    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q" event={"ID":"5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2","Type":"ContainerDied","Data":"aabed61d1b6e58853746adec8f8344fa2fc530e9750d082baf320c6d18162d56"}
Jul 28 14:30:03.726360 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:03.726268    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754150-vkk9q"
Jul 28 14:30:03.726360 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:03.726291    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aabed61d1b6e58853746adec8f8344fa2fc530e9750d082baf320c6d18162d56"
Jul 28 14:30:06.882497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.882458    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"]
Jul 28 14:30:06.883634 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.883608    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2" containerName="cleanup"
Jul 28 14:30:06.883797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.883784    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2" containerName="cleanup"
Jul 28 14:30:06.884010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.883995    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2" containerName="cleanup"
Jul 28 14:30:06.887576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.887553    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:06.891706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.891674    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:30:06.914187 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.914155    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"]
Jul 28 14:30:06.947295 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:06.947255    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv\" (UID: \"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:07.047869 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.047815    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv\" (UID: \"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:07.048565 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.048540    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv\" (UID: \"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:07.212184 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.212076    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:07.392782 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.392736    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"]
Jul 28 14:30:07.403206 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:30:07.403173    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67069c3_cd2d_457c_bb2e_6e48cd7c8ba7.slice/crio-a1401e7000ff27fdd082f46b22bc4f821e83a8a245d27fa7b6099edc37b3f3c7 WatchSource:0}: Error finding container a1401e7000ff27fdd082f46b22bc4f821e83a8a245d27fa7b6099edc37b3f3c7: Status 404 returned error can't find the container with id a1401e7000ff27fdd082f46b22bc4f821e83a8a245d27fa7b6099edc37b3f3c7
Jul 28 14:30:07.747912 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.747871    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv" event={"ID":"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7","Type":"ContainerStarted","Data":"90091e0f91728dd4bb5259d43cbd67526c8cfdbd80ff4b16fd5e33755bb9f2ff"}
Jul 28 14:30:07.748149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.747926    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv" event={"ID":"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7","Type":"ContainerStarted","Data":"a1401e7000ff27fdd082f46b22bc4f821e83a8a245d27fa7b6099edc37b3f3c7"}
Jul 28 14:30:07.768909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:07.768850    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv" podStartSLOduration=1.768834301 podStartE2EDuration="1.768834301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:30:07.767445045 +0000 UTC m=+1821.001964517" watchObservedRunningTime="2026-07-28 14:30:07.768834301 +0000 UTC m=+1821.003353772"
Jul 28 14:30:08.754131 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:08.754095    2558 generic.go:356] "Generic (PLEG): container finished" podID="f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7" containerID="90091e0f91728dd4bb5259d43cbd67526c8cfdbd80ff4b16fd5e33755bb9f2ff" exitCode=0
Jul 28 14:30:08.754521 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:08.754183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv" event={"ID":"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7","Type":"ContainerDied","Data":"90091e0f91728dd4bb5259d43cbd67526c8cfdbd80ff4b16fd5e33755bb9f2ff"}
Jul 28 14:30:09.906519 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:09.906493    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:09.970378 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:09.970344    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7-maas-api-service-ca\") pod \"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7\" (UID: \"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7\") "
Jul 28 14:30:09.970741 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:09.970715    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7" (UID: "f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:30:10.071705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:10.071618    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:10.765554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:10.765509    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv" event={"ID":"f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7","Type":"ContainerDied","Data":"a1401e7000ff27fdd082f46b22bc4f821e83a8a245d27fa7b6099edc37b3f3c7"}
Jul 28 14:30:10.765554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:10.765538    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"
Jul 28 14:30:10.765797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:10.765582    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a1401e7000ff27fdd082f46b22bc4f821e83a8a245d27fa7b6099edc37b3f3c7"
Jul 28 14:30:11.772718 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:11.772680    2558 generic.go:356] "Generic (PLEG): container finished" podID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerID="61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5" exitCode=0
Jul 28 14:30:11.773168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:11.772758    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" event={"ID":"926ad771-c29d-47de-bf54-c20c92c8b3c2","Type":"ContainerDied","Data":"61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"}
Jul 28 14:30:11.773342 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:11.773324    2558 scope.go:117] "RemoveContainer" containerID="61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"
Jul 28 14:30:11.774665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:11.774627    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:11.774751 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:11.774712    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:11.774790 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:11.774755    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:12.679094 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:12.679053    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:12.780352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:12.780316    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" event={"ID":"926ad771-c29d-47de-bf54-c20c92c8b3c2","Type":"ContainerStarted","Data":"8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15"}
Jul 28 14:30:12.972731 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:12.972650    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:12.973727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:12.973693    2558 patch_prober.go:28] interesting pod/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 14:30:12.973865 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:12.973748    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 14:30:13.972732 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:13.972689    2558 patch_prober.go:28] interesting pod/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 14:30:13.973234 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:13.972767    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 14:30:14.973591 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:14.973535    2558 patch_prober.go:28] interesting pod/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 14:30:14.974134 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:14.973623    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 14:30:15.973360 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:15.973320    2558 patch_prober.go:28] interesting pod/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 14:30:15.973640 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:15.973607    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 14:30:16.973298 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:16.973256    2558 patch_prober.go:28] interesting pod/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Jul 28 14:30:16.973520 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:16.973339    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Jul 28 14:30:17.640142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.640103    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"]
Jul 28 14:30:17.640991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.640922    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:17.797434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.797406    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"
Jul 28 14:30:17.812802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.812774    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6" event={"ID":"615a6bb6-cbf0-463d-996c-9fdce25d3734","Type":"ContainerDied","Data":"b23223ba804ded916a0f911485f921464b7c1e8fff496bcaded869f890846ab4"}
Jul 28 14:30:17.812802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.812802    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"
Jul 28 14:30:17.812973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.812833    2558 scope.go:117] "RemoveContainer" containerID="524e2504198bf37181296115891160d4f54f2d7d511d95e256cdc0da162e6739"
Jul 28 14:30:17.848725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.848695    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:17.866665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.866629    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"]
Jul 28 14:30:17.874049 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.873997    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-d2089a60-29754150-whqc6"]
Jul 28 14:30:17.976947 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.976867    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:17.977319 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.977295    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:17.978061 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:17.978038    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:18.028119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.028080    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"]
Jul 28 14:30:18.037400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.037373    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:18.038297 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.038273    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-d2089a60-t89zv"]
Jul 28 14:30:18.135274 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.135224    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:18.191062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.191006    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"]
Jul 28 14:30:18.231297 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.231214    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:18.435509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.435475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:18.673120 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.673085    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:18.819391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:18.819360    2558 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" secret="" err="secret \"e2e-migrate-d2089a60-gw-openshift-default-dockercfg-6qxcx\" not found"
Jul 28 14:30:19.020035 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.019986    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"]
Jul 28 14:30:19.020407 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.020393    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerName="cleanup"
Jul 28 14:30:19.020407 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.020408    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerName="cleanup"
Jul 28 14:30:19.020509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.020422    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7" containerName="revoke-keys"
Jul 28 14:30:19.020509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.020428    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7" containerName="revoke-keys"
Jul 28 14:30:19.020509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.020493    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7" containerName="revoke-keys"
Jul 28 14:30:19.020509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.020502    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerName="cleanup"
Jul 28 14:30:19.023051 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.023035    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.025693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.025673    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0b8a5700-openshift-default-dockercfg-jn5jw\""
Jul 28 14:30:19.039888 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.039863    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"]
Jul 28 14:30:19.057898 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.057866    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-data\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.057931    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-certs\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.057969    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-podinfo\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.057995    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-credential-socket\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058173 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.058080    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-token\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058173 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.058138    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istiod-ca-cert\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.058167    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrn44\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-kube-api-access-xrn44\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.058208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-envoy\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.058238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.058232    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-socket\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.069895 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.069870    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:19.159355 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159314    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istiod-ca-cert\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159367    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrn44\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-kube-api-access-xrn44\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159409    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-envoy\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159428    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-socket\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159445    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-data\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-certs\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159523    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-podinfo\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159555    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-credential-socket\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159589    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-token\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.159875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159811    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-data\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.160055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.159942    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-socket\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.160149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.160119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-certs\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.160149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.160120    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-credential-socket\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.160339 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.160176    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istiod-ca-cert\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.161957 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.161933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-envoy\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.162072 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.162057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-podinfo\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.170637 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.170617    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-token\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.170794 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.170771    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrn44\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-kube-api-access-xrn44\") pod \"e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") " pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.283737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.283655    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" path="/var/lib/kubelet/pods/615a6bb6-cbf0-463d-996c-9fdce25d3734/volumes"
Jul 28 14:30:19.283976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.283961    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7" path="/var/lib/kubelet/pods/f67069c3-cd2d-457c-bb2e-6e48cd7c8ba7/volumes"
Jul 28 14:30:19.333795 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.333762    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:19.481112 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.481083    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"]
Jul 28 14:30:19.482940 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:30:19.482912    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c76bb27_84be_4b12_b532_c48d8a4a42e4.slice/crio-e1f8a04f634e3549f0a303db40ab02699d175c6f680e1fb8c30a6e0ad7d8b3c3 WatchSource:0}: Error finding container e1f8a04f634e3549f0a303db40ab02699d175c6f680e1fb8c30a6e0ad7d8b3c3: Status 404 returned error can't find the container with id e1f8a04f634e3549f0a303db40ab02699d175c6f680e1fb8c30a6e0ad7d8b3c3
Jul 28 14:30:19.485107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.485073    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:19.485176 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.485140    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:19.485176 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.485167    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:19.660962 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.660875    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:19.826113 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.826074    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" event={"ID":"6c76bb27-84be-4b12-b532-c48d8a4a42e4","Type":"ContainerStarted","Data":"7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"}
Jul 28 14:30:19.826545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.826137    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" event={"ID":"6c76bb27-84be-4b12-b532-c48d8a4a42e4","Type":"ContainerStarted","Data":"e1f8a04f634e3549f0a303db40ab02699d175c6f680e1fb8c30a6e0ad7d8b3c3"}
Jul 28 14:30:19.826545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.826172    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy" containerID="cri-o://8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15" gracePeriod=30
Jul 28 14:30:19.867328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:19.867273    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podStartSLOduration=1.8672570689999999 podStartE2EDuration="1.867257069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:30:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:30:19.865282146 +0000 UTC m=+1833.099801618" watchObservedRunningTime="2026-07-28 14:30:19.867257069 +0000 UTC m=+1833.101776540"
Jul 28 14:30:20.334773 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:20.334731    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:20.339665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:20.339641    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:20.831700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:20.831669    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:20.832788 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:20.832769    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:21.291895 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:21.291856    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:21.390336 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:21.390293    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:21.561787 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:21.561696    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:22.013345 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:22.013310    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:22.390746 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:22.390666    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:23.088414 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:23.088360    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:30:25.085806 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.085744    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:25.221956 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.221923    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-envoy\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.221978    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-token\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222001    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-th4gb\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-kube-api-access-th4gb\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222049    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-data\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222074    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/926ad771-c29d-47de-bf54-c20c92c8b3c2-istiod-ca-cert\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222095    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-credential-socket\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222159    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-podinfo\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222188    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-socket\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222803 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222247    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-certs\") pod \"926ad771-c29d-47de-bf54-c20c92c8b3c2\" (UID: \"926ad771-c29d-47de-bf54-c20c92c8b3c2\") "
Jul 28 14:30:25.222803 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222636    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:30:25.222803 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222742    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:30:25.222803 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/926ad771-c29d-47de-bf54-c20c92c8b3c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:30:25.222981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222926    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:30:25.222981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.222960    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:30:25.224316 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.224290    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:30:25.224316 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.224295    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:30:25.224817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.224793    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:30:25.224817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.224810    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-kube-api-access-th4gb" (OuterVolumeSpecName: "kube-api-access-th4gb") pod "926ad771-c29d-47de-bf54-c20c92c8b3c2" (UID: "926ad771-c29d-47de-bf54-c20c92c8b3c2"). InnerVolumeSpecName "kube-api-access-th4gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:30:25.323366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323335    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-th4gb\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-kube-api-access-th4gb\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323363    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323372    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/926ad771-c29d-47de-bf54-c20c92c8b3c2-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323380    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323388    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323397    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323404    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323412    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.323567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.323419    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/926ad771-c29d-47de-bf54-c20c92c8b3c2-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:25.859829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.859794    2558 generic.go:356] "Generic (PLEG): container finished" podID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerID="8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15" exitCode=0
Jul 28 14:30:25.860045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.859840    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"
Jul 28 14:30:25.860045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.859846    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" event={"ID":"926ad771-c29d-47de-bf54-c20c92c8b3c2","Type":"ContainerDied","Data":"8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15"}
Jul 28 14:30:25.860045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.859890    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64" event={"ID":"926ad771-c29d-47de-bf54-c20c92c8b3c2","Type":"ContainerDied","Data":"49ca314e3317b2d522d5c97a7e5546fecb3d6fee3fc986fa0f2471afd7fb143f"}
Jul 28 14:30:25.860045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.859910    2558 scope.go:117] "RemoveContainer" containerID="8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15"
Jul 28 14:30:25.868961 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.868938    2558 scope.go:117] "RemoveContainer" containerID="61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"
Jul 28 14:30:25.878258 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.878233    2558 scope.go:117] "RemoveContainer" containerID="8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15"
Jul 28 14:30:25.878561 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:30:25.878537    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15\": container with ID starting with 8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15 not found: ID does not exist" containerID="8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15"
Jul 28 14:30:25.878667 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.878571    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15"} err="failed to get container status \"8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15\": rpc error: code = NotFound desc = could not find container \"8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15\": container with ID starting with 8f6780eb503724ec3bc5bc9d8c12c1ca20fd0238c8855a555f7be1bbd8332a15 not found: ID does not exist"
Jul 28 14:30:25.878667 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.878593    2558 scope.go:117] "RemoveContainer" containerID="61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"
Jul 28 14:30:25.878897 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:30:25.878879    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5\": container with ID starting with 61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5 not found: ID does not exist" containerID="61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"
Jul 28 14:30:25.878947 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.878904    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5"} err="failed to get container status \"61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5\": rpc error: code = NotFound desc = could not find container \"61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5\": container with ID starting with 61a0dc1ae7e4900b98193f81765ba5974e35256e7a9b07dc78a4824c036621a5 not found: ID does not exist"
Jul 28 14:30:25.882771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.882745    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"]
Jul 28 14:30:25.888235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:25.888213    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-d2089a60-gw-openshift-default-98897b96d-vjk64"]
Jul 28 14:30:27.282672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:27.282641    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" path="/var/lib/kubelet/pods/926ad771-c29d-47de-bf54-c20c92c8b3c2/volumes"
Jul 28 14:30:35.833286 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.833201    2558 patch_prober.go:28] interesting pod/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 14:30:35.833689 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.833279    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 14:30:35.924578 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.924544    2558 generic.go:356] "Generic (PLEG): container finished" podID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerID="7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244" exitCode=0
Jul 28 14:30:35.924578 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.924586    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" event={"ID":"6c76bb27-84be-4b12-b532-c48d8a4a42e4","Type":"ContainerDied","Data":"7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"}
Jul 28 14:30:35.925084 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.925065    2558 scope.go:117] "RemoveContainer" containerID="7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"
Jul 28 14:30:35.926131 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.926100    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:35.926200 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.926173    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:35.926240 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:35.926206    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:30:36.930636 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:36.930603    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" event={"ID":"6c76bb27-84be-4b12-b532-c48d8a4a42e4","Type":"ContainerStarted","Data":"b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748"}
Jul 28 14:30:37.334906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:37.334865    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:37.335231 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:37.335207    2558 patch_prober.go:28] interesting pod/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 14:30:37.335330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:37.335266    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 14:30:38.335113 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:38.335071    2558 patch_prober.go:28] interesting pod/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 14:30:38.335635 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:38.335138    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 14:30:39.335061 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:39.335002    2558 patch_prober.go:28] interesting pod/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 14:30:39.335256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:39.335094    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 14:30:40.334830 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:40.334795    2558 patch_prober.go:28] interesting pod/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 14:30:40.335052 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:40.334853    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 14:30:41.334318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:41.334281    2558 patch_prober.go:28] interesting pod/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 28 14:30:41.334789 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:41.334344    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 28 14:30:42.338105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:42.338069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:42.338487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:42.338358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:42.338965 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:42.338948    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:30:52.414191 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414154    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"]
Jul 28 14:30:52.414786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414714    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy"
Jul 28 14:30:52.414786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414735    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy"
Jul 28 14:30:52.414786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414748    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerName="cleanup"
Jul 28 14:30:52.414786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414757    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerName="cleanup"
Jul 28 14:30:52.415039 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414876    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy"
Jul 28 14:30:52.415039 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.414894    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="615a6bb6-cbf0-463d-996c-9fdce25d3734" containerName="cleanup"
Jul 28 14:30:52.416906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.416886    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:52.419658 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.419630    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:30:52.419786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.419630    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:30:52.427334 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.427313    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"]
Jul 28 14:30:52.496508 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.496467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e535bef-2887-4327-996d-a4df9863c8c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8a5700-btktv\" (UID: \"4e535bef-2887-4327-996d-a4df9863c8c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:52.597410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.597374    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e535bef-2887-4327-996d-a4df9863c8c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8a5700-btktv\" (UID: \"4e535bef-2887-4327-996d-a4df9863c8c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:52.598080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.598058    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e535bef-2887-4327-996d-a4df9863c8c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0b8a5700-btktv\" (UID: \"4e535bef-2887-4327-996d-a4df9863c8c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:52.728367 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.728286    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:52.873684 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:52.873656    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"]
Jul 28 14:30:52.875423 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:30:52.875393    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e535bef_2887_4327_996d_a4df9863c8c8.slice/crio-5d2489a0a2ed5f643702e94f9bee764f9cf1085547017c7c9bec309e5967179f WatchSource:0}: Error finding container 5d2489a0a2ed5f643702e94f9bee764f9cf1085547017c7c9bec309e5967179f: Status 404 returned error can't find the container with id 5d2489a0a2ed5f643702e94f9bee764f9cf1085547017c7c9bec309e5967179f
Jul 28 14:30:53.010661 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:53.010622    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv" event={"ID":"4e535bef-2887-4327-996d-a4df9863c8c8","Type":"ContainerStarted","Data":"5d2489a0a2ed5f643702e94f9bee764f9cf1085547017c7c9bec309e5967179f"}
Jul 28 14:30:54.020903 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:54.020869    2558 generic.go:356] "Generic (PLEG): container finished" podID="4e535bef-2887-4327-996d-a4df9863c8c8" containerID="9fd5281aa3c8957f880c226cc5f75bc6d503d05d7fd9743cbe558c709572d7f4" exitCode=0
Jul 28 14:30:54.021323 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:54.020961    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv" event={"ID":"4e535bef-2887-4327-996d-a4df9863c8c8","Type":"ContainerDied","Data":"9fd5281aa3c8957f880c226cc5f75bc6d503d05d7fd9743cbe558c709572d7f4"}
Jul 28 14:30:55.171632 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:55.171607    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:55.226152 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:55.226120    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e535bef-2887-4327-996d-a4df9863c8c8-maas-api-service-ca\") pod \"4e535bef-2887-4327-996d-a4df9863c8c8\" (UID: \"4e535bef-2887-4327-996d-a4df9863c8c8\") "
Jul 28 14:30:55.226448 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:55.226425    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e535bef-2887-4327-996d-a4df9863c8c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4e535bef-2887-4327-996d-a4df9863c8c8" (UID: "4e535bef-2887-4327-996d-a4df9863c8c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:30:55.327173 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:55.327140    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e535bef-2887-4327-996d-a4df9863c8c8-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:30:56.032366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:56.032334    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv" event={"ID":"4e535bef-2887-4327-996d-a4df9863c8c8","Type":"ContainerDied","Data":"5d2489a0a2ed5f643702e94f9bee764f9cf1085547017c7c9bec309e5967179f"}
Jul 28 14:30:56.032366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:56.032358    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"
Jul 28 14:30:56.032576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:30:56.032382    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d2489a0a2ed5f643702e94f9bee764f9cf1085547017c7c9bec309e5967179f"
Jul 28 14:31:03.566584 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:03.566544    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:03.706917 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:03.706880    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:03.930518 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:03.930430    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"]
Jul 28 14:31:03.941109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:03.941075    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:03.941609 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:03.941591    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0b8a5700-btktv"]
Jul 28 14:31:05.282596 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:05.282562    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e535bef-2887-4327-996d-a4df9863c8c8" path="/var/lib/kubelet/pods/4e535bef-2887-4327-996d-a4df9863c8c8/volumes"
Jul 28 14:31:05.346433 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:05.346397    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"]
Jul 28 14:31:05.346636 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:05.346598    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy" containerID="cri-o://b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748" gracePeriod=30
Jul 28 14:31:05.352156 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:05.352125    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:05.585517 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:05.585424    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:05.785069 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:05.785038    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.160643    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"]
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.161586    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e535bef-2887-4327-996d-a4df9863c8c8" containerName="revoke-keys"
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.161606    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e535bef-2887-4327-996d-a4df9863c8c8" containerName="revoke-keys"
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.161622    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy"
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.161631    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy"
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.161855    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="926ad771-c29d-47de-bf54-c20c92c8b3c2" containerName="istio-proxy"
Jul 28 14:31:06.164038 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.161867    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e535bef-2887-4327-996d-a4df9863c8c8" containerName="revoke-keys"
Jul 28 14:31:06.165283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.165250    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.177970 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.177950    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-384b773a-openshift-default-dockercfg-rrrmb\""
Jul 28 14:31:06.207475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.207400    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"]
Jul 28 14:31:06.209483 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.209458    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:06.344113 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344067    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-envoy\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istiod-ca-cert\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-credential-socket\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-data\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344250    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-token\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-certs\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-socket\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344463    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-podinfo\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.344580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.344496    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnrr\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-kube-api-access-7qnrr\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.445838 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445759    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-certs\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.445838 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445809    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-socket\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.445838 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445834    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-podinfo\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445860    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnrr\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-kube-api-access-7qnrr\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445887    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-envoy\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445927    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istiod-ca-cert\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445947    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-credential-socket\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445971    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-data\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.445999    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-token\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.446252    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-certs\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.446286    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-socket\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.446500    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-credential-socket\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.446561    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-data\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.446705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.446686    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istiod-ca-cert\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.447982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.447962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-envoy\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.448301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.448282    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-podinfo\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.472193 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.472168    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-token\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.472672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.472648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnrr\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-kube-api-access-7qnrr\") pod \"e2e-derive-384b773a-openshift-default-b8f68f764-42kqh\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") " pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.477948 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.477925    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:06.484770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.484741    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:06.641926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.641897    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"]
Jul 28 14:31:06.643999 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:31:06.643967    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf74ea8a2_0e6b_41ec_87f7_31a20ebc01ed.slice/crio-2abaa6276f6ae599059d2df3ac5aa8fb62d594abe3522cb75362634bcc336782 WatchSource:0}: Error finding container 2abaa6276f6ae599059d2df3ac5aa8fb62d594abe3522cb75362634bcc336782: Status 404 returned error can't find the container with id 2abaa6276f6ae599059d2df3ac5aa8fb62d594abe3522cb75362634bcc336782
Jul 28 14:31:06.646055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.645996    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:31:06.646128 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.646098    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:31:06.646171 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:06.646129    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:31:07.086534 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:07.086501    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" event={"ID":"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed","Type":"ContainerStarted","Data":"e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"}
Jul 28 14:31:07.086715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:07.086554    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" event={"ID":"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed","Type":"ContainerStarted","Data":"2abaa6276f6ae599059d2df3ac5aa8fb62d594abe3522cb75362634bcc336782"}
Jul 28 14:31:07.121749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:07.121694    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podStartSLOduration=1.121676312 podStartE2EDuration="1.121676312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:31:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:31:07.11932969 +0000 UTC m=+1880.353849157" watchObservedRunningTime="2026-07-28 14:31:07.121676312 +0000 UTC m=+1880.356195784"
Jul 28 14:31:07.479048 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:07.478929    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:07.484318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:07.484291    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:08.092167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:08.092130    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:08.092981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:08.092956    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:08.646898 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:08.646861    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:08.903279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:08.903158    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:09.049882 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:09.049848    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:09.475620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:09.475583    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:10.461148 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.461116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:10.602715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.602664    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:10.603808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.603791    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:31:10.788061 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.787960    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-envoy\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788128    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-certs\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788156    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-credential-socket\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788186    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istiod-ca-cert\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788219    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-data\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788483 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788245    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-token\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788483 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788316    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrn44\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-kube-api-access-xrn44\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788483 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788365    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-podinfo\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788483 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788391    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-socket\") pod \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\" (UID: \"6c76bb27-84be-4b12-b532-c48d8a4a42e4\") "
Jul 28 14:31:10.788680 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788527    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:10.788680 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788546    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:10.789177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788771    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:10.789177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788788    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.789177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788826    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.789177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.788868    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:10.790649 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.790619    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:10.791309 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.791272    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-data" (OuterVolumeSpecName: "istio-data") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:10.791896 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.791860    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-kube-api-access-xrn44" (OuterVolumeSpecName: "kube-api-access-xrn44") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "kube-api-access-xrn44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:10.792086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.792053    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:31:10.792086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.792066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-token" (OuterVolumeSpecName: "istio-token") pod "6c76bb27-84be-4b12-b532-c48d8a4a42e4" (UID: "6c76bb27-84be-4b12-b532-c48d8a4a42e4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:10.890060 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890006    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.890060 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890049    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.890060 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890060    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrn44\" (UniqueName: \"kubernetes.io/projected/6c76bb27-84be-4b12-b532-c48d8a4a42e4-kube-api-access-xrn44\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.890060 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890071    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.890391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890082    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.890391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890096    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:10.890391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:10.890107    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6c76bb27-84be-4b12-b532-c48d8a4a42e4-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:11.108783 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.108681    2558 generic.go:356] "Generic (PLEG): container finished" podID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerID="b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748" exitCode=0
Jul 28 14:31:11.108783 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.108744    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"
Jul 28 14:31:11.108992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.108775    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" event={"ID":"6c76bb27-84be-4b12-b532-c48d8a4a42e4","Type":"ContainerDied","Data":"b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748"}
Jul 28 14:31:11.108992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.108854    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc" event={"ID":"6c76bb27-84be-4b12-b532-c48d8a4a42e4","Type":"ContainerDied","Data":"e1f8a04f634e3549f0a303db40ab02699d175c6f680e1fb8c30a6e0ad7d8b3c3"}
Jul 28 14:31:11.108992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.108877    2558 scope.go:117] "RemoveContainer" containerID="b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748"
Jul 28 14:31:11.118033 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.118003    2558 scope.go:117] "RemoveContainer" containerID="7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"
Jul 28 14:31:11.125799 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.125784    2558 scope.go:117] "RemoveContainer" containerID="b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748"
Jul 28 14:31:11.126012 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:31:11.125995    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748\": container with ID starting with b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748 not found: ID does not exist" containerID="b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748"
Jul 28 14:31:11.126086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.126036    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748"} err="failed to get container status \"b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748\": rpc error: code = NotFound desc = could not find container \"b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748\": container with ID starting with b0c1e61679df72b4e7af72afad52f547d865bab5dd445b09ac12ed02dccb2748 not found: ID does not exist"
Jul 28 14:31:11.126086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.126061    2558 scope.go:117] "RemoveContainer" containerID="7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"
Jul 28 14:31:11.126297 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:31:11.126283    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244\": container with ID starting with 7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244 not found: ID does not exist" containerID="7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"
Jul 28 14:31:11.126344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.126302    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244"} err="failed to get container status \"7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244\": rpc error: code = NotFound desc = could not find container \"7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244\": container with ID starting with 7c99aed0dd22f52eea7325b6b28349d0d9b873e3513379be27a9dc1bc7eee244 not found: ID does not exist"
Jul 28 14:31:11.147037 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.146989    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"]
Jul 28 14:31:11.155923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.155897    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0b8a5700-openshift-default-748b478574-nq9fc"]
Jul 28 14:31:11.284210 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:11.284173    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" path="/var/lib/kubelet/pods/6c76bb27-84be-4b12-b532-c48d8a4a42e4/volumes"
Jul 28 14:31:12.477990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:12.477953    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:22.167409 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:22.167373    2558 generic.go:356] "Generic (PLEG): container finished" podID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerID="e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89" exitCode=0
Jul 28 14:31:22.167833 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:22.167446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" event={"ID":"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed","Type":"ContainerDied","Data":"e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"}
Jul 28 14:31:22.167875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:22.167841    2558 scope.go:117] "RemoveContainer" containerID="e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"
Jul 28 14:31:22.168974 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:22.168940    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:31:22.169046 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:22.169028    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:31:22.169097 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:22.169061    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:31:23.093107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:23.093072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:23.174567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:23.174526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" event={"ID":"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed","Type":"ContainerStarted","Data":"76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6"}
Jul 28 14:31:23.478658 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:23.478543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:23.480105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:23.480068    2558 patch_prober.go:28] interesting pod/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 28 14:31:23.480260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:23.480134    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 28 14:31:24.478409 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:24.478361    2558 patch_prober.go:28] interesting pod/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 28 14:31:24.478942 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:24.478453    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 28 14:31:25.478527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:25.478475    2558 patch_prober.go:28] interesting pod/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 28 14:31:25.479088 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:25.478569    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 28 14:31:26.478590 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:26.478546    2558 patch_prober.go:28] interesting pod/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 28 14:31:26.479102 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:26.478611    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 28 14:31:27.479523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:27.479010    2558 patch_prober.go:28] interesting pod/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused" start-of-body=
Jul 28 14:31:27.479523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:27.479104    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": dial tcp 10.133.0.49:15021: connect: connection refused"
Jul 28 14:31:28.482657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:28.482622    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:28.483163 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:28.483138    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:28.483983 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:28.483964    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:33.424298 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424261    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"]
Jul 28 14:31:33.424693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424640    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy"
Jul 28 14:31:33.424693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424652    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy"
Jul 28 14:31:33.424693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424659    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy"
Jul 28 14:31:33.424693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424664    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy"
Jul 28 14:31:33.424827 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424738    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy"
Jul 28 14:31:33.424827 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.424748    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c76bb27-84be-4b12-b532-c48d8a4a42e4" containerName="istio-proxy"
Jul 28 14:31:33.426867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.426852    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:33.429714 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.429694    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:31:33.429714 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.429699    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:31:33.438732 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.438706    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"]
Jul 28 14:31:33.489781 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.489752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61691460-9969-413e-a184-6c97b79e373a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-384b773a-7bzf4\" (UID: \"61691460-9969-413e-a184-6c97b79e373a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:33.590712 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.590680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61691460-9969-413e-a184-6c97b79e373a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-384b773a-7bzf4\" (UID: \"61691460-9969-413e-a184-6c97b79e373a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:33.591375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.591352    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61691460-9969-413e-a184-6c97b79e373a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-384b773a-7bzf4\" (UID: \"61691460-9969-413e-a184-6c97b79e373a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:33.737559 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.737463    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:33.868969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:33.868946    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"]
Jul 28 14:31:33.871607 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:31:33.871577    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61691460_9969_413e_a184_6c97b79e373a.slice/crio-5f6618e09b97ad23c930f4cb785f99844f6657d27727c64e10ae88b51385c1d4 WatchSource:0}: Error finding container 5f6618e09b97ad23c930f4cb785f99844f6657d27727c64e10ae88b51385c1d4: Status 404 returned error can't find the container with id 5f6618e09b97ad23c930f4cb785f99844f6657d27727c64e10ae88b51385c1d4
Jul 28 14:31:34.244997 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:34.244957    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4" event={"ID":"61691460-9969-413e-a184-6c97b79e373a","Type":"ContainerStarted","Data":"0acb7105151f737dee49d8e9b77512fb100e36bde4710ab2db2212673c85bb53"}
Jul 28 14:31:34.245200 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:34.245035    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4" event={"ID":"61691460-9969-413e-a184-6c97b79e373a","Type":"ContainerStarted","Data":"5f6618e09b97ad23c930f4cb785f99844f6657d27727c64e10ae88b51385c1d4"}
Jul 28 14:31:34.265770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:34.265714    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4" podStartSLOduration=1.265699477 podStartE2EDuration="1.265699477s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:31:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:31:34.264215563 +0000 UTC m=+1907.498735035" watchObservedRunningTime="2026-07-28 14:31:34.265699477 +0000 UTC m=+1907.500218948"
Jul 28 14:31:35.252718 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:35.252687    2558 generic.go:356] "Generic (PLEG): container finished" podID="61691460-9969-413e-a184-6c97b79e373a" containerID="0acb7105151f737dee49d8e9b77512fb100e36bde4710ab2db2212673c85bb53" exitCode=0
Jul 28 14:31:35.253143 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:35.252750    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4" event={"ID":"61691460-9969-413e-a184-6c97b79e373a","Type":"ContainerDied","Data":"0acb7105151f737dee49d8e9b77512fb100e36bde4710ab2db2212673c85bb53"}
Jul 28 14:31:36.396539 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:36.396509    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:36.517095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:36.516989    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61691460-9969-413e-a184-6c97b79e373a-maas-api-service-ca\") pod \"61691460-9969-413e-a184-6c97b79e373a\" (UID: \"61691460-9969-413e-a184-6c97b79e373a\") "
Jul 28 14:31:36.517400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:36.517377    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61691460-9969-413e-a184-6c97b79e373a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "61691460-9969-413e-a184-6c97b79e373a" (UID: "61691460-9969-413e-a184-6c97b79e373a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:36.617961 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:36.617929    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/61691460-9969-413e-a184-6c97b79e373a-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:37.263925 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:37.263893    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"
Jul 28 14:31:37.264213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:37.263932    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4" event={"ID":"61691460-9969-413e-a184-6c97b79e373a","Type":"ContainerDied","Data":"5f6618e09b97ad23c930f4cb785f99844f6657d27727c64e10ae88b51385c1d4"}
Jul 28 14:31:37.264213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:37.263982    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5f6618e09b97ad23c930f4cb785f99844f6657d27727c64e10ae88b51385c1d4"
Jul 28 14:31:38.152858 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:38.152813    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"]
Jul 28 14:31:38.160950 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:38.160919    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-384b773a-7bzf4"]
Jul 28 14:31:38.307389 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:38.307358    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"]
Jul 28 14:31:38.307612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:38.307588    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" containerID="cri-o://76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6" gracePeriod=30
Jul 28 14:31:38.593753 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:38.593716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:38.679119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:38.679084    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:39.119327 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:39.119296    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:39.242715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:39.242680    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:39.282324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:39.282293    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61691460-9969-413e-a184-6c97b79e373a" path="/var/lib/kubelet/pods/61691460-9969-413e-a184-6c97b79e373a/volumes"
Jul 28 14:31:39.363675 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:39.363639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:40.888545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:40.888508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:43.559314 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.559288    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:43.694516 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694433    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-certs\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694516 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694479    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-socket\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694516 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694507    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-credential-socket\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694527    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-envoy\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694562    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istiod-ca-cert\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694601    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-data\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694634    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-token\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694658    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qnrr\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-kube-api-access-7qnrr\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694719    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-podinfo\") pod \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\" (UID: \"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed\") "
Jul 28 14:31:43.694815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694735    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694825    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.694843    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.695057    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.695170    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.695193    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.695210    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.695250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.695227    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.695756 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.695730    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-data" (OuterVolumeSpecName: "istio-data") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:43.696950 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.696922    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-token" (OuterVolumeSpecName: "istio-token") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:43.697090 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.697010    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:31:43.697338 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.697317    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:31:43.697419 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.697334    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-kube-api-access-7qnrr" (OuterVolumeSpecName: "kube-api-access-7qnrr") pod "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" (UID: "f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed"). InnerVolumeSpecName "kube-api-access-7qnrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:31:43.796012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.795971    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.796012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.796003    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.796012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.796014    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.796012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.796035    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qnrr\" (UniqueName: \"kubernetes.io/projected/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-kube-api-access-7qnrr\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:43.796012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:43.796045    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:31:44.302131 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.302094    2558 generic.go:356] "Generic (PLEG): container finished" podID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerID="76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6" exitCode=0
Jul 28 14:31:44.302314 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.302150    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"
Jul 28 14:31:44.302314 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.302183    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" event={"ID":"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed","Type":"ContainerDied","Data":"76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6"}
Jul 28 14:31:44.302314 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.302247    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" event={"ID":"f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed","Type":"ContainerDied","Data":"2abaa6276f6ae599059d2df3ac5aa8fb62d594abe3522cb75362634bcc336782"}
Jul 28 14:31:44.302314 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.302277    2558 scope.go:117] "RemoveContainer" containerID="76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6"
Jul 28 14:31:44.311791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.311773    2558 scope.go:117] "RemoveContainer" containerID="e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"
Jul 28 14:31:44.320045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.320005    2558 scope.go:117] "RemoveContainer" containerID="76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6"
Jul 28 14:31:44.320300 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:31:44.320280    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6\": container with ID starting with 76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6 not found: ID does not exist" containerID="76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6"
Jul 28 14:31:44.320352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.320310    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6"} err="failed to get container status \"76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6\": rpc error: code = NotFound desc = could not find container \"76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6\": container with ID starting with 76f6b49cfa2ef83f47a9c3b4d8463e69d3e0670cad0c3707dab6a0cc9caa76a6 not found: ID does not exist"
Jul 28 14:31:44.320352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.320326    2558 scope.go:117] "RemoveContainer" containerID="e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"
Jul 28 14:31:44.320527 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:31:44.320512    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89\": container with ID starting with e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89 not found: ID does not exist" containerID="e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"
Jul 28 14:31:44.320576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.320531    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89"} err="failed to get container status \"e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89\": rpc error: code = NotFound desc = could not find container \"e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89\": container with ID starting with e9e004e1ae82602d8be7c584d0098727111395a696d133a43e6903aa085a3f89 not found: ID does not exist"
Jul 28 14:31:44.336085 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.336060    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"]
Jul 28 14:31:44.348687 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.348662    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh"]
Jul 28 14:31:44.484377 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.484337    2558 patch_prober.go:28] interesting pod/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 14:31:44.484542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:44.484401    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-384b773a-openshift-default-b8f68f764-42kqh" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 14:31:45.282823 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:45.282792    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" path="/var/lib/kubelet/pods/f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed/volumes"
Jul 28 14:31:49.508238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:49.508197    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:49.612611 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:49.612577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:49.705142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:49.705104    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:49.805897 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:49.805820    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:31:50.348617 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:31:50.348579    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:16.391546 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:16.391508    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:23.603013 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:23.602971    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:23.674084 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:23.674047    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:23.775970 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:23.775938    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:23.880076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:23.879951    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:30.183635 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:30.183595    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:30.285334 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:30.285302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:39.844705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:39.844614    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:46.369740 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:46.369700    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:46.475926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:46.475878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:46.602876 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:46.602826    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:47.323119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:47.323082    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:57.224945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:57.224908    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:32:58.205366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:32:58.205324    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:06.077207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:06.077174    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:06.249141 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:06.249101    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:06.333489 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:06.333394    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:18.122498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:18.122456    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:18.220351 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:18.220321    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:18.323173 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:18.323139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:20.269401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:20.269365    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:27.261517 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:27.261475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:27.358803 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:27.358772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:27.992479 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:27.992437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:36.009337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.009302    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:36.093223 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.093191    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:36.249177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.249139    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:36.552159 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552125    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"]
Jul 28 14:33:36.552517 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552503    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy"
Jul 28 14:33:36.552567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552521    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy"
Jul 28 14:33:36.552567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552533    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy"
Jul 28 14:33:36.552567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552538    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy"
Jul 28 14:33:36.552567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552552    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61691460-9969-413e-a184-6c97b79e373a" containerName="revoke-keys"
Jul 28 14:33:36.552567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552558    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="61691460-9969-413e-a184-6c97b79e373a" containerName="revoke-keys"
Jul 28 14:33:36.552723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552621    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy"
Jul 28 14:33:36.552723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552633    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="f74ea8a2-0e6b-41ec-87f7-31a20ebc01ed" containerName="istio-proxy"
Jul 28 14:33:36.552723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.552640    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="61691460-9969-413e-a184-6c97b79e373a" containerName="revoke-keys"
Jul 28 14:33:36.555812 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.555789    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.558255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.558235    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-049328b0-openshift-default-dockercfg-tlhk5\""
Jul 28 14:33:36.580612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.580583    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"]
Jul 28 14:33:36.597797 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.597768    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:36.638037 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.637998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-data\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638179 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638069    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-podinfo\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638179 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istiod-ca-cert\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638179 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-socket\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638182    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-credential-socket\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-certs\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638240    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-envoy\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638263    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9cq5\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-kube-api-access-p9cq5\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.638359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.638297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-token\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739570 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-podinfo\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739583    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istiod-ca-cert\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739607    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-socket\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739640    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-credential-socket\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739660    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-certs\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739734 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739687    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-envoy\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739763    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9cq5\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-kube-api-access-p9cq5\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-token\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.739990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.739850    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-data\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.740197 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.740119    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-certs\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.740256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.740189    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-credential-socket\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.740310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.740263    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-socket\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.740365 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.740307    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-data\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.740446 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.740422    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istiod-ca-cert\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.742082 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.742057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-envoy\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.742229 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.742208    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-podinfo\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.751214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.751191    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-token\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.753158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.753133    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9cq5\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-kube-api-access-p9cq5\") pod \"e2e-mt-049328b0-openshift-default-848fbff688-rzq7s\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") " pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.866401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.866311    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:36.921702 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:36.921569    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:37.009203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.009179    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"]
Jul 28 14:33:37.010864 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:33:37.010837    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24736c6b_ec30_465b_b43e_0f6c4a4965a9.slice/crio-fb5777b4ee98aae5ea18006cf9b071712cf2c72b3bae5f9e15db1e1d7143a27c WatchSource:0}: Error finding container fb5777b4ee98aae5ea18006cf9b071712cf2c72b3bae5f9e15db1e1d7143a27c: Status 404 returned error can't find the container with id fb5777b4ee98aae5ea18006cf9b071712cf2c72b3bae5f9e15db1e1d7143a27c
Jul 28 14:33:37.012909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.012878    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:33:37.013009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.012940    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:33:37.013009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.012970    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:33:37.868612 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.868574    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" event={"ID":"24736c6b-ec30-465b-b43e-0f6c4a4965a9","Type":"ContainerStarted","Data":"0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"}
Jul 28 14:33:37.868813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.868628    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" event={"ID":"24736c6b-ec30-465b-b43e-0f6c4a4965a9","Type":"ContainerStarted","Data":"fb5777b4ee98aae5ea18006cf9b071712cf2c72b3bae5f9e15db1e1d7143a27c"}
Jul 28 14:33:37.897973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:37.897921    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" podStartSLOduration=1.897904149 podStartE2EDuration="1.897904149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:33:37.896178934 +0000 UTC m=+2031.130698407" watchObservedRunningTime="2026-07-28 14:33:37.897904149 +0000 UTC m=+2031.132423621"
Jul 28 14:33:38.867536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:38.867490    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:38.872843 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:38.872813    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:38.874570 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:38.874550    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:38.875527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:38.875501    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:39.895200 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:39.895165    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:39.995125 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:39.995095    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:40.065804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:40.065771    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:40.793591 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:40.793554    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:40.893569 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:40.893526    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:40.983930 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:40.983878    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:33:41.075513 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.075425    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"]
Jul 28 14:33:41.079162 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.079127    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.082183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.082154    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-049328b0-dockercfg-rpmd9\""
Jul 28 14:33:41.082303 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.082194    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-049328b0\""
Jul 28 14:33:41.089527 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.089503    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"]
Jul 28 14:33:41.185126 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.185076    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lbqh\" (UniqueName: \"kubernetes.io/projected/a936e05f-1064-40a4-9401-050283783a21-kube-api-access-7lbqh\") pod \"payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") " pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.185415 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.185279    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a936e05f-1064-40a4-9401-050283783a21-plugins-config-volume\") pod \"payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") " pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.286293 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.286259    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a936e05f-1064-40a4-9401-050283783a21-plugins-config-volume\") pod \"payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") " pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.286470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.286304    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lbqh\" (UniqueName: \"kubernetes.io/projected/a936e05f-1064-40a4-9401-050283783a21-kube-api-access-7lbqh\") pod \"payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") " pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.286927 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.286904    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a936e05f-1064-40a4-9401-050283783a21-plugins-config-volume\") pod \"payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") " pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.295581 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.295553    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lbqh\" (UniqueName: \"kubernetes.io/projected/a936e05f-1064-40a4-9401-050283783a21-kube-api-access-7lbqh\") pod \"payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") " pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.391344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.391241    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:41.539067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.539043    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"]
Jul 28 14:33:41.541075 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:33:41.541040    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda936e05f_1064_40a4_9401_050283783a21.slice/crio-bd3d8fb7ad25a8f6b1af4adb4e775858494f2c8f8cb38adac0448b91d016537a WatchSource:0}: Error finding container bd3d8fb7ad25a8f6b1af4adb4e775858494f2c8f8cb38adac0448b91d016537a: Status 404 returned error can't find the container with id bd3d8fb7ad25a8f6b1af4adb4e775858494f2c8f8cb38adac0448b91d016537a
Jul 28 14:33:41.543302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.543281    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 14:33:41.891724 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:41.891686    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb" event={"ID":"a936e05f-1064-40a4-9401-050283783a21","Type":"ContainerStarted","Data":"bd3d8fb7ad25a8f6b1af4adb4e775858494f2c8f8cb38adac0448b91d016537a"}
Jul 28 14:33:43.905455 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:43.905414    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb" event={"ID":"a936e05f-1064-40a4-9401-050283783a21","Type":"ContainerStarted","Data":"ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec"}
Jul 28 14:33:43.905954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:43.905508    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:43.925740 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:43.925690    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb" podStartSLOduration=1.289671056 podStartE2EDuration="2.925673457s" totalImagesPullingTime="1.636002401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:33:43.923679677 +0000 UTC m=+2037.158199152" watchObservedRunningTime="2026-07-28 14:33:43.925673457 +0000 UTC m=+2037.160192928"
Jul 28 14:33:51.947477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:51.947439    2558 generic.go:356] "Generic (PLEG): container finished" podID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerID="0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b" exitCode=0
Jul 28 14:33:51.947477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:51.947485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" event={"ID":"24736c6b-ec30-465b-b43e-0f6c4a4965a9","Type":"ContainerDied","Data":"0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"}
Jul 28 14:33:51.947965 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:51.947889    2558 scope.go:117] "RemoveContainer" containerID="0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"
Jul 28 14:33:51.948928 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:51.948896    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:33:51.949044 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:51.948981    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:33:51.949128 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:51.949056    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:33:52.954804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:52.954769    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" event={"ID":"24736c6b-ec30-465b-b43e-0f6c4a4965a9","Type":"ContainerStarted","Data":"180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7"}
Jul 28 14:33:53.867158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:53.867109    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:53.868384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:53.868353    2558 patch_prober.go:28] interesting pod/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 28 14:33:53.868530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:53.868412    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 28 14:33:53.874913 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:53.874876    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:54.866996 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:54.866960    2558 patch_prober.go:28] interesting pod/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 28 14:33:54.867436 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:54.867057    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 28 14:33:54.912854 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:54.912825    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:33:55.867232 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:55.867195    2558 patch_prober.go:28] interesting pod/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Jul 28 14:33:55.867632 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:55.867250    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Jul 28 14:33:56.871064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:56.871009    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:33:56.872090 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:33:56.872063    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:34:05.129056 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:05.128982    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:06.319378 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:06.319346    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:07.094812 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:07.094781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:12.919234 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:12.919135    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:13.019540 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.019502    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:13.661140 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.661099    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"]
Jul 28 14:34:13.665350 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.665327    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:13.668119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.668096    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:34:13.668216 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.668180    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:34:13.672639 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.672617    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"]
Jul 28 14:34:13.791686 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.791650    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c0f5fba-f663-454d-99cb-481829510884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-049328b0-q75nb\" (UID: \"2c0f5fba-f663-454d-99cb-481829510884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:13.892814 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.892770    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c0f5fba-f663-454d-99cb-481829510884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-049328b0-q75nb\" (UID: \"2c0f5fba-f663-454d-99cb-481829510884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:13.893430 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.893410    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c0f5fba-f663-454d-99cb-481829510884-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-049328b0-q75nb\" (UID: \"2c0f5fba-f663-454d-99cb-481829510884\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:13.976772 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:13.976686    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:14.317401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:14.317372    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"]
Jul 28 14:34:14.319355 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:34:14.319327    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0f5fba_f663_454d_99cb_481829510884.slice/crio-fbed56db0768d9669b262e0a22f26b2dde4f68175d940e80cbb21063b9288d51 WatchSource:0}: Error finding container fbed56db0768d9669b262e0a22f26b2dde4f68175d940e80cbb21063b9288d51: Status 404 returned error can't find the container with id fbed56db0768d9669b262e0a22f26b2dde4f68175d940e80cbb21063b9288d51
Jul 28 14:34:15.071848 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:15.071816    2558 generic.go:356] "Generic (PLEG): container finished" podID="2c0f5fba-f663-454d-99cb-481829510884" containerID="e06adc8cedd5c225a10af20784af2afb8a4b8b0dbe9bad05ec6e1a1bf0f8e13c" exitCode=0
Jul 28 14:34:15.072207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:15.071865    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb" event={"ID":"2c0f5fba-f663-454d-99cb-481829510884","Type":"ContainerDied","Data":"e06adc8cedd5c225a10af20784af2afb8a4b8b0dbe9bad05ec6e1a1bf0f8e13c"}
Jul 28 14:34:15.072207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:15.071925    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb" event={"ID":"2c0f5fba-f663-454d-99cb-481829510884","Type":"ContainerStarted","Data":"fbed56db0768d9669b262e0a22f26b2dde4f68175d940e80cbb21063b9288d51"}
Jul 28 14:34:16.214119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:16.214092    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:16.318754 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:16.318725    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c0f5fba-f663-454d-99cb-481829510884-maas-api-service-ca\") pod \"2c0f5fba-f663-454d-99cb-481829510884\" (UID: \"2c0f5fba-f663-454d-99cb-481829510884\") "
Jul 28 14:34:16.319085 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:16.319058    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c0f5fba-f663-454d-99cb-481829510884-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2c0f5fba-f663-454d-99cb-481829510884" (UID: "2c0f5fba-f663-454d-99cb-481829510884"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:34:16.419931 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:16.419851    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c0f5fba-f663-454d-99cb-481829510884-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:17.083975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:17.083942    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb" event={"ID":"2c0f5fba-f663-454d-99cb-481829510884","Type":"ContainerDied","Data":"fbed56db0768d9669b262e0a22f26b2dde4f68175d940e80cbb21063b9288d51"}
Jul 28 14:34:17.083975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:17.083970    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"
Jul 28 14:34:17.084214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:17.083993    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fbed56db0768d9669b262e0a22f26b2dde4f68175d940e80cbb21063b9288d51"
Jul 28 14:34:24.337667 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.337622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:24.371097 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.371059    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"]
Jul 28 14:34:24.371281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.371260    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb" podUID="a936e05f-1064-40a4-9401-050283783a21" containerName="payload-processing" containerID="cri-o://ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec" gracePeriod=30
Jul 28 14:34:24.435100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.435062    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:24.537926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.537882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:24.585254 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.585208    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"]
Jul 28 14:34:24.589500 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.589420    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-049328b0-q75nb"]
Jul 28 14:34:24.614589 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.614557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:24.634392 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.634367    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:34:24.798754 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.798718    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a936e05f-1064-40a4-9401-050283783a21-plugins-config-volume\") pod \"a936e05f-1064-40a4-9401-050283783a21\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") "
Jul 28 14:34:24.798944 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.798858    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7lbqh\" (UniqueName: \"kubernetes.io/projected/a936e05f-1064-40a4-9401-050283783a21-kube-api-access-7lbqh\") pod \"a936e05f-1064-40a4-9401-050283783a21\" (UID: \"a936e05f-1064-40a4-9401-050283783a21\") "
Jul 28 14:34:24.799135 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.799111    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a936e05f-1064-40a4-9401-050283783a21-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a936e05f-1064-40a4-9401-050283783a21" (UID: "a936e05f-1064-40a4-9401-050283783a21"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:34:24.800802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.800780    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a936e05f-1064-40a4-9401-050283783a21-kube-api-access-7lbqh" (OuterVolumeSpecName: "kube-api-access-7lbqh") pod "a936e05f-1064-40a4-9401-050283783a21" (UID: "a936e05f-1064-40a4-9401-050283783a21"). InnerVolumeSpecName "kube-api-access-7lbqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:34:24.899897 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.899818    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7lbqh\" (UniqueName: \"kubernetes.io/projected/a936e05f-1064-40a4-9401-050283783a21-kube-api-access-7lbqh\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:24.899897 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.899844    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a936e05f-1064-40a4-9401-050283783a21-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:24.973660 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:24.973589    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:25.126303 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.126268    2558 generic.go:356] "Generic (PLEG): container finished" podID="a936e05f-1064-40a4-9401-050283783a21" containerID="ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec" exitCode=0
Jul 28 14:34:25.126487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.126319    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"
Jul 28 14:34:25.126487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.126344    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb" event={"ID":"a936e05f-1064-40a4-9401-050283783a21","Type":"ContainerDied","Data":"ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec"}
Jul 28 14:34:25.126487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.126396    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb" event={"ID":"a936e05f-1064-40a4-9401-050283783a21","Type":"ContainerDied","Data":"bd3d8fb7ad25a8f6b1af4adb4e775858494f2c8f8cb38adac0448b91d016537a"}
Jul 28 14:34:25.126487 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.126426    2558 scope.go:117] "RemoveContainer" containerID="ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec"
Jul 28 14:34:25.135356 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.135335    2558 scope.go:117] "RemoveContainer" containerID="ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec"
Jul 28 14:34:25.135648 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:34:25.135626    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec\": container with ID starting with ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec not found: ID does not exist" containerID="ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec"
Jul 28 14:34:25.135725 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.135656    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec"} err="failed to get container status \"ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec\": rpc error: code = NotFound desc = could not find container \"ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec\": container with ID starting with ea73dbf3a21e43fd2e5070efb460fae2512ac3b2e3fea08c6bc7a33bdc2044ec not found: ID does not exist"
Jul 28 14:34:25.150492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.150415    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"]
Jul 28 14:34:25.155450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.155422    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-049328b0-dc9c88bf8-kq2wb"]
Jul 28 14:34:25.282761 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.282717    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c0f5fba-f663-454d-99cb-481829510884" path="/var/lib/kubelet/pods/2c0f5fba-f663-454d-99cb-481829510884/volumes"
Jul 28 14:34:25.283230 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:25.283208    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a936e05f-1064-40a4-9401-050283783a21" path="/var/lib/kubelet/pods/a936e05f-1064-40a4-9401-050283783a21/volumes"
Jul 28 14:34:31.439693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:31.439639    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:31.504302 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:31.504264    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:31.614095 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:31.614059    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"]
Jul 28 14:34:31.614294 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:31.614267    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy" containerID="cri-o://180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7" gracePeriod=30
Jul 28 14:34:32.272588 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:32.272541    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:32.373795 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:32.373754    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:34.000981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:34.000944    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:36.874459 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.874432    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:34:36.917828 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.917752    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-data\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.917828 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.917803    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-token\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.917860    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-socket\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.917902    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9cq5\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-kube-api-access-p9cq5\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.917932    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-envoy\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.917973    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-podinfo\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918056    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istiod-ca-cert\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918089    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-certs\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918199    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:34:36.918391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918214    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-credential-socket\") pod \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\" (UID: \"24736c6b-ec30-465b-b43e-0f6c4a4965a9\") "
Jul 28 14:34:36.918543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918524    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:36.918543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918520    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:34:36.918665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918630    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:34:36.918782 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918747    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-data" (OuterVolumeSpecName: "istio-data") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:34:36.918782 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.918761    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:34:36.920526 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.920502    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-token" (OuterVolumeSpecName: "istio-token") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:34:36.920610 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.920557    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:34:36.920823 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.920801    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-kube-api-access-p9cq5" (OuterVolumeSpecName: "kube-api-access-p9cq5") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "kube-api-access-p9cq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:34:36.920899 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:36.920847    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "24736c6b-ec30-465b-b43e-0f6c4a4965a9" (UID: "24736c6b-ec30-465b-b43e-0f6c4a4965a9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:34:37.019391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019352    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9cq5\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-kube-api-access-p9cq5\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019388    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019391 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019400    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019411    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019423    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019435    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019447    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.019653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.019458    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24736c6b-ec30-465b-b43e-0f6c4a4965a9-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:34:37.193124 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.193041    2558 generic.go:356] "Generic (PLEG): container finished" podID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerID="180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7" exitCode=0
Jul 28 14:34:37.193124 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.193085    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"
Jul 28 14:34:37.193124 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.193095    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" event={"ID":"24736c6b-ec30-465b-b43e-0f6c4a4965a9","Type":"ContainerDied","Data":"180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7"}
Jul 28 14:34:37.193373 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.193138    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s" event={"ID":"24736c6b-ec30-465b-b43e-0f6c4a4965a9","Type":"ContainerDied","Data":"fb5777b4ee98aae5ea18006cf9b071712cf2c72b3bae5f9e15db1e1d7143a27c"}
Jul 28 14:34:37.193373 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.193159    2558 scope.go:117] "RemoveContainer" containerID="180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7"
Jul 28 14:34:37.202402 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.202387    2558 scope.go:117] "RemoveContainer" containerID="0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"
Jul 28 14:34:37.210105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.210082    2558 scope.go:117] "RemoveContainer" containerID="180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7"
Jul 28 14:34:37.210368 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:34:37.210346    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7\": container with ID starting with 180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7 not found: ID does not exist" containerID="180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7"
Jul 28 14:34:37.210467 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.210380    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7"} err="failed to get container status \"180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7\": rpc error: code = NotFound desc = could not find container \"180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7\": container with ID starting with 180096df3be0012f75f5b3d5ef8d3aa25a4ae0dfb8d4fe646999b184f7fe32a7 not found: ID does not exist"
Jul 28 14:34:37.210467 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.210407    2558 scope.go:117] "RemoveContainer" containerID="0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"
Jul 28 14:34:37.210656 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:34:37.210639    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b\": container with ID starting with 0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b not found: ID does not exist" containerID="0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"
Jul 28 14:34:37.210694 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.210663    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b"} err="failed to get container status \"0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b\": rpc error: code = NotFound desc = could not find container \"0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b\": container with ID starting with 0b78a10d4d787ec44e9e2fe3583b50316ed7d648b55f5ccc7c5e91eb026b034b not found: ID does not exist"
Jul 28 14:34:37.215616 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.215595    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"]
Jul 28 14:34:37.220753 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.220729    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-049328b0-openshift-default-848fbff688-rzq7s"]
Jul 28 14:34:37.283212 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:37.283173    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" path="/var/lib/kubelet/pods/24736c6b-ec30-465b-b43e-0f6c4a4965a9/volumes"
Jul 28 14:34:38.515806 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:38.515756    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:38.620432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:38.620399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:38.715848 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:38.715800    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:38.891218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:38.891108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:44.946968 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:44.946927    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:46.146116 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:46.146080    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:46.246503 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:46.246469    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:47.307975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:47.307943    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:34:47.311405 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:47.311383    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:34:52.212159 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.212123    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:52.528977 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.528941    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"]
Jul 28 14:34:52.529364 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529351    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c0f5fba-f663-454d-99cb-481829510884" containerName="revoke-keys"
Jul 28 14:34:52.529410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529367    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c0f5fba-f663-454d-99cb-481829510884" containerName="revoke-keys"
Jul 28 14:34:52.529410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529382    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy"
Jul 28 14:34:52.529410 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529394    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy"
Jul 28 14:34:52.529515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529412    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a936e05f-1064-40a4-9401-050283783a21" containerName="payload-processing"
Jul 28 14:34:52.529515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529417    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="a936e05f-1064-40a4-9401-050283783a21" containerName="payload-processing"
Jul 28 14:34:52.529515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529486    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c0f5fba-f663-454d-99cb-481829510884" containerName="revoke-keys"
Jul 28 14:34:52.529515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529495    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy"
Jul 28 14:34:52.529515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.529503    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="a936e05f-1064-40a4-9401-050283783a21" containerName="payload-processing"
Jul 28 14:34:52.532571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.532548    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.534971 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.534948    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f2131889-openshift-default-dockercfg-9xd58\""
Jul 28 14:34:52.550176 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.545728    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"]
Jul 28 14:34:52.550176 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.549587    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:52.676774 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.676737    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-certs\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.676943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.676792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sbb2\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-kube-api-access-5sbb2\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.676943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.676828    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-socket\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.676943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.676903    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-credential-socket\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.677081 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.677001    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istiod-ca-cert\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.677123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.677090    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-token\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.677167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.677127    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-podinfo\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.677203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.677176    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-data\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.677245 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.677208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-envoy\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.777848 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.777807    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sbb2\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-kube-api-access-5sbb2\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.777859    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-socket\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.777888    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-credential-socket\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.777934    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istiod-ca-cert\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.777964    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-token\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.777993    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-podinfo\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778057    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-data\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-envoy\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-certs\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778317    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-socket\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778570 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-certs\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778649    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-credential-socket\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778800 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778771    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-data\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.778923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.778886    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istiod-ca-cert\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.780844 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.780773    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-envoy\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.780844 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.780782    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-podinfo\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.786756 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.786733    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-token\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.787175 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.787150    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sbb2\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-kube-api-access-5sbb2\") pod \"e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") " pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.843912 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.843880    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:52.911396 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.911359    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:52.997437 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:52.997409    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"]
Jul 28 14:34:52.999510 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:34:52.999483    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbec6e7_6629_4ebc_8f69_d7a0e39ef0db.slice/crio-f60770983ed7eda824a819fd6974615373ba764227cf0c6ca47174a16801b347 WatchSource:0}: Error finding container f60770983ed7eda824a819fd6974615373ba764227cf0c6ca47174a16801b347: Status 404 returned error can't find the container with id f60770983ed7eda824a819fd6974615373ba764227cf0c6ca47174a16801b347
Jul 28 14:34:53.001723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.001690    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:34:53.001826 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.001783    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:34:53.001889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.001827    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:34:53.274938 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.274896    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" event={"ID":"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db","Type":"ContainerStarted","Data":"dbd91c5eb3aca54400b819497192c2b8b2338ce22c97fac27113a5bfe70ec286"}
Jul 28 14:34:53.275437 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.274959    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" event={"ID":"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db","Type":"ContainerStarted","Data":"f60770983ed7eda824a819fd6974615373ba764227cf0c6ca47174a16801b347"}
Jul 28 14:34:53.296769 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.296667    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" podStartSLOduration=1.296644623 podStartE2EDuration="1.296644623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:34:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:34:53.295374156 +0000 UTC m=+2106.529893629" watchObservedRunningTime="2026-07-28 14:34:53.296644623 +0000 UTC m=+2106.531164096"
Jul 28 14:34:53.844577 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:53.844537    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:54.849809 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:54.849777    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:55.285044 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:55.284996    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:55.286008 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:55.285985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:34:55.425616 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:55.425586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:55.526058 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:55.526002    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:56.358192 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.358155    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"]
Jul 28 14:34:56.358589 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.358523    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy"
Jul 28 14:34:56.358589 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.358535    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy"
Jul 28 14:34:56.358667 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.358628    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="24736c6b-ec30-465b-b43e-0f6c4a4965a9" containerName="istio-proxy"
Jul 28 14:34:56.361624 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.361607    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.364093 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.364071    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-f2131889-dockercfg-ctn8j\""
Jul 28 14:34:56.364223 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.364092    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-f2131889\""
Jul 28 14:34:56.378752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.378723    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"]
Jul 28 14:34:56.414900 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.414863    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"]
Jul 28 14:34:56.418682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.418660    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.428067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.428038    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"]
Jul 28 14:34:56.512042 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.511980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wlbw\" (UniqueName: \"kubernetes.io/projected/0cd49b92-6b68-4878-93ca-4bfdf98266fc-kube-api-access-6wlbw\") pod \"payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.512235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.512081    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2131889-6977678766-k2j96\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") " pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.512235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.512103    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22cw6\" (UniqueName: \"kubernetes.io/projected/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-kube-api-access-22cw6\") pod \"payload-processing-e2e-mt-f2131889-6977678766-k2j96\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") " pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.512235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.512181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd49b92-6b68-4878-93ca-4bfdf98266fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.613244 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.613164    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2131889-6977678766-k2j96\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") " pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.613244 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.613197    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22cw6\" (UniqueName: \"kubernetes.io/projected/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-kube-api-access-22cw6\") pod \"payload-processing-e2e-mt-f2131889-6977678766-k2j96\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") " pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.613244 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.613225    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd49b92-6b68-4878-93ca-4bfdf98266fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.613475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.613298    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wlbw\" (UniqueName: \"kubernetes.io/projected/0cd49b92-6b68-4878-93ca-4bfdf98266fc-kube-api-access-6wlbw\") pod \"payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.614099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.614076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-plugins-config-volume\") pod \"payload-processing-e2e-mt-f2131889-6977678766-k2j96\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") " pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.614144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.614076    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd49b92-6b68-4878-93ca-4bfdf98266fc-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.622949 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.622917    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22cw6\" (UniqueName: \"kubernetes.io/projected/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-kube-api-access-22cw6\") pod \"payload-processing-e2e-mt-f2131889-6977678766-k2j96\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") " pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.622949 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.622944    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wlbw\" (UniqueName: \"kubernetes.io/projected/0cd49b92-6b68-4878-93ca-4bfdf98266fc-kube-api-access-6wlbw\") pod \"payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.672653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.672621    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:56.750195 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.750169    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:56.818337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.818306    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"]
Jul 28 14:34:56.820811 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:34:56.820783    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06397f1a_bd39_42b6_a9e6_3aaa114b2eaa.slice/crio-be70e04387bfe1b20588e818c32cbadc204b34d5355b3bdb1396f184a9061779 WatchSource:0}: Error finding container be70e04387bfe1b20588e818c32cbadc204b34d5355b3bdb1396f184a9061779: Status 404 returned error can't find the container with id be70e04387bfe1b20588e818c32cbadc204b34d5355b3bdb1396f184a9061779
Jul 28 14:34:56.897668 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.897641    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"]
Jul 28 14:34:56.899276 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:34:56.899250    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd49b92_6b68_4878_93ca_4bfdf98266fc.slice/crio-5a28345085b826ea148ed741f98822597159d4b06fe868baefcefe88e867a68a WatchSource:0}: Error finding container 5a28345085b826ea148ed741f98822597159d4b06fe868baefcefe88e867a68a: Status 404 returned error can't find the container with id 5a28345085b826ea148ed741f98822597159d4b06fe868baefcefe88e867a68a
Jul 28 14:34:56.919951 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:56.919924    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:57.019896 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.019859    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:34:57.299096 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.299042    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t" event={"ID":"0cd49b92-6b68-4878-93ca-4bfdf98266fc","Type":"ContainerStarted","Data":"e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00"}
Jul 28 14:34:57.299299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.299121    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t" event={"ID":"0cd49b92-6b68-4878-93ca-4bfdf98266fc","Type":"ContainerStarted","Data":"5a28345085b826ea148ed741f98822597159d4b06fe868baefcefe88e867a68a"}
Jul 28 14:34:57.299299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.299159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:34:57.300633 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.300604    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96" event={"ID":"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa","Type":"ContainerStarted","Data":"8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be"}
Jul 28 14:34:57.300757 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.300654    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96" event={"ID":"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa","Type":"ContainerStarted","Data":"be70e04387bfe1b20588e818c32cbadc204b34d5355b3bdb1396f184a9061779"}
Jul 28 14:34:57.300840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.300819    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:34:57.322957 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.322875    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t" podStartSLOduration=1.322845203 podStartE2EDuration="1.322845203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:34:57.320360216 +0000 UTC m=+2110.554879694" watchObservedRunningTime="2026-07-28 14:34:57.322845203 +0000 UTC m=+2110.557364676"
Jul 28 14:34:57.344728 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:34:57.344673    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96" podStartSLOduration=1.344658362 podStartE2EDuration="1.344658362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:34:57.34296616 +0000 UTC m=+2110.577485635" watchObservedRunningTime="2026-07-28 14:34:57.344658362 +0000 UTC m=+2110.579177834"
Jul 28 14:35:02.793201 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:02.793157    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:35:08.308227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:08.308195    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:35:08.308750 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:08.308370    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:35:09.377222 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:09.377190    2558 generic.go:356] "Generic (PLEG): container finished" podID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerID="dbd91c5eb3aca54400b819497192c2b8b2338ce22c97fac27113a5bfe70ec286" exitCode=0
Jul 28 14:35:09.377656 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:09.377272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" event={"ID":"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db","Type":"ContainerDied","Data":"dbd91c5eb3aca54400b819497192c2b8b2338ce22c97fac27113a5bfe70ec286"}
Jul 28 14:35:09.377796 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:09.377780    2558 scope.go:117] "RemoveContainer" containerID="dbd91c5eb3aca54400b819497192c2b8b2338ce22c97fac27113a5bfe70ec286"
Jul 28 14:35:09.379010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:09.378981    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:35:09.379119 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:09.379102    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:35:09.379169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:09.379142    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:35:10.285480 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:10.285437    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:35:10.388435 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:10.388399    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" event={"ID":"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db","Type":"ContainerStarted","Data":"10b18d3b339e0bd6ed0abeea4d8bf6e19e1bcb7db45ec40630b35751f0ab230a"}
Jul 28 14:35:10.844840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:10.844804    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:35:10.846167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:10.846139    2558 patch_prober.go:28] interesting pod/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 14:35:10.846287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:10.846221    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 14:35:11.844857 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:11.844819    2558 patch_prober.go:28] interesting pod/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 14:35:11.845276 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:11.844892    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 14:35:12.844587 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:12.844547    2558 patch_prober.go:28] interesting pod/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 14:35:12.844773 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:12.844603    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 14:35:13.844925 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:13.844888    2558 patch_prober.go:28] interesting pod/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Jul 28 14:35:13.845359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:13.844949    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Jul 28 14:35:14.848190 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:14.848159    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:35:14.848600 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:14.848410    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:35:14.849050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:14.849013    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:35:25.660414 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:25.660377    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:35:36.536142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.536106    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"]
Jul 28 14:35:36.539613 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.539594    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.543556 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.543529    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f2131889\"/\"default-dockercfg-xs842\""
Jul 28 14:35:36.543556 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.543532    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-f2131889\"/\"e2e-lifecycle-model-f2131889-kserve-self-signed-certs\""
Jul 28 14:35:36.543763 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.543514    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f2131889\"/\"kube-root-ca.crt\""
Jul 28 14:35:36.543763 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.543531    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-f2131889\"/\"openshift-service-ca.crt\""
Jul 28 14:35:36.549655 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.549630    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"]
Jul 28 14:35:36.563155 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.563108    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:35:36.598451 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.598413    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-tmp-dir\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.598585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.598472    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dfca81-edef-4782-a518-8d7b1661e4ed-tls-certs\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.598585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.598556    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-home\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.598678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.598607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-model-cache\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.598678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.598673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-dshm\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.598761 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.598710    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9sxf\" (UniqueName: \"kubernetes.io/projected/67dfca81-edef-4782-a518-8d7b1661e4ed-kube-api-access-p9sxf\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.699496 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699443    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-tmp-dir\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.699700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dfca81-edef-4782-a518-8d7b1661e4ed-tls-certs\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.699700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699573    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-home\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.699700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699610    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-model-cache\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.699700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699659    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-dshm\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.699700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699694    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9sxf\" (UniqueName: \"kubernetes.io/projected/67dfca81-edef-4782-a518-8d7b1661e4ed-kube-api-access-p9sxf\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.700005 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.699896    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-tmp-dir\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.700229 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.700206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-home\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.700357 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.700333    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-model-cache\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.702578 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.702546    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-dshm\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.702739 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.702719    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dfca81-edef-4782-a518-8d7b1661e4ed-tls-certs\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.708406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.708371    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9sxf\" (UniqueName: \"kubernetes.io/projected/67dfca81-edef-4782-a518-8d7b1661e4ed-kube-api-access-p9sxf\") pod \"e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") " pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.855727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.855627    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:36.988627 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:36.988592    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"]
Jul 28 14:35:36.990699 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:35:36.990669    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod67dfca81_edef_4782_a518_8d7b1661e4ed.slice/crio-1d3692a642214c323769a6910d20a875a698cbc90202d4d44e951aaecddb5a88 WatchSource:0}: Error finding container 1d3692a642214c323769a6910d20a875a698cbc90202d4d44e951aaecddb5a88: Status 404 returned error can't find the container with id 1d3692a642214c323769a6910d20a875a698cbc90202d4d44e951aaecddb5a88
Jul 28 14:35:37.534858 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:37.534822    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd" event={"ID":"67dfca81-edef-4782-a518-8d7b1661e4ed","Type":"ContainerStarted","Data":"540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920"}
Jul 28 14:35:37.534858 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:37.534861    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd" event={"ID":"67dfca81-edef-4782-a518-8d7b1661e4ed","Type":"ContainerStarted","Data":"1d3692a642214c323769a6910d20a875a698cbc90202d4d44e951aaecddb5a88"}
Jul 28 14:35:37.555507 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:37.555453    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd" podStartSLOduration=1.5554379109999998 podStartE2EDuration="1.555437911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:35:37.553493216 +0000 UTC m=+2150.788012689" watchObservedRunningTime="2026-07-28 14:35:37.555437911 +0000 UTC m=+2150.789957382"
Jul 28 14:35:46.856637 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:46.856531    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:46.856637 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:46.856590    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:46.869129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:46.869103    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:35:47.602497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:35:47.602468    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:36:20.829802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.829763    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:36:20.866136 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.866099    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"]
Jul 28 14:36:20.866365 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.866322    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96" podUID="06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" containerName="payload-processing" containerID="cri-o://8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be" gracePeriod=30
Jul 28 14:36:20.876427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.875627    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"]
Jul 28 14:36:20.876427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.875849    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t" podUID="0cd49b92-6b68-4878-93ca-4bfdf98266fc" containerName="payload-pre-processing" containerID="cri-o://e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00" gracePeriod=30
Jul 28 14:36:20.907889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.907864    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:36:20.961034 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:20.960999    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:36:21.029940 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.029909    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:36:21.167445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.167425    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:36:21.170299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.170280    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:36:21.330378 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.330346    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wlbw\" (UniqueName: \"kubernetes.io/projected/0cd49b92-6b68-4878-93ca-4bfdf98266fc-kube-api-access-6wlbw\") pod \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") "
Jul 28 14:36:21.330564 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.330408    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22cw6\" (UniqueName: \"kubernetes.io/projected/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-kube-api-access-22cw6\") pod \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") "
Jul 28 14:36:21.330564 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.330450    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd49b92-6b68-4878-93ca-4bfdf98266fc-plugins-config-volume\") pod \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\" (UID: \"0cd49b92-6b68-4878-93ca-4bfdf98266fc\") "
Jul 28 14:36:21.330564 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.330470    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-plugins-config-volume\") pod \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\" (UID: \"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa\") "
Jul 28 14:36:21.330824 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.330797    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cd49b92-6b68-4878-93ca-4bfdf98266fc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0cd49b92-6b68-4878-93ca-4bfdf98266fc" (UID: "0cd49b92-6b68-4878-93ca-4bfdf98266fc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:36:21.330893 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.330846    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" (UID: "06397f1a-bd39-42b6-a9e6-3aaa114b2eaa"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:36:21.332530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.332504    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-kube-api-access-22cw6" (OuterVolumeSpecName: "kube-api-access-22cw6") pod "06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" (UID: "06397f1a-bd39-42b6-a9e6-3aaa114b2eaa"). InnerVolumeSpecName "kube-api-access-22cw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:36:21.332694 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.332505    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd49b92-6b68-4878-93ca-4bfdf98266fc-kube-api-access-6wlbw" (OuterVolumeSpecName: "kube-api-access-6wlbw") pod "0cd49b92-6b68-4878-93ca-4bfdf98266fc" (UID: "0cd49b92-6b68-4878-93ca-4bfdf98266fc"). InnerVolumeSpecName "kube-api-access-6wlbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:36:21.431973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.431892    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0cd49b92-6b68-4878-93ca-4bfdf98266fc-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.431973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.431920    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.431973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.431929    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wlbw\" (UniqueName: \"kubernetes.io/projected/0cd49b92-6b68-4878-93ca-4bfdf98266fc-kube-api-access-6wlbw\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.431973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.431937    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22cw6\" (UniqueName: \"kubernetes.io/projected/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa-kube-api-access-22cw6\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:21.769393 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.769359    2558 generic.go:356] "Generic (PLEG): container finished" podID="06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" containerID="8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be" exitCode=0
Jul 28 14:36:21.769594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.769416    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"
Jul 28 14:36:21.769594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.769420    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96" event={"ID":"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa","Type":"ContainerDied","Data":"8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be"}
Jul 28 14:36:21.769594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.769490    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96" event={"ID":"06397f1a-bd39-42b6-a9e6-3aaa114b2eaa","Type":"ContainerDied","Data":"be70e04387bfe1b20588e818c32cbadc204b34d5355b3bdb1396f184a9061779"}
Jul 28 14:36:21.769594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.769519    2558 scope.go:117] "RemoveContainer" containerID="8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be"
Jul 28 14:36:21.771128 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.771065    2558 generic.go:356] "Generic (PLEG): container finished" podID="0cd49b92-6b68-4878-93ca-4bfdf98266fc" containerID="e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00" exitCode=0
Jul 28 14:36:21.771128 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.771116    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"
Jul 28 14:36:21.771337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.771156    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t" event={"ID":"0cd49b92-6b68-4878-93ca-4bfdf98266fc","Type":"ContainerDied","Data":"e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00"}
Jul 28 14:36:21.771337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.771229    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t" event={"ID":"0cd49b92-6b68-4878-93ca-4bfdf98266fc","Type":"ContainerDied","Data":"5a28345085b826ea148ed741f98822597159d4b06fe868baefcefe88e867a68a"}
Jul 28 14:36:21.780922 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.780903    2558 scope.go:117] "RemoveContainer" containerID="8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be"
Jul 28 14:36:21.781222 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:36:21.781201    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be\": container with ID starting with 8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be not found: ID does not exist" containerID="8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be"
Jul 28 14:36:21.781288 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.781230    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be"} err="failed to get container status \"8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be\": rpc error: code = NotFound desc = could not find container \"8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be\": container with ID starting with 8b3791ac8b99000266a775b41c27c2c8fabcb4631a4ab0fd2502595c2ba2d7be not found: ID does not exist"
Jul 28 14:36:21.781288 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.781247    2558 scope.go:117] "RemoveContainer" containerID="e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00"
Jul 28 14:36:21.790009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.789989    2558 scope.go:117] "RemoveContainer" containerID="e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00"
Jul 28 14:36:21.790281 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:36:21.790261    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00\": container with ID starting with e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00 not found: ID does not exist" containerID="e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00"
Jul 28 14:36:21.790347 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.790287    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00"} err="failed to get container status \"e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00\": rpc error: code = NotFound desc = could not find container \"e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00\": container with ID starting with e34a515079f6a584dad1439680ce0e17e85e0449f9a5304b9ab5548c6bd0ce00 not found: ID does not exist"
Jul 28 14:36:21.798328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.798306    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"]
Jul 28 14:36:21.805238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.805209    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-f2131889-6977678766-k2j96"]
Jul 28 14:36:21.817914 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.817893    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"]
Jul 28 14:36:21.822188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:21.822169    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-f2131889-5fb8fdc57b-gh78t"]
Jul 28 14:36:23.283491 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:23.283454    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" path="/var/lib/kubelet/pods/06397f1a-bd39-42b6-a9e6-3aaa114b2eaa/volumes"
Jul 28 14:36:23.283883 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:23.283820    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd49b92-6b68-4878-93ca-4bfdf98266fc" path="/var/lib/kubelet/pods/0cd49b92-6b68-4878-93ca-4bfdf98266fc/volumes"
Jul 28 14:36:24.332470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:24.332416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:36:29.309050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:29.309000    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"]
Jul 28 14:36:29.355068 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:29.355008    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:36:44.328255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.328212    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd" podUID="67dfca81-edef-4782-a518-8d7b1661e4ed" containerName="main" containerID="cri-o://540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920" gracePeriod=45
Jul 28 14:36:44.580569 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.580505    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:36:44.658676 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658637    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-home\") pod \"67dfca81-edef-4782-a518-8d7b1661e4ed\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") "
Jul 28 14:36:44.658851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658697    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dfca81-edef-4782-a518-8d7b1661e4ed-tls-certs\") pod \"67dfca81-edef-4782-a518-8d7b1661e4ed\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") "
Jul 28 14:36:44.658851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658726    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-model-cache\") pod \"67dfca81-edef-4782-a518-8d7b1661e4ed\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") "
Jul 28 14:36:44.658851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658747    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-dshm\") pod \"67dfca81-edef-4782-a518-8d7b1661e4ed\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") "
Jul 28 14:36:44.658851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658797    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-tmp-dir\") pod \"67dfca81-edef-4782-a518-8d7b1661e4ed\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") "
Jul 28 14:36:44.658851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658843    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9sxf\" (UniqueName: \"kubernetes.io/projected/67dfca81-edef-4782-a518-8d7b1661e4ed-kube-api-access-p9sxf\") pod \"67dfca81-edef-4782-a518-8d7b1661e4ed\" (UID: \"67dfca81-edef-4782-a518-8d7b1661e4ed\") "
Jul 28 14:36:44.659186 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.658906    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-home" (OuterVolumeSpecName: "home") pod "67dfca81-edef-4782-a518-8d7b1661e4ed" (UID: "67dfca81-edef-4782-a518-8d7b1661e4ed"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:36:44.659186 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.659066    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-model-cache" (OuterVolumeSpecName: "model-cache") pod "67dfca81-edef-4782-a518-8d7b1661e4ed" (UID: "67dfca81-edef-4782-a518-8d7b1661e4ed"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:36:44.659186 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.659158    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "67dfca81-edef-4782-a518-8d7b1661e4ed" (UID: "67dfca81-edef-4782-a518-8d7b1661e4ed"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:36:44.659321 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.659205    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-home\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:44.659321 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.659230    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-model-cache\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:44.661123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.661091    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-dshm" (OuterVolumeSpecName: "dshm") pod "67dfca81-edef-4782-a518-8d7b1661e4ed" (UID: "67dfca81-edef-4782-a518-8d7b1661e4ed"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:36:44.661123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.661114    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/67dfca81-edef-4782-a518-8d7b1661e4ed-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "67dfca81-edef-4782-a518-8d7b1661e4ed" (UID: "67dfca81-edef-4782-a518-8d7b1661e4ed"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:36:44.661262 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.661131    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67dfca81-edef-4782-a518-8d7b1661e4ed-kube-api-access-p9sxf" (OuterVolumeSpecName: "kube-api-access-p9sxf") pod "67dfca81-edef-4782-a518-8d7b1661e4ed" (UID: "67dfca81-edef-4782-a518-8d7b1661e4ed"). InnerVolumeSpecName "kube-api-access-p9sxf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:36:44.760144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.760108    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9sxf\" (UniqueName: \"kubernetes.io/projected/67dfca81-edef-4782-a518-8d7b1661e4ed-kube-api-access-p9sxf\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:44.760144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.760138    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67dfca81-edef-4782-a518-8d7b1661e4ed-tls-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:44.760144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.760150    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-dshm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:44.760377 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.760158    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67dfca81-edef-4782-a518-8d7b1661e4ed-tmp-dir\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:36:44.897544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.897442    2558 generic.go:356] "Generic (PLEG): container finished" podID="67dfca81-edef-4782-a518-8d7b1661e4ed" containerID="540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920" exitCode=0
Jul 28 14:36:44.897544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.897487    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"
Jul 28 14:36:44.897544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.897526    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd" event={"ID":"67dfca81-edef-4782-a518-8d7b1661e4ed","Type":"ContainerDied","Data":"540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920"}
Jul 28 14:36:44.897813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.897578    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd" event={"ID":"67dfca81-edef-4782-a518-8d7b1661e4ed","Type":"ContainerDied","Data":"1d3692a642214c323769a6910d20a875a698cbc90202d4d44e951aaecddb5a88"}
Jul 28 14:36:44.897813 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.897605    2558 scope.go:117] "RemoveContainer" containerID="540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920"
Jul 28 14:36:44.907602 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.907584    2558 scope.go:117] "RemoveContainer" containerID="540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920"
Jul 28 14:36:44.907876 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:36:44.907856    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920\": container with ID starting with 540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920 not found: ID does not exist" containerID="540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920"
Jul 28 14:36:44.907936 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.907885    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920"} err="failed to get container status \"540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920\": rpc error: code = NotFound desc = could not find container \"540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920\": container with ID starting with 540d4b4bab6a7a3fb1910eb15a0bc20721be2ff8ac59d64a13d1a303dc8e8920 not found: ID does not exist"
Jul 28 14:36:44.920431 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.920411    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"]
Jul 28 14:36:44.926992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:44.926968    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-f2131889/e2e-lifecycle-model-f2131889-kserve-67c8b44987-d72nd"]
Jul 28 14:36:45.283614 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:45.283575    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67dfca81-edef-4782-a518-8d7b1661e4ed" path="/var/lib/kubelet/pods/67dfca81-edef-4782-a518-8d7b1661e4ed/volumes"
Jul 28 14:36:47.426138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:47.426107    2558 scope.go:117] "RemoveContainer" containerID="90091e0f91728dd4bb5259d43cbd67526c8cfdbd80ff4b16fd5e33755bb9f2ff"
Jul 28 14:36:47.433976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:36:47.433953    2558 scope.go:117] "RemoveContainer" containerID="4bbb9df7e561c6c345839cd98d68f2253cba7bfa0b7c6445d43cb06833bbcf55"
Jul 28 14:37:06.279279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:06.279231    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:07.096381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:07.096346    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:13.213251 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:13.213163    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:37.773524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:37.773481    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:37.841593 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:37.841546    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:38.078365 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:38.078294    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"]
Jul 28 14:37:38.078542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:38.078517    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy" containerID="cri-o://10b18d3b339e0bd6ed0abeea4d8bf6e19e1bcb7db45ec40630b35751f0ab230a" gracePeriod=30
Jul 28 14:37:38.102155 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:38.102127    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:38.233139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:38.233100    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:38.347260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:38.347172    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:39.467251 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:39.467212    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:39.567322 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:39.567285    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:39.668281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:39.668232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:40.392421 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:40.392380    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:40.491562 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:40.491525    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:40.594250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:40.594218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:42.023920 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:42.023882    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:43.200749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.200717    2558 generic.go:356] "Generic (PLEG): container finished" podID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerID="10b18d3b339e0bd6ed0abeea4d8bf6e19e1bcb7db45ec40630b35751f0ab230a" exitCode=0
Jul 28 14:37:43.201117 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.200792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" event={"ID":"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db","Type":"ContainerDied","Data":"10b18d3b339e0bd6ed0abeea4d8bf6e19e1bcb7db45ec40630b35751f0ab230a"}
Jul 28 14:37:43.201117 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.200855    2558 scope.go:117] "RemoveContainer" containerID="dbd91c5eb3aca54400b819497192c2b8b2338ce22c97fac27113a5bfe70ec286"
Jul 28 14:37:43.331528 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.331504    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:37:43.427792 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427713    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-token\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.427792 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427755    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-data\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427796    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-certs\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istiod-ca-cert\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427865    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-socket\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427894    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sbb2\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-kube-api-access-5sbb2\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427930    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-podinfo\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427959    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-credential-socket\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.427980    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-envoy\") pod \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\" (UID: \"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db\") "
Jul 28 14:37:43.428502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428197    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:37:43.428502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428212    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:37:43.428502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428305    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:37:43.428502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428329    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.428502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428347    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.428502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428445    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:37:43.428821 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.428676    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-data" (OuterVolumeSpecName: "istio-data") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:37:43.430113 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.430080    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-token" (OuterVolumeSpecName: "istio-token") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:37:43.430234 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.430216    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:37:43.430299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.430258    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:37:43.430384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.430367    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-kube-api-access-5sbb2" (OuterVolumeSpecName: "kube-api-access-5sbb2") pod "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" (UID: "2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db"). InnerVolumeSpecName "kube-api-access-5sbb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:37:43.529211 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529180    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.529211 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529207    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.529211 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529216    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.529447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529224    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sbb2\" (UniqueName: \"kubernetes.io/projected/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-kube-api-access-5sbb2\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.529447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529234    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.529447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529242    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:43.529447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:43.529249    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:37:44.206747 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:44.206715    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"
Jul 28 14:37:44.207244 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:44.206756    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq" event={"ID":"2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db","Type":"ContainerDied","Data":"f60770983ed7eda824a819fd6974615373ba764227cf0c6ca47174a16801b347"}
Jul 28 14:37:44.207244 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:44.206833    2558 scope.go:117] "RemoveContainer" containerID="10b18d3b339e0bd6ed0abeea4d8bf6e19e1bcb7db45ec40630b35751f0ab230a"
Jul 28 14:37:44.233586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:44.232237    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"]
Jul 28 14:37:44.238597 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:44.238575    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f2131889-openshift-default-5b464f4f6d-22bvq"]
Jul 28 14:37:45.283475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:45.283430    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" path="/var/lib/kubelet/pods/2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db/volumes"
Jul 28 14:37:47.468561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:47.468523    2558 scope.go:117] "RemoveContainer" containerID="0acb7105151f737dee49d8e9b77512fb100e36bde4710ab2db2212673c85bb53"
Jul 28 14:37:47.476892 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:47.476869    2558 scope.go:117] "RemoveContainer" containerID="9fd5281aa3c8957f880c226cc5f75bc6d503d05d7fd9743cbe558c709572d7f4"
Jul 28 14:37:48.586265 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:48.586224    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:48.657171 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:48.657136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:49.261229 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:49.261201    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:55.899759 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:55.899702    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:55.998341 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:55.998281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:37:56.097872 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:37:56.097831    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:06.607615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:06.607520    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:06.960530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:06.960397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:22.481622 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:22.481586    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:22.557304 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:22.557261    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:27.936606 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:27.936557    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:34.894207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:34.894171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:34.963191 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:34.963155    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:35.252616 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.252554    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:35.551818 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.551741    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"]
Jul 28 14:38:35.552127 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552114    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67dfca81-edef-4782-a518-8d7b1661e4ed" containerName="main"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552129    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="67dfca81-edef-4782-a518-8d7b1661e4ed" containerName="main"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552139    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552145    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552153    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" containerName="payload-processing"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552158    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" containerName="payload-processing"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552170    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy"
Jul 28 14:38:35.552185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552176    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552190    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd49b92-6b68-4878-93ca-4bfdf98266fc" containerName="payload-pre-processing"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552195    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd49b92-6b68-4878-93ca-4bfdf98266fc" containerName="payload-pre-processing"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552263    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd49b92-6b68-4878-93ca-4bfdf98266fc" containerName="payload-pre-processing"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552272    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552279    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bbec6e7-6629-4ebc-8f69-d7a0e39ef0db" containerName="istio-proxy"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552285    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="06397f1a-bd39-42b6-a9e6-3aaa114b2eaa" containerName="payload-processing"
Jul 28 14:38:35.552400 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.552290    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="67dfca81-edef-4782-a518-8d7b1661e4ed" containerName="main"
Jul 28 14:38:35.555363 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.555342    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.557927 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.557906    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e8f53c-openshift-default-dockercfg-xwrss\""
Jul 28 14:38:35.567522 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.567502    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"]
Jul 28 14:38:35.577227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.577206    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:35.606374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606349    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047cee5f-8960-47fa-890d-3633a68c92c7-istiod-ca-cert\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606493 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606376    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-istio-token\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606493 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606405    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-certs\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606493 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606425    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-socket\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606493 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606491    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-envoy\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606521    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-credential-socket\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606553    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6xj9\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-kube-api-access-h6xj9\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-data\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.606641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.606602    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047cee5f-8960-47fa-890d-3633a68c92c7-istio-podinfo\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.707941 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.707908    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-credential-socket\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.707941 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.707946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6xj9\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-kube-api-access-h6xj9\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.707978    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-data\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708014    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047cee5f-8960-47fa-890d-3633a68c92c7-istio-podinfo\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708090    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047cee5f-8960-47fa-890d-3633a68c92c7-istiod-ca-cert\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708113    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-istio-token\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708151    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-certs\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708214 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708184    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-socket\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708235    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-envoy\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708416    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-data\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708524    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-certs\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708692 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708648    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-credential-socket\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708692 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708658    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-socket\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.708886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.708868    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047cee5f-8960-47fa-890d-3633a68c92c7-istiod-ca-cert\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.710432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.710409    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-envoy\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.710536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.710522    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047cee5f-8960-47fa-890d-3633a68c92c7-istio-podinfo\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.718374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.718347    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-istio-token\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.718889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.718864    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6xj9\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-kube-api-access-h6xj9\") pod \"e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") " pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:35.814671 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.814580    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:35.865446 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:35.865411    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:36.011643 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.011618    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"]
Jul 28 14:38:36.013919 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:38:36.013880    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod047cee5f_8960_47fa_890d_3633a68c92c7.slice/crio-7782c0814d58da1b6ed264b67e4458088515ae69aab97377079e8e0c52c0e9dd WatchSource:0}: Error finding container 7782c0814d58da1b6ed264b67e4458088515ae69aab97377079e8e0c52c0e9dd: Status 404 returned error can't find the container with id 7782c0814d58da1b6ed264b67e4458088515ae69aab97377079e8e0c52c0e9dd
Jul 28 14:38:36.016162 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.016128    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:38:36.016243 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.016227    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:38:36.016279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.016265    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:38:36.469465 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.469368    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" event={"ID":"047cee5f-8960-47fa-890d-3633a68c92c7","Type":"ContainerStarted","Data":"84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"}
Jul 28 14:38:36.469465 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.469428    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" event={"ID":"047cee5f-8960-47fa-890d-3633a68c92c7","Type":"ContainerStarted","Data":"7782c0814d58da1b6ed264b67e4458088515ae69aab97377079e8e0c52c0e9dd"}
Jul 28 14:38:36.490644 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.490596    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" podStartSLOduration=1.490578544 podStartE2EDuration="1.490578544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:38:36.489565936 +0000 UTC m=+2329.724085422" watchObservedRunningTime="2026-07-28 14:38:36.490578544 +0000 UTC m=+2329.725098017"
Jul 28 14:38:36.866470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:36.866433    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:37.872121 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:37.872085    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:38.486146 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:38.486115    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:38.487091 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:38.487069    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:38.506263 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:38.506232    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:38.595627 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:38.595596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:38.656819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:38.656785    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:39.073669 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.073582    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:39.219441 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.219403    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:39.311971 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.311936    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:38:39.313045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.313007    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"]
Jul 28 14:38:39.316656 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.316639    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.319272 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.319251    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-e8f53c\""
Jul 28 14:38:39.326350 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.326326    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"]
Jul 28 14:38:39.344166 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.344138    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"]
Jul 28 14:38:39.347642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.347625    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.350325 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.350301    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-e8f53c-dockercfg-lbl8v\""
Jul 28 14:38:39.358297 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.358267    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"]
Jul 28 14:38:39.444645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.444607    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2clv\" (UniqueName: \"kubernetes.io/projected/eacfd966-583a-4092-a251-17ddd0a5a41c-kube-api-access-f2clv\") pod \"payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.444854 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.444667    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eacfd966-583a-4092-a251-17ddd0a5a41c-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.444854 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.444810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d00549-2a99-4d9a-95ef-68bf7401e886-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.444996 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.444911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6459d\" (UniqueName: \"kubernetes.io/projected/92d00549-2a99-4d9a-95ef-68bf7401e886-kube-api-access-6459d\") pod \"payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.545879 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.545836    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6459d\" (UniqueName: \"kubernetes.io/projected/92d00549-2a99-4d9a-95ef-68bf7401e886-kube-api-access-6459d\") pod \"payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.546109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.545954    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2clv\" (UniqueName: \"kubernetes.io/projected/eacfd966-583a-4092-a251-17ddd0a5a41c-kube-api-access-f2clv\") pod \"payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.546109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.545990    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eacfd966-583a-4092-a251-17ddd0a5a41c-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.546109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.546101    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d00549-2a99-4d9a-95ef-68bf7401e886-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.546816 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.546791    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d00549-2a99-4d9a-95ef-68bf7401e886-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.546926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.546816    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eacfd966-583a-4092-a251-17ddd0a5a41c-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.555109 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.555079    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6459d\" (UniqueName: \"kubernetes.io/projected/92d00549-2a99-4d9a-95ef-68bf7401e886-kube-api-access-6459d\") pod \"payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.555202 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.555145    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2clv\" (UniqueName: \"kubernetes.io/projected/eacfd966-583a-4092-a251-17ddd0a5a41c-kube-api-access-f2clv\") pod \"payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.629047 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.628936    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:39.659328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.659299    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:39.778696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.778658    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"]
Jul 28 14:38:39.782634 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:38:39.782607    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92d00549_2a99_4d9a_95ef_68bf7401e886.slice/crio-3d3dd2982644d3136c743cfd111a4a6892f4ca17394c93005abbbb9cd7a4fd18 WatchSource:0}: Error finding container 3d3dd2982644d3136c743cfd111a4a6892f4ca17394c93005abbbb9cd7a4fd18: Status 404 returned error can't find the container with id 3d3dd2982644d3136c743cfd111a4a6892f4ca17394c93005abbbb9cd7a4fd18
Jul 28 14:38:39.809859 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:39.809838    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"]
Jul 28 14:38:39.817052 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:38:39.817013    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeacfd966_583a_4092_a251_17ddd0a5a41c.slice/crio-9b31e2fe830f38bc2444295ad8b225a4ab0191f2f111cf27fa3f8d3d71a8d2e1 WatchSource:0}: Error finding container 9b31e2fe830f38bc2444295ad8b225a4ab0191f2f111cf27fa3f8d3d71a8d2e1: Status 404 returned error can't find the container with id 9b31e2fe830f38bc2444295ad8b225a4ab0191f2f111cf27fa3f8d3d71a8d2e1
Jul 28 14:38:40.498428 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.498380    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6" event={"ID":"92d00549-2a99-4d9a-95ef-68bf7401e886","Type":"ContainerStarted","Data":"bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281"}
Jul 28 14:38:40.498904 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.498596    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:40.498904 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.498643    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6" event={"ID":"92d00549-2a99-4d9a-95ef-68bf7401e886","Type":"ContainerStarted","Data":"3d3dd2982644d3136c743cfd111a4a6892f4ca17394c93005abbbb9cd7a4fd18"}
Jul 28 14:38:40.500350 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.500296    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l" event={"ID":"eacfd966-583a-4092-a251-17ddd0a5a41c","Type":"ContainerStarted","Data":"aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8"}
Jul 28 14:38:40.500350 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.500350    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l" event={"ID":"eacfd966-583a-4092-a251-17ddd0a5a41c","Type":"ContainerStarted","Data":"9b31e2fe830f38bc2444295ad8b225a4ab0191f2f111cf27fa3f8d3d71a8d2e1"}
Jul 28 14:38:40.500553 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.500484    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:40.514792 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.514733    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6" podStartSLOduration=1.5147168450000001 podStartE2EDuration="1.514716845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:38:40.514354415 +0000 UTC m=+2333.748873888" watchObservedRunningTime="2026-07-28 14:38:40.514716845 +0000 UTC m=+2333.749236319"
Jul 28 14:38:40.534772 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:40.534729    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l" podStartSLOduration=1.534716416 podStartE2EDuration="1.534716416s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:38:40.53253271 +0000 UTC m=+2333.767052184" watchObservedRunningTime="2026-07-28 14:38:40.534716416 +0000 UTC m=+2333.769235887"
Jul 28 14:38:51.507557 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:51.507525    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:38:51.508010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:51.507820    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:38:52.573032 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:52.572969    2558 generic.go:356] "Generic (PLEG): container finished" podID="047cee5f-8960-47fa-890d-3633a68c92c7" containerID="84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870" exitCode=0
Jul 28 14:38:52.573557 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:52.573032    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" event={"ID":"047cee5f-8960-47fa-890d-3633a68c92c7","Type":"ContainerDied","Data":"84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"}
Jul 28 14:38:52.573956 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:52.573933    2558 scope.go:117] "RemoveContainer" containerID="84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"
Jul 28 14:38:52.575253 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:52.575219    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:38:52.575344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:52.575305    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:38:52.575383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:52.575349    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:38:53.487073 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:53.486951    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:53.584667 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:53.584618    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" event={"ID":"047cee5f-8960-47fa-890d-3633a68c92c7","Type":"ContainerStarted","Data":"852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707"}
Jul 28 14:38:53.865864 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:53.865823    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:53.867117 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:53.867092    2558 patch_prober.go:28] interesting pod/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 14:38:53.867191 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:53.867146    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 14:38:54.865851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:54.865811    2558 patch_prober.go:28] interesting pod/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 14:38:54.866270 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:54.865888    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 14:38:55.866446 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:55.866405    2558 patch_prober.go:28] interesting pod/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 14:38:55.866870 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:55.866470    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 14:38:56.866066 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:56.865994    2558 patch_prober.go:28] interesting pod/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Jul 28 14:38:56.866258 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:56.866083    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Jul 28 14:38:57.870238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:57.870206    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:57.870614 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:57.870464    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:38:57.871102 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:38:57.871087    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:39:03.584727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:03.584692    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:03.983566 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:03.983480    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:04.275274 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.275240    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"]
Jul 28 14:39:04.279411 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.279385    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.281972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.281945    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-38f257-openshift-default-dockercfg-d2xw8\""
Jul 28 14:39:04.290175 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.290150    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"]
Jul 28 14:39:04.315422 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.315399    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:04.381629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381582    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-envoy\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.381822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381653    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-socket\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.381822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381689    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-credential-socket\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.381822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381716    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-token\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.381822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-podinfo\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.381822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381795    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-certs\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.382123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381822    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6da60f2c-679f-46e2-b54a-25cb8069ad58-istiod-ca-cert\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.382123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381873    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-data\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.382123 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.381934    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kkbt\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-kube-api-access-5kkbt\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.482785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.482750    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-data\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.482997 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.482799    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kkbt\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-kube-api-access-5kkbt\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.482997 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.482884    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-envoy\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.482997 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.482931    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-socket\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.482997 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.482960    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-credential-socket\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.482997 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.482987    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-token\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483340 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483138    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-podinfo\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483340 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483171    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-certs\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483340 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483200    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6da60f2c-679f-46e2-b54a-25cb8069ad58-istiod-ca-cert\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483340 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483276    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-data\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483557 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483426    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-socket\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483557 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483529    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-credential-socket\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483564    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-certs\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.483952 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.483930    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6da60f2c-679f-46e2-b54a-25cb8069ad58-istiod-ca-cert\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.485260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.485240    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-envoy\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.485853 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.485833    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-podinfo\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.493870 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.493849    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-token\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.494008 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.493986    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kkbt\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-kube-api-access-5kkbt\") pod \"e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") " pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.593301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.593211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:04.663592 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.663563    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:04.734464 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.734435    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"]
Jul 28 14:39:04.735998 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:39:04.735974    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da60f2c_679f_46e2_b54a_25cb8069ad58.slice/crio-8c00fc8985d39f54507fb1970323e41092d75394a24e02b12cf63a25bffc32eb WatchSource:0}: Error finding container 8c00fc8985d39f54507fb1970323e41092d75394a24e02b12cf63a25bffc32eb: Status 404 returned error can't find the container with id 8c00fc8985d39f54507fb1970323e41092d75394a24e02b12cf63a25bffc32eb
Jul 28 14:39:04.738299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.738270    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:39:04.738375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.738333    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:39:04.738375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:04.738365    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:39:05.651960 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:05.651923    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" event={"ID":"6da60f2c-679f-46e2-b54a-25cb8069ad58","Type":"ContainerStarted","Data":"ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"}
Jul 28 14:39:05.652455 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:05.651977    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" event={"ID":"6da60f2c-679f-46e2-b54a-25cb8069ad58","Type":"ContainerStarted","Data":"8c00fc8985d39f54507fb1970323e41092d75394a24e02b12cf63a25bffc32eb"}
Jul 28 14:39:06.594058 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:06.593999    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:06.599271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:06.599246    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:06.621785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:06.621735    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" podStartSLOduration=2.621720116 podStartE2EDuration="2.621720116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:39:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:39:05.673721321 +0000 UTC m=+2358.908240794" watchObservedRunningTime="2026-07-28 14:39:06.621720116 +0000 UTC m=+2359.856239588"
Jul 28 14:39:06.657053 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:06.657012    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:06.657923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:06.657901    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:07.721183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:07.721147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:09.327177 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:09.327141    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:22.699199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:22.699161    2558 patch_prober.go:28] interesting pod/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 14:39:22.701526 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:22.699223    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 14:39:23.744615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:23.744585    2558 generic.go:356] "Generic (PLEG): container finished" podID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerID="ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c" exitCode=0
Jul 28 14:39:23.744996 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:23.744664    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" event={"ID":"6da60f2c-679f-46e2-b54a-25cb8069ad58","Type":"ContainerDied","Data":"ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"}
Jul 28 14:39:23.745121 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:23.745105    2558 scope.go:117] "RemoveContainer" containerID="ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"
Jul 28 14:39:23.746285 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:23.746259    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:39:23.746353 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:23.746335    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:39:23.746393 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:23.746371    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:39:24.751448 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:24.751409    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" event={"ID":"6da60f2c-679f-46e2-b54a-25cb8069ad58","Type":"ContainerStarted","Data":"de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d"}
Jul 28 14:39:25.595336 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:25.594737    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:25.595336 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:25.594986    2558 patch_prober.go:28] interesting pod/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 28 14:39:25.595336 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:25.595069    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 28 14:39:26.595206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:26.594726    2558 patch_prober.go:28] interesting pod/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 28 14:39:26.595206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:26.594795    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 28 14:39:27.593981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:27.593933    2558 patch_prober.go:28] interesting pod/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 28 14:39:27.594308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:27.594273    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 28 14:39:28.597575 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:28.597543    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:28.597956 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:28.597813    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:28.598530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:28.598514    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:39:32.684222 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:32.684184    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:39.161954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:39.161921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:39:47.339412 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:47.339384    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:39:47.343202 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:39:47.343179    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:40:17.846888 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.846793    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"]
Jul 28 14:40:17.851144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.851111    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:17.854802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.854773    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-38f257\"/\"default-dockercfg-sk8s6\""
Jul 28 14:40:17.854802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.854772    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-38f257\"/\"kube-root-ca.crt\""
Jul 28 14:40:17.854802 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.854781    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-38f257\"/\"openshift-service-ca.crt\""
Jul 28 14:40:17.855152 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.854832    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-38f257\"/\"test-model-38f257-kserve-self-signed-certs\""
Jul 28 14:40:17.858369 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.858350    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"]
Jul 28 14:40:17.875886 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.875852    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:40:17.999567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.999508    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-tmp-dir\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:17.999567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.999569    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-model-cache\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:17.999831 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.999750    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31816289-90cc-4b6b-b61c-8d5abe7986e3-tls-certs\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:17.999894 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.999867    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-home\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:17.999952 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.999900    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q22l\" (UniqueName: \"kubernetes.io/projected/31816289-90cc-4b6b-b61c-8d5abe7986e3-kube-api-access-5q22l\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.000010 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:17.999971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-dshm\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.100438 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.100353    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31816289-90cc-4b6b-b61c-8d5abe7986e3-tls-certs\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.100438 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.100434    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-home\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.100661 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.100455    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q22l\" (UniqueName: \"kubernetes.io/projected/31816289-90cc-4b6b-b61c-8d5abe7986e3-kube-api-access-5q22l\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.100661 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.100500    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-dshm\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.100661 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.100526    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-tmp-dir\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.100661 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.100541    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-model-cache\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.101234 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.101206    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-model-cache\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.101369 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.101236    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-home\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.101369 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.101313    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-tmp-dir\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.102953 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.102924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-dshm\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.103266 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.103249    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31816289-90cc-4b6b-b61c-8d5abe7986e3-tls-certs\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.111984 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.111962    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q22l\" (UniqueName: \"kubernetes.io/projected/31816289-90cc-4b6b-b61c-8d5abe7986e3-kube-api-access-5q22l\") pod \"test-model-38f257-kserve-5cbb9bfcb7-d984d\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") " pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.162687 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.162648    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:18.303166 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:18.303139    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"]
Jul 28 14:40:18.304900 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:40:18.304870    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31816289_90cc_4b6b_b61c_8d5abe7986e3.slice/crio-0bcf4cefe344e1de9a4a97b5671d65d06c108aa1c2a16bd57e53843c43342105 WatchSource:0}: Error finding container 0bcf4cefe344e1de9a4a97b5671d65d06c108aa1c2a16bd57e53843c43342105: Status 404 returned error can't find the container with id 0bcf4cefe344e1de9a4a97b5671d65d06c108aa1c2a16bd57e53843c43342105
Jul 28 14:40:19.035235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:19.035199    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d" event={"ID":"31816289-90cc-4b6b-b61c-8d5abe7986e3","Type":"ContainerStarted","Data":"6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c"}
Jul 28 14:40:19.035235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:19.035240    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d" event={"ID":"31816289-90cc-4b6b-b61c-8d5abe7986e3","Type":"ContainerStarted","Data":"0bcf4cefe344e1de9a4a97b5671d65d06c108aa1c2a16bd57e53843c43342105"}
Jul 28 14:40:19.054574 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:19.054516    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d" podStartSLOduration=2.054499513 podStartE2EDuration="2.054499513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:40:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:40:19.05188012 +0000 UTC m=+2432.286399594" watchObservedRunningTime="2026-07-28 14:40:19.054499513 +0000 UTC m=+2432.289018985"
Jul 28 14:40:28.163770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:28.163714    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:28.163770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:28.163785    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:28.178520 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:28.178493    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:29.097925 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:29.097893    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:40:31.754071 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:31.754039    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:40:31.855079 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:31.855045    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:40:47.529627 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:47.529589    2558 scope.go:117] "RemoveContainer" containerID="e06adc8cedd5c225a10af20784af2afb8a4b8b0dbe9bad05ec6e1a1bf0f8e13c"
Jul 28 14:40:57.541681 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:57.541642    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:40:58.578531 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:58.578495    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"]
Jul 28 14:40:58.598380 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:40:58.598347    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:09.449432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.449397    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:09.476283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.476251    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"]
Jul 28 14:41:09.476738 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.476486    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l" podUID="eacfd966-583a-4092-a251-17ddd0a5a41c" containerName="payload-processing" containerID="cri-o://aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8" gracePeriod=30
Jul 28 14:41:09.487423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.487396    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"]
Jul 28 14:41:09.487657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.487627    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6" podUID="92d00549-2a99-4d9a-95ef-68bf7401e886" containerName="payload-pre-processing" containerID="cri-o://bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281" gracePeriod=30
Jul 28 14:41:09.522158 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.522131    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:09.613840 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.613788    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:09.676888 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.676716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:09.752992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.752966    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:41:09.773577 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.773549    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:41:09.815807 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.815776    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d00549-2a99-4d9a-95ef-68bf7401e886-plugins-config-volume\") pod \"92d00549-2a99-4d9a-95ef-68bf7401e886\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") "
Jul 28 14:41:09.816219 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.816184    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92d00549-2a99-4d9a-95ef-68bf7401e886-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "92d00549-2a99-4d9a-95ef-68bf7401e886" (UID: "92d00549-2a99-4d9a-95ef-68bf7401e886"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:09.816370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.816282    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6459d\" (UniqueName: \"kubernetes.io/projected/92d00549-2a99-4d9a-95ef-68bf7401e886-kube-api-access-6459d\") pod \"92d00549-2a99-4d9a-95ef-68bf7401e886\" (UID: \"92d00549-2a99-4d9a-95ef-68bf7401e886\") "
Jul 28 14:41:09.816370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.816315    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eacfd966-583a-4092-a251-17ddd0a5a41c-plugins-config-volume\") pod \"eacfd966-583a-4092-a251-17ddd0a5a41c\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") "
Jul 28 14:41:09.816679 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.816647    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f2clv\" (UniqueName: \"kubernetes.io/projected/eacfd966-583a-4092-a251-17ddd0a5a41c-kube-api-access-f2clv\") pod \"eacfd966-583a-4092-a251-17ddd0a5a41c\" (UID: \"eacfd966-583a-4092-a251-17ddd0a5a41c\") "
Jul 28 14:41:09.816811 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.816750    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eacfd966-583a-4092-a251-17ddd0a5a41c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "eacfd966-583a-4092-a251-17ddd0a5a41c" (UID: "eacfd966-583a-4092-a251-17ddd0a5a41c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:09.817107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.817086    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/92d00549-2a99-4d9a-95ef-68bf7401e886-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:09.817107 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.817112    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/eacfd966-583a-4092-a251-17ddd0a5a41c-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:09.819039 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.818998    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d00549-2a99-4d9a-95ef-68bf7401e886-kube-api-access-6459d" (OuterVolumeSpecName: "kube-api-access-6459d") pod "92d00549-2a99-4d9a-95ef-68bf7401e886" (UID: "92d00549-2a99-4d9a-95ef-68bf7401e886"). InnerVolumeSpecName "kube-api-access-6459d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:09.819160 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.819046    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eacfd966-583a-4092-a251-17ddd0a5a41c-kube-api-access-f2clv" (OuterVolumeSpecName: "kube-api-access-f2clv") pod "eacfd966-583a-4092-a251-17ddd0a5a41c" (UID: "eacfd966-583a-4092-a251-17ddd0a5a41c"). InnerVolumeSpecName "kube-api-access-f2clv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:09.918079 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.918045    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6459d\" (UniqueName: \"kubernetes.io/projected/92d00549-2a99-4d9a-95ef-68bf7401e886-kube-api-access-6459d\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:09.918079 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:09.918072    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2clv\" (UniqueName: \"kubernetes.io/projected/eacfd966-583a-4092-a251-17ddd0a5a41c-kube-api-access-f2clv\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:10.059464 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.059427    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:10.308118 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.308083    2558 generic.go:356] "Generic (PLEG): container finished" podID="92d00549-2a99-4d9a-95ef-68bf7401e886" containerID="bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281" exitCode=0
Jul 28 14:41:10.308333 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.308161    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"
Jul 28 14:41:10.308333 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.308193    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6" event={"ID":"92d00549-2a99-4d9a-95ef-68bf7401e886","Type":"ContainerDied","Data":"bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281"}
Jul 28 14:41:10.308333 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.308244    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6" event={"ID":"92d00549-2a99-4d9a-95ef-68bf7401e886","Type":"ContainerDied","Data":"3d3dd2982644d3136c743cfd111a4a6892f4ca17394c93005abbbb9cd7a4fd18"}
Jul 28 14:41:10.308333 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.308273    2558 scope.go:117] "RemoveContainer" containerID="bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281"
Jul 28 14:41:10.309609 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.309533    2558 generic.go:356] "Generic (PLEG): container finished" podID="eacfd966-583a-4092-a251-17ddd0a5a41c" containerID="aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8" exitCode=0
Jul 28 14:41:10.309609 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.309578    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"
Jul 28 14:41:10.309749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.309579    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l" event={"ID":"eacfd966-583a-4092-a251-17ddd0a5a41c","Type":"ContainerDied","Data":"aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8"}
Jul 28 14:41:10.309749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.309711    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l" event={"ID":"eacfd966-583a-4092-a251-17ddd0a5a41c","Type":"ContainerDied","Data":"9b31e2fe830f38bc2444295ad8b225a4ab0191f2f111cf27fa3f8d3d71a8d2e1"}
Jul 28 14:41:10.317441 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.317422    2558 scope.go:117] "RemoveContainer" containerID="bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281"
Jul 28 14:41:10.317722 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:10.317696    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281\": container with ID starting with bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281 not found: ID does not exist" containerID="bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281"
Jul 28 14:41:10.317825 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.317732    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281"} err="failed to get container status \"bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281\": rpc error: code = NotFound desc = could not find container \"bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281\": container with ID starting with bda5af1f58d154c634459fd333c699438ee715b5724d89e7071f156296800281 not found: ID does not exist"
Jul 28 14:41:10.317825 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.317752    2558 scope.go:117] "RemoveContainer" containerID="aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8"
Jul 28 14:41:10.326639 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.326617    2558 scope.go:117] "RemoveContainer" containerID="aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8"
Jul 28 14:41:10.326942 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:10.326923    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8\": container with ID starting with aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8 not found: ID does not exist" containerID="aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8"
Jul 28 14:41:10.326998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.326949    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8"} err="failed to get container status \"aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8\": rpc error: code = NotFound desc = could not find container \"aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8\": container with ID starting with aaf9ddee2038ff9ee0b98b0f244751df2d79a65baebd650f9908a9068f9a64c8 not found: ID does not exist"
Jul 28 14:41:10.337733 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.337709    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"]
Jul 28 14:41:10.340564 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.340542    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e8f53c-7db7df9998-nxm9l"]
Jul 28 14:41:10.352817 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.352793    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"]
Jul 28 14:41:10.361370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:10.361342    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-e8f53c-57c54cd748-9v6d6"]
Jul 28 14:41:11.285275 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:11.285239    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92d00549-2a99-4d9a-95ef-68bf7401e886" path="/var/lib/kubelet/pods/92d00549-2a99-4d9a-95ef-68bf7401e886/volumes"
Jul 28 14:41:11.285760 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:11.285742    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eacfd966-583a-4092-a251-17ddd0a5a41c" path="/var/lib/kubelet/pods/eacfd966-583a-4092-a251-17ddd0a5a41c/volumes"
Jul 28 14:41:13.603198 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.603153    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d" podUID="31816289-90cc-4b6b-b61c-8d5abe7986e3" containerName="main" containerID="cri-o://6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c" gracePeriod=45
Jul 28 14:41:13.861245 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.861182    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:41:13.958254 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958217    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31816289-90cc-4b6b-b61c-8d5abe7986e3-tls-certs\") pod \"31816289-90cc-4b6b-b61c-8d5abe7986e3\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") "
Jul 28 14:41:13.958422 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958274    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-dshm\") pod \"31816289-90cc-4b6b-b61c-8d5abe7986e3\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") "
Jul 28 14:41:13.958422 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958306    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-tmp-dir\") pod \"31816289-90cc-4b6b-b61c-8d5abe7986e3\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") "
Jul 28 14:41:13.958422 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958388    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-model-cache\") pod \"31816289-90cc-4b6b-b61c-8d5abe7986e3\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") "
Jul 28 14:41:13.958422 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958414    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-home\") pod \"31816289-90cc-4b6b-b61c-8d5abe7986e3\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") "
Jul 28 14:41:13.958644 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958453    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5q22l\" (UniqueName: \"kubernetes.io/projected/31816289-90cc-4b6b-b61c-8d5abe7986e3-kube-api-access-5q22l\") pod \"31816289-90cc-4b6b-b61c-8d5abe7986e3\" (UID: \"31816289-90cc-4b6b-b61c-8d5abe7986e3\") "
Jul 28 14:41:13.958644 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958579    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "31816289-90cc-4b6b-b61c-8d5abe7986e3" (UID: "31816289-90cc-4b6b-b61c-8d5abe7986e3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:13.958752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958665    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-home" (OuterVolumeSpecName: "home") pod "31816289-90cc-4b6b-b61c-8d5abe7986e3" (UID: "31816289-90cc-4b6b-b61c-8d5abe7986e3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:13.958752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958681    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-model-cache" (OuterVolumeSpecName: "model-cache") pod "31816289-90cc-4b6b-b61c-8d5abe7986e3" (UID: "31816289-90cc-4b6b-b61c-8d5abe7986e3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:13.958870 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958847    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-model-cache\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:13.958921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958871    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-home\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:13.958921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.958886    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-tmp-dir\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:13.960573 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.960539    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-dshm" (OuterVolumeSpecName: "dshm") pod "31816289-90cc-4b6b-b61c-8d5abe7986e3" (UID: "31816289-90cc-4b6b-b61c-8d5abe7986e3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:13.960703 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.960570    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31816289-90cc-4b6b-b61c-8d5abe7986e3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "31816289-90cc-4b6b-b61c-8d5abe7986e3" (UID: "31816289-90cc-4b6b-b61c-8d5abe7986e3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:41:13.960703 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:13.960638    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31816289-90cc-4b6b-b61c-8d5abe7986e3-kube-api-access-5q22l" (OuterVolumeSpecName: "kube-api-access-5q22l") pod "31816289-90cc-4b6b-b61c-8d5abe7986e3" (UID: "31816289-90cc-4b6b-b61c-8d5abe7986e3"). InnerVolumeSpecName "kube-api-access-5q22l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:14.060046 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.059993    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5q22l\" (UniqueName: \"kubernetes.io/projected/31816289-90cc-4b6b-b61c-8d5abe7986e3-kube-api-access-5q22l\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:14.060205 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.060077    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/31816289-90cc-4b6b-b61c-8d5abe7986e3-tls-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:14.060205 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.060096    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/31816289-90cc-4b6b-b61c-8d5abe7986e3-dshm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:14.332561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.332521    2558 generic.go:356] "Generic (PLEG): container finished" podID="31816289-90cc-4b6b-b61c-8d5abe7986e3" containerID="6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c" exitCode=0
Jul 28 14:41:14.332749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.332569    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"
Jul 28 14:41:14.332749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.332592    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d" event={"ID":"31816289-90cc-4b6b-b61c-8d5abe7986e3","Type":"ContainerDied","Data":"6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c"}
Jul 28 14:41:14.332749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.332632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d" event={"ID":"31816289-90cc-4b6b-b61c-8d5abe7986e3","Type":"ContainerDied","Data":"0bcf4cefe344e1de9a4a97b5671d65d06c108aa1c2a16bd57e53843c43342105"}
Jul 28 14:41:14.332749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.332659    2558 scope.go:117] "RemoveContainer" containerID="6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c"
Jul 28 14:41:14.341883 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.341863    2558 scope.go:117] "RemoveContainer" containerID="6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c"
Jul 28 14:41:14.342200 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:14.342176    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c\": container with ID starting with 6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c not found: ID does not exist" containerID="6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c"
Jul 28 14:41:14.342283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.342207    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c"} err="failed to get container status \"6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c\": rpc error: code = NotFound desc = could not find container \"6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c\": container with ID starting with 6be1d16636efc0428fba97417038dd01dda77aae3f13f0a53fa7f5aaab4b909c not found: ID does not exist"
Jul 28 14:41:14.356384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.356357    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"]
Jul 28 14:41:14.361220 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:14.361193    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-38f257/test-model-38f257-kserve-5cbb9bfcb7-d984d"]
Jul 28 14:41:15.283362 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:15.283325    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31816289-90cc-4b6b-b61c-8d5abe7986e3" path="/var/lib/kubelet/pods/31816289-90cc-4b6b-b61c-8d5abe7986e3/volumes"
Jul 28 14:41:16.499306 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:16.499274    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:16.599965 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:16.599916    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:16.744751 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:16.744718    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"]
Jul 28 14:41:16.745000 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:16.744969    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy" containerID="cri-o://852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707" gracePeriod=30
Jul 28 14:41:16.772293 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:16.772211    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:17.009169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.009128    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:17.138533 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138442    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"]
Jul 28 14:41:17.138825 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138813    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31816289-90cc-4b6b-b61c-8d5abe7986e3" containerName="main"
Jul 28 14:41:17.138873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138827    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="31816289-90cc-4b6b-b61c-8d5abe7986e3" containerName="main"
Jul 28 14:41:17.138873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138847    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d00549-2a99-4d9a-95ef-68bf7401e886" containerName="payload-pre-processing"
Jul 28 14:41:17.138873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138855    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d00549-2a99-4d9a-95ef-68bf7401e886" containerName="payload-pre-processing"
Jul 28 14:41:17.138873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138863    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eacfd966-583a-4092-a251-17ddd0a5a41c" containerName="payload-processing"
Jul 28 14:41:17.138873 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138869    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="eacfd966-583a-4092-a251-17ddd0a5a41c" containerName="payload-processing"
Jul 28 14:41:17.139042 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138932    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="eacfd966-583a-4092-a251-17ddd0a5a41c" containerName="payload-processing"
Jul 28 14:41:17.139042 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138943    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="31816289-90cc-4b6b-b61c-8d5abe7986e3" containerName="main"
Jul 28 14:41:17.139042 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.138950    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d00549-2a99-4d9a-95ef-68bf7401e886" containerName="payload-pre-processing"
Jul 28 14:41:17.143403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.143385    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:17.145774 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.145745    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:41:17.145774 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.145750    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 28 14:41:17.151781 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.151758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"]
Jul 28 14:41:17.190926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.190890    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c4c65a-34aa-45c7-b344-a853a7b0acb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj\" (UID: \"24c4c65a-34aa-45c7-b344-a853a7b0acb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:17.291855 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.291814    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c4c65a-34aa-45c7-b344-a853a7b0acb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj\" (UID: \"24c4c65a-34aa-45c7-b344-a853a7b0acb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:17.292576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.292543    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c4c65a-34aa-45c7-b344-a853a7b0acb7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj\" (UID: \"24c4c65a-34aa-45c7-b344-a853a7b0acb7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:17.454982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.454895    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:17.600623 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:17.600588    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"]
Jul 28 14:41:17.605094 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:41:17.605061    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24c4c65a_34aa_45c7_b344_a853a7b0acb7.slice/crio-511215e6c9f01bb650551515baef5f3ac2be6bbecc2afeb95a41cbb0875b0043 WatchSource:0}: Error finding container 511215e6c9f01bb650551515baef5f3ac2be6bbecc2afeb95a41cbb0875b0043: Status 404 returned error can't find the container with id 511215e6c9f01bb650551515baef5f3ac2be6bbecc2afeb95a41cbb0875b0043
Jul 28 14:41:18.354561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:18.354523    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj" event={"ID":"24c4c65a-34aa-45c7-b344-a853a7b0acb7","Type":"ContainerStarted","Data":"e40a8669e276d7aea6d4cabcd8aae9c2b870bf261c6bae0f0dd7adf9ed27477b"}
Jul 28 14:41:18.354763 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:18.354596    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj" event={"ID":"24c4c65a-34aa-45c7-b344-a853a7b0acb7","Type":"ContainerStarted","Data":"511215e6c9f01bb650551515baef5f3ac2be6bbecc2afeb95a41cbb0875b0043"}
Jul 28 14:41:18.371434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:18.371384    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj" podStartSLOduration=1.37136864 podStartE2EDuration="1.37136864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:41:18.369000341 +0000 UTC m=+2491.603519815" watchObservedRunningTime="2026-07-28 14:41:18.37136864 +0000 UTC m=+2491.605888113"
Jul 28 14:41:19.366932 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:19.366896    2558 generic.go:356] "Generic (PLEG): container finished" podID="24c4c65a-34aa-45c7-b344-a853a7b0acb7" containerID="e40a8669e276d7aea6d4cabcd8aae9c2b870bf261c6bae0f0dd7adf9ed27477b" exitCode=0
Jul 28 14:41:19.367364 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:19.366962    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj" event={"ID":"24c4c65a-34aa-45c7-b344-a853a7b0acb7","Type":"ContainerDied","Data":"e40a8669e276d7aea6d4cabcd8aae9c2b870bf261c6bae0f0dd7adf9ed27477b"}
Jul 28 14:41:20.509067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:20.509036    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:20.625322 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:20.625229    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c4c65a-34aa-45c7-b344-a853a7b0acb7-maas-api-service-ca\") pod \"24c4c65a-34aa-45c7-b344-a853a7b0acb7\" (UID: \"24c4c65a-34aa-45c7-b344-a853a7b0acb7\") "
Jul 28 14:41:20.625575 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:20.625552    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24c4c65a-34aa-45c7-b344-a853a7b0acb7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "24c4c65a-34aa-45c7-b344-a853a7b0acb7" (UID: "24c4c65a-34aa-45c7-b344-a853a7b0acb7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:20.726743 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:20.726704    2558 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/24c4c65a-34aa-45c7-b344-a853a7b0acb7-maas-api-service-ca\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:21.381562 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:21.381531    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"
Jul 28 14:41:21.381772 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:21.381529    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj" event={"ID":"24c4c65a-34aa-45c7-b344-a853a7b0acb7","Type":"ContainerDied","Data":"511215e6c9f01bb650551515baef5f3ac2be6bbecc2afeb95a41cbb0875b0043"}
Jul 28 14:41:21.381772 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:21.381657    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="511215e6c9f01bb650551515baef5f3ac2be6bbecc2afeb95a41cbb0875b0043"
Jul 28 14:41:22.008920 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.008861    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:41:22.141861 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.141830    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-socket\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.141870    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-data\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.141892    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047cee5f-8960-47fa-890d-3633a68c92c7-istiod-ca-cert\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.141920    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047cee5f-8960-47fa-890d-3633a68c92c7-istio-podinfo\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.141954    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6xj9\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-kube-api-access-h6xj9\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142064    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-certs\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142094    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-istio-token\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142132    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-envoy\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142183    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-credential-socket\") pod \"047cee5f-8960-47fa-890d-3633a68c92c7\" (UID: \"047cee5f-8960-47fa-890d-3633a68c92c7\") "
Jul 28 14:41:22.142284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142159    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:22.142543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142374    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/047cee5f-8960-47fa-890d-3633a68c92c7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:22.142603 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142567    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:22.142664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142590    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:22.142664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142622    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.142664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142635    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/047cee5f-8960-47fa-890d-3633a68c92c7-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.142907 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.142881    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-data" (OuterVolumeSpecName: "istio-data") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:22.144307 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.144279    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-istio-token" (OuterVolumeSpecName: "istio-token") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:22.144397 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.144305    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-kube-api-access-h6xj9" (OuterVolumeSpecName: "kube-api-access-h6xj9") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "kube-api-access-h6xj9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:22.144397 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.144300    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/047cee5f-8960-47fa-890d-3633a68c92c7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:41:22.144473 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.144380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "047cee5f-8960-47fa-890d-3633a68c92c7" (UID: "047cee5f-8960-47fa-890d-3633a68c92c7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:22.244080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244013    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.244259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244071    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.244259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244105    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.244259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244113    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.244259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244122    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/047cee5f-8960-47fa-890d-3633a68c92c7-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.244259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244131    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/047cee5f-8960-47fa-890d-3633a68c92c7-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.244259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.244139    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6xj9\" (UniqueName: \"kubernetes.io/projected/047cee5f-8960-47fa-890d-3633a68c92c7-kube-api-access-h6xj9\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:22.388310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.388218    2558 generic.go:356] "Generic (PLEG): container finished" podID="047cee5f-8960-47fa-890d-3633a68c92c7" containerID="852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707" exitCode=0
Jul 28 14:41:22.388310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.388273    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"
Jul 28 14:41:22.388479 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.388272    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" event={"ID":"047cee5f-8960-47fa-890d-3633a68c92c7","Type":"ContainerDied","Data":"852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707"}
Jul 28 14:41:22.388479 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.388390    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz" event={"ID":"047cee5f-8960-47fa-890d-3633a68c92c7","Type":"ContainerDied","Data":"7782c0814d58da1b6ed264b67e4458088515ae69aab97377079e8e0c52c0e9dd"}
Jul 28 14:41:22.388479 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.388420    2558 scope.go:117] "RemoveContainer" containerID="852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707"
Jul 28 14:41:22.398396 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.398374    2558 scope.go:117] "RemoveContainer" containerID="84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"
Jul 28 14:41:22.406532 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.406511    2558 scope.go:117] "RemoveContainer" containerID="852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707"
Jul 28 14:41:22.406805 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:22.406782    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707\": container with ID starting with 852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707 not found: ID does not exist" containerID="852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707"
Jul 28 14:41:22.406880 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.406818    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707"} err="failed to get container status \"852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707\": rpc error: code = NotFound desc = could not find container \"852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707\": container with ID starting with 852b8ae1dde6f5ccf9962af3e80775895995fc4b76adbfc7746995ab43022707 not found: ID does not exist"
Jul 28 14:41:22.406880 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.406846    2558 scope.go:117] "RemoveContainer" containerID="84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"
Jul 28 14:41:22.407133 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:22.407114    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870\": container with ID starting with 84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870 not found: ID does not exist" containerID="84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"
Jul 28 14:41:22.407188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.407139    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870"} err="failed to get container status \"84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870\": rpc error: code = NotFound desc = could not find container \"84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870\": container with ID starting with 84e78a371c84c79c804013ec521785aa7536e65e659b47cebd18e617805de870 not found: ID does not exist"
Jul 28 14:41:22.414867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.414844    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"]
Jul 28 14:41:22.419538 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:22.419515    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e8f53c-openshift-default-765fdd7df4-wzfbz"]
Jul 28 14:41:23.203256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.203228    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:23.283628 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.283591    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" path="/var/lib/kubelet/pods/047cee5f-8960-47fa-890d-3633a68c92c7/volumes"
Jul 28 14:41:23.299419 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.299392    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:23.399498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.399465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:23.461792 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.461703    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"]
Jul 28 14:41:23.464585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.464549    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-38f257-kkrnj"]
Jul 28 14:41:23.862828 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:23.862779    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:25.286540 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:25.286506    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24c4c65a-34aa-45c7-b344-a853a7b0acb7" path="/var/lib/kubelet/pods/24c4c65a-34aa-45c7-b344-a853a7b0acb7/volumes"
Jul 28 14:41:30.259988 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:30.259943    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:30.360771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:30.360735    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:30.567434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:30.567350    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"]
Jul 28 14:41:30.567591 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:30.567563    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy" containerID="cri-o://de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d" gracePeriod=30
Jul 28 14:41:30.600573 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:30.600524    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:30.871659 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:30.871559    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:31.318929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.318892    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:31.658062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.657961    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"]
Jul 28 14:41:31.658342 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658329    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24c4c65a-34aa-45c7-b344-a853a7b0acb7" containerName="revoke-keys"
Jul 28 14:41:31.658385 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658343    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="24c4c65a-34aa-45c7-b344-a853a7b0acb7" containerName="revoke-keys"
Jul 28 14:41:31.658385 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658381    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy"
Jul 28 14:41:31.658452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658386    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy"
Jul 28 14:41:31.658452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658395    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy"
Jul 28 14:41:31.658452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658401    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy"
Jul 28 14:41:31.658541 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658456    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy"
Jul 28 14:41:31.658541 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658464    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="047cee5f-8960-47fa-890d-3633a68c92c7" containerName="istio-proxy"
Jul 28 14:41:31.658541 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.658472    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="24c4c65a-34aa-45c7-b344-a853a7b0acb7" containerName="revoke-keys"
Jul 28 14:41:31.661389 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.661372    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.663864 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.663846    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-4e9663-openshift-default-dockercfg-js62r\""
Jul 28 14:41:31.682335 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.682300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:31.683067 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.682986    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"]
Jul 28 14:41:31.838876 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.838838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27643b09-d536-4cbd-9499-34b2df20082d-istiod-ca-cert\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.838876 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.838878    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-istio-token\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.838904    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-data\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.839003    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27643b09-d536-4cbd-9499-34b2df20082d-istio-podinfo\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.839063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-envoy\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.839126    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-credential-socket\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839268 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.839144    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-socket\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839268 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.839169    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-certs\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.839268 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.839188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vx5b\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-kube-api-access-8vx5b\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.906567 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.906528    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:31.940222 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940159    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27643b09-d536-4cbd-9499-34b2df20082d-istiod-ca-cert\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940222 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-istio-token\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940227    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-data\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940271    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27643b09-d536-4cbd-9499-34b2df20082d-istio-podinfo\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940292    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-envoy\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940341    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-credential-socket\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940360    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-socket\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940383 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940379    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-certs\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940403    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vx5b\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-kube-api-access-8vx5b\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940661    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-data\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940851 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940827    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-certs\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.940973 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940950    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-socket\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.941043 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.940973    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-credential-socket\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.941043 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.941005    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27643b09-d536-4cbd-9499-34b2df20082d-istiod-ca-cert\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.942635 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.942607    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-envoy\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.942757 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.942721    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27643b09-d536-4cbd-9499-34b2df20082d-istio-podinfo\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.950402 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.950378    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vx5b\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-kube-api-access-8vx5b\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.950544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.950436    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-istio-token\") pod \"e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") " pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:31.972475 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:31.972449    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:32.110875 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.110844    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"]
Jul 28 14:41:32.114141 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:41:32.114100    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27643b09_d536_4cbd_9499_34b2df20082d.slice/crio-81c1de2142666c26fc12406c3ec39da681ced227962e897f1e8baded84e90a3b WatchSource:0}: Error finding container 81c1de2142666c26fc12406c3ec39da681ced227962e897f1e8baded84e90a3b: Status 404 returned error can't find the container with id 81c1de2142666c26fc12406c3ec39da681ced227962e897f1e8baded84e90a3b
Jul 28 14:41:32.116495 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.116451    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:41:32.116577 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.116558    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:41:32.116628 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.116612    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:41:32.440562 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.440519    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" event={"ID":"27643b09-d536-4cbd-9499-34b2df20082d","Type":"ContainerStarted","Data":"36027153779e69fa6a22e22004a2c7f5b13ba65590a3b144d44fcb54d7c8ee90"}
Jul 28 14:41:32.441105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.440583    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" event={"ID":"27643b09-d536-4cbd-9499-34b2df20082d","Type":"ContainerStarted","Data":"81c1de2142666c26fc12406c3ec39da681ced227962e897f1e8baded84e90a3b"}
Jul 28 14:41:32.464140 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.464087    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" podStartSLOduration=1.464066532 podStartE2EDuration="1.464066532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:41:32.463246704 +0000 UTC m=+2505.697766177" watchObservedRunningTime="2026-07-28 14:41:32.464066532 +0000 UTC m=+2505.698586005"
Jul 28 14:41:32.972867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:32.972830    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:33.979337 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:33.979305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:34.450390 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:34.450358    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:34.451375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:34.451355    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:34.522462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:34.522429    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:34.627318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:34.627284    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:34.728805 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:34.728698    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:34.827905 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:34.827870    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:35.480366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.480330    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"]
Jul 28 14:41:35.484180 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.484157    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.486586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.486559    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-4e9663\""
Jul 28 14:41:35.486705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.486560    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-4e9663-dockercfg-zwk4t\""
Jul 28 14:41:35.497738 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.497717    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"]
Jul 28 14:41:35.504104 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.504083    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:35.578665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.578629    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b03f15bb-4c3e-4814-9fca-eea8079f9f79-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") " pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.579435 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.579410    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jf6n\" (UniqueName: \"kubernetes.io/projected/b03f15bb-4c3e-4814-9fca-eea8079f9f79-kube-api-access-7jf6n\") pod \"payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") " pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.603803 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.603772    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:41:35.680524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.680471    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jf6n\" (UniqueName: \"kubernetes.io/projected/b03f15bb-4c3e-4814-9fca-eea8079f9f79-kube-api-access-7jf6n\") pod \"payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") " pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.680666 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.680643    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b03f15bb-4c3e-4814-9fca-eea8079f9f79-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") " pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.681515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.681491    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b03f15bb-4c3e-4814-9fca-eea8079f9f79-plugins-config-volume\") pod \"payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") " pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.690820 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.690792    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jf6n\" (UniqueName: \"kubernetes.io/projected/b03f15bb-4c3e-4814-9fca-eea8079f9f79-kube-api-access-7jf6n\") pod \"payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") " pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.795362 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.795330    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:35.826090 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.826064    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:41:35.960615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.960588    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"]
Jul 28 14:41:35.963086 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:41:35.963054    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb03f15bb_4c3e_4814_9fca_eea8079f9f79.slice/crio-db91d6d9dd599e39f6c92ddd5da8cb16d3933493135a87f8b6231ecae0818dde WatchSource:0}: Error finding container db91d6d9dd599e39f6c92ddd5da8cb16d3933493135a87f8b6231ecae0818dde: Status 404 returned error can't find the container with id db91d6d9dd599e39f6c92ddd5da8cb16d3933493135a87f8b6231ecae0818dde
Jul 28 14:41:35.983915 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.983859    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-envoy\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984012 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.983977    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-socket\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984091 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984037    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-podinfo\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984091 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984068    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-data\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984097    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-certs\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984127    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-credential-socket\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984161    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-token\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984196    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kkbt\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-kube-api-access-5kkbt\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984402 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984250    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6da60f2c-679f-46e2-b54a-25cb8069ad58-istiod-ca-cert\") pod \"6da60f2c-679f-46e2-b54a-25cb8069ad58\" (UID: \"6da60f2c-679f-46e2-b54a-25cb8069ad58\") "
Jul 28 14:41:35.984402 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984272    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:35.984601 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984581    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:35.984869 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984829    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:35.984967 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984913    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6da60f2c-679f-46e2-b54a-25cb8069ad58-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:41:35.985048 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.984956    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-data" (OuterVolumeSpecName: "istio-data") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:35.985335 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.985308    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:35.986883 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.986854    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:41:35.986994 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.986890    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:41:35.986994 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.986983    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-kube-api-access-5kkbt" (OuterVolumeSpecName: "kube-api-access-5kkbt") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "kube-api-access-5kkbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:35.987350 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:35.987327    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-token" (OuterVolumeSpecName: "istio-token") pod "6da60f2c-679f-46e2-b54a-25cb8069ad58" (UID: "6da60f2c-679f-46e2-b54a-25cb8069ad58"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:41:36.085678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085645    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085675    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085687    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kkbt\" (UniqueName: \"kubernetes.io/projected/6da60f2c-679f-46e2-b54a-25cb8069ad58-kube-api-access-5kkbt\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085697    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6da60f2c-679f-46e2-b54a-25cb8069ad58-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085705    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085713    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085720    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.085929 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.085728    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6da60f2c-679f-46e2-b54a-25cb8069ad58-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:41:36.462445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.462409    2558 generic.go:356] "Generic (PLEG): container finished" podID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerID="de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d" exitCode=0
Jul 28 14:41:36.462621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.462456    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"
Jul 28 14:41:36.462621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.462494    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" event={"ID":"6da60f2c-679f-46e2-b54a-25cb8069ad58","Type":"ContainerDied","Data":"de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d"}
Jul 28 14:41:36.462621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.462565    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt" event={"ID":"6da60f2c-679f-46e2-b54a-25cb8069ad58","Type":"ContainerDied","Data":"8c00fc8985d39f54507fb1970323e41092d75394a24e02b12cf63a25bffc32eb"}
Jul 28 14:41:36.462621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.462600    2558 scope.go:117] "RemoveContainer" containerID="de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d"
Jul 28 14:41:36.464213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.464180    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m" event={"ID":"b03f15bb-4c3e-4814-9fca-eea8079f9f79","Type":"ContainerStarted","Data":"56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c"}
Jul 28 14:41:36.464348 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.464230    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m" event={"ID":"b03f15bb-4c3e-4814-9fca-eea8079f9f79","Type":"ContainerStarted","Data":"db91d6d9dd599e39f6c92ddd5da8cb16d3933493135a87f8b6231ecae0818dde"}
Jul 28 14:41:36.464348 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.464273    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:36.476484 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.476458    2558 scope.go:117] "RemoveContainer" containerID="ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"
Jul 28 14:41:36.486546 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.486523    2558 scope.go:117] "RemoveContainer" containerID="de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d"
Jul 28 14:41:36.487231 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:36.487201    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d\": container with ID starting with de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d not found: ID does not exist" containerID="de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d"
Jul 28 14:41:36.487317 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.487242    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d"} err="failed to get container status \"de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d\": rpc error: code = NotFound desc = could not find container \"de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d\": container with ID starting with de813cea9ae84bc5bb1f5edb2145ab94f4299d7a8f5c2eedb796662339f5739d not found: ID does not exist"
Jul 28 14:41:36.487317 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.487267    2558 scope.go:117] "RemoveContainer" containerID="ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"
Jul 28 14:41:36.487555 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:41:36.487532    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c\": container with ID starting with ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c not found: ID does not exist" containerID="ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"
Jul 28 14:41:36.487632 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.487564    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c"} err="failed to get container status \"ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c\": rpc error: code = NotFound desc = could not find container \"ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c\": container with ID starting with ab03f8b043b1d4089d8b8da8078fb1286734d13e04fd29572559553cbad22e2c not found: ID does not exist"
Jul 28 14:41:36.491318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.491273    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m" podStartSLOduration=1.491260427 podStartE2EDuration="1.491260427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:41:36.488897563 +0000 UTC m=+2509.723417039" watchObservedRunningTime="2026-07-28 14:41:36.491260427 +0000 UTC m=+2509.725779898"
Jul 28 14:41:36.505899 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.505877    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"]
Jul 28 14:41:36.510629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:36.510605    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-38f257-openshift-default-5554c9cb94-j6rwt"]
Jul 28 14:41:37.284032 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:37.283991    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" path="/var/lib/kubelet/pods/6da60f2c-679f-46e2-b54a-25cb8069ad58/volumes"
Jul 28 14:41:47.473401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.473365    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:41:47.531850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.531818    2558 generic.go:356] "Generic (PLEG): container finished" podID="27643b09-d536-4cbd-9499-34b2df20082d" containerID="36027153779e69fa6a22e22004a2c7f5b13ba65590a3b144d44fcb54d7c8ee90" exitCode=0
Jul 28 14:41:47.532057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.531894    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" event={"ID":"27643b09-d536-4cbd-9499-34b2df20082d","Type":"ContainerDied","Data":"36027153779e69fa6a22e22004a2c7f5b13ba65590a3b144d44fcb54d7c8ee90"}
Jul 28 14:41:47.532463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.532446    2558 scope.go:117] "RemoveContainer" containerID="36027153779e69fa6a22e22004a2c7f5b13ba65590a3b144d44fcb54d7c8ee90"
Jul 28 14:41:47.533571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.533545    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:41:47.533693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.533629    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:41:47.533693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:47.533681    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:41:48.539286 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:48.539245    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" event={"ID":"27643b09-d536-4cbd-9499-34b2df20082d","Type":"ContainerStarted","Data":"f36a98e1357baf1a4c18c8670a7b9fa0038de49918d8438d9b9265a45a2b58c6"}
Jul 28 14:41:48.974450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:48.974344    2558 patch_prober.go:28] interesting pod/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 14:41:48.974450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:48.974427    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 14:41:48.975151 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:48.975123    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:49.451100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:49.451058    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:49.973814 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:49.973765    2558 patch_prober.go:28] interesting pod/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 14:41:49.974355 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:49.973837    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 14:41:50.973279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:50.973234    2558 patch_prober.go:28] interesting pod/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 14:41:50.973497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:50.973303    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 14:41:51.973292 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:51.973242    2558 patch_prober.go:28] interesting pod/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Jul 28 14:41:51.973820 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:51.973329    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Jul 28 14:41:52.977188 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:52.977154    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:52.978359 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:52.978333    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:41:59.923305 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:41:59.923270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:00.064343 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.064308    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:00.354709 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.354675    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"]
Jul 28 14:42:00.355166 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.355148    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy"
Jul 28 14:42:00.355166 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.355167    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy"
Jul 28 14:42:00.355284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.355193    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy"
Jul 28 14:42:00.355284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.355199    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy"
Jul 28 14:42:00.355284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.355271    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy"
Jul 28 14:42:00.358358 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.358339    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.360913 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.360895    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a409a3-openshift-default-dockercfg-sg5hn\""
Jul 28 14:42:00.370199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.370179    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"]
Jul 28 14:42:00.383950 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.383921    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:00.424344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424312    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-podinfo\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-token\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424435    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-certs\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424494    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-envoy\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424530    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-data\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424611 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424579    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-credential-socket\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424630    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpw8\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-kube-api-access-jhpw8\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istiod-ca-cert\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.424760 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.424745    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-socket\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.526946    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-podinfo\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527069    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-token\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527124    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-certs\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527157    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-envoy\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527193    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-data\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527232    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-credential-socket\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527286    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpw8\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-kube-api-access-jhpw8\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527323    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istiod-ca-cert\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527357    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-socket\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.527854    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-socket\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.531515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.530975    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-podinfo\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.532209 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.531595    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-certs\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.532921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.532640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-data\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.532921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.532750    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-credential-socket\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.533650 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.533625    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istiod-ca-cert\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.533992 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.533968    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-envoy\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.540320 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.540296    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-token\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.540607 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.540591    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpw8\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-kube-api-access-jhpw8\") pod \"e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") " pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.669247 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.669149    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:00.812651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.812625    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"]
Jul 28 14:42:00.815093 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:42:00.815058    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f33f426_cd7c_4390_a58e_b7c373ce78d2.slice/crio-fe2c4f3e2cde99dac654e630d6c4e2efe0e5ba990a0b6b5b68ea310673ad34ac WatchSource:0}: Error finding container fe2c4f3e2cde99dac654e630d6c4e2efe0e5ba990a0b6b5b68ea310673ad34ac: Status 404 returned error can't find the container with id fe2c4f3e2cde99dac654e630d6c4e2efe0e5ba990a0b6b5b68ea310673ad34ac
Jul 28 14:42:00.817257 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.817220    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:42:00.817371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.817285    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:42:00.817371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:00.817313    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:42:01.233615 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:01.233577    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:01.608269 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:01.608232    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" event={"ID":"3f33f426-cd7c-4390-a58e-b7c373ce78d2","Type":"ContainerStarted","Data":"67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"}
Jul 28 14:42:01.608452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:01.608284    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" event={"ID":"3f33f426-cd7c-4390-a58e-b7c373ce78d2","Type":"ContainerStarted","Data":"fe2c4f3e2cde99dac654e630d6c4e2efe0e5ba990a0b6b5b68ea310673ad34ac"}
Jul 28 14:42:01.630472 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:01.630423    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" podStartSLOduration=1.6303914910000001 podStartE2EDuration="1.630391491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:42:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:42:01.628377616 +0000 UTC m=+2534.862897091" watchObservedRunningTime="2026-07-28 14:42:01.630391491 +0000 UTC m=+2534.864910963"
Jul 28 14:42:01.669500 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:01.669468    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:01.674825 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:01.674791    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:02.613180 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:02.613144    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:02.614137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:02.614114    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:03.553744 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:03.553710    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:03.641263 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:03.641227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:03.715231 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:03.715194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:04.276100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.275996    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:04.385654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.385612    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"]
Jul 28 14:42:04.386163 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.386144    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6da60f2c-679f-46e2-b54a-25cb8069ad58" containerName="istio-proxy"
Jul 28 14:42:04.389680 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.389656    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.392257 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.392233    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-a409a3\""
Jul 28 14:42:04.392366 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.392314    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-a409a3-dockercfg-n8zj2\""
Jul 28 14:42:04.400784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.400758    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"]
Jul 28 14:42:04.470171 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.470130    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.470341 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.470292    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d88jt\" (UniqueName: \"kubernetes.io/projected/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-kube-api-access-d88jt\") pod \"payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.571730 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.571629    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d88jt\" (UniqueName: \"kubernetes.io/projected/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-kube-api-access-d88jt\") pod \"payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.571730 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.571680    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.572432 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.572401    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.580415 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.580383    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d88jt\" (UniqueName: \"kubernetes.io/projected/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-kube-api-access-d88jt\") pod \"payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.637141 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.637112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:04.701483 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.701444    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:04.844444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:04.844416    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"]
Jul 28 14:42:04.846727 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:42:04.846698    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f80fb2c_8679_4f4a_be0d_d0b475e2da0f.slice/crio-a57eab8bb4d89b8e9c67e07b382b450ded38ff9dd2c7442828e7caf791c2d50b WatchSource:0}: Error finding container a57eab8bb4d89b8e9c67e07b382b450ded38ff9dd2c7442828e7caf791c2d50b: Status 404 returned error can't find the container with id a57eab8bb4d89b8e9c67e07b382b450ded38ff9dd2c7442828e7caf791c2d50b
Jul 28 14:42:05.628736 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:05.628694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6" event={"ID":"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f","Type":"ContainerStarted","Data":"f2a8f12b3c00a6059af22d9e773262d47e85db0a5d86a78cffcb01a5ce188691"}
Jul 28 14:42:05.628910 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:05.628765    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6" event={"ID":"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f","Type":"ContainerStarted","Data":"a57eab8bb4d89b8e9c67e07b382b450ded38ff9dd2c7442828e7caf791c2d50b"}
Jul 28 14:42:05.628910 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:05.628815    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:05.647677 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:05.647629    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6" podStartSLOduration=1.647614168 podStartE2EDuration="1.647614168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:42:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:42:05.645767794 +0000 UTC m=+2538.880287464" watchObservedRunningTime="2026-07-28 14:42:05.647614168 +0000 UTC m=+2538.882133640"
Jul 28 14:42:16.636709 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:16.636672    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:42:18.186456 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.185513    2558 patch_prober.go:28] interesting pod/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": read tcp 10.133.0.2:56148->10.133.0.66:15021: read: connection reset by peer" start-of-body=
Jul 28 14:42:18.186456 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.185607    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": read tcp 10.133.0.2:56148->10.133.0.66:15021: read: connection reset by peer"
Jul 28 14:42:18.698991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.698956    2558 generic.go:356] "Generic (PLEG): container finished" podID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerID="67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085" exitCode=0
Jul 28 14:42:18.699185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.699000    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" event={"ID":"3f33f426-cd7c-4390-a58e-b7c373ce78d2","Type":"ContainerDied","Data":"67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"}
Jul 28 14:42:18.699439 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.699425    2558 scope.go:117] "RemoveContainer" containerID="67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"
Jul 28 14:42:18.700512 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.700481    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:42:18.700629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.700564    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:42:18.700629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:18.700614    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:42:19.706975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:19.706936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" event={"ID":"3f33f426-cd7c-4390-a58e-b7c373ce78d2","Type":"ContainerStarted","Data":"1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13"}
Jul 28 14:42:20.669983 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:20.669941    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:20.670204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:20.670167    2558 patch_prober.go:28] interesting pod/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 28 14:42:20.670252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:20.670236    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 28 14:42:21.669704 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:21.669663    2558 patch_prober.go:28] interesting pod/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 28 14:42:21.670144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:21.669725    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 28 14:42:22.670324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:22.670280    2558 patch_prober.go:28] interesting pod/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 28 14:42:22.670721 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:22.670348    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 28 14:42:23.673353 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:23.673319    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:23.673856 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:23.673618    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:23.674477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:23.674450    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:42:28.642386 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:28.642344    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:47.506702 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.506658    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:47.537523 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.537487    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"]
Jul 28 14:42:47.537793 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.537761    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m" podUID="b03f15bb-4c3e-4814-9fca-eea8079f9f79" containerName="payload-processing" containerID="cri-o://56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c" gracePeriod=30
Jul 28 14:42:47.607791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.607740    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:47.706592 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.706558    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:47.776435 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.776395    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:47.794736 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.794713    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:42:47.856086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.856054    2558 generic.go:356] "Generic (PLEG): container finished" podID="b03f15bb-4c3e-4814-9fca-eea8079f9f79" containerID="56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c" exitCode=0
Jul 28 14:42:47.856260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.856104    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"
Jul 28 14:42:47.856260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.856141    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m" event={"ID":"b03f15bb-4c3e-4814-9fca-eea8079f9f79","Type":"ContainerDied","Data":"56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c"}
Jul 28 14:42:47.856260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.856204    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m" event={"ID":"b03f15bb-4c3e-4814-9fca-eea8079f9f79","Type":"ContainerDied","Data":"db91d6d9dd599e39f6c92ddd5da8cb16d3933493135a87f8b6231ecae0818dde"}
Jul 28 14:42:47.856260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.856240    2558 scope.go:117] "RemoveContainer" containerID="56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c"
Jul 28 14:42:47.866931 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.866912    2558 scope.go:117] "RemoveContainer" containerID="56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c"
Jul 28 14:42:47.867262 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:42:47.867234    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c\": container with ID starting with 56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c not found: ID does not exist" containerID="56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c"
Jul 28 14:42:47.867384 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.867275    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c"} err="failed to get container status \"56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c\": rpc error: code = NotFound desc = could not find container \"56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c\": container with ID starting with 56c4bf58016f5a186412381829ea3d9da9490a303ca91063cc0207dce59c7c6c not found: ID does not exist"
Jul 28 14:42:47.880823 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.880791    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jf6n\" (UniqueName: \"kubernetes.io/projected/b03f15bb-4c3e-4814-9fca-eea8079f9f79-kube-api-access-7jf6n\") pod \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") "
Jul 28 14:42:47.880984 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.880942    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b03f15bb-4c3e-4814-9fca-eea8079f9f79-plugins-config-volume\") pod \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\" (UID: \"b03f15bb-4c3e-4814-9fca-eea8079f9f79\") "
Jul 28 14:42:47.881368 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.881336    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b03f15bb-4c3e-4814-9fca-eea8079f9f79-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b03f15bb-4c3e-4814-9fca-eea8079f9f79" (UID: "b03f15bb-4c3e-4814-9fca-eea8079f9f79"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:42:47.883368 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.883330    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b03f15bb-4c3e-4814-9fca-eea8079f9f79-kube-api-access-7jf6n" (OuterVolumeSpecName: "kube-api-access-7jf6n") pod "b03f15bb-4c3e-4814-9fca-eea8079f9f79" (UID: "b03f15bb-4c3e-4814-9fca-eea8079f9f79"). InnerVolumeSpecName "kube-api-access-7jf6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:42:47.982528 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.982489    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b03f15bb-4c3e-4814-9fca-eea8079f9f79-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:42:47.982528 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:47.982526    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jf6n\" (UniqueName: \"kubernetes.io/projected/b03f15bb-4c3e-4814-9fca-eea8079f9f79-kube-api-access-7jf6n\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:42:48.100888 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:48.100781    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:48.181079 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:48.181043    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"]
Jul 28 14:42:48.185427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:48.185403    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-4e9663-b57b7c574-pmk5m"]
Jul 28 14:42:49.282571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:49.282538    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b03f15bb-4c3e-4814-9fca-eea8079f9f79" path="/var/lib/kubelet/pods/b03f15bb-4c3e-4814-9fca-eea8079f9f79/volumes"
Jul 28 14:42:54.444328 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:54.444294    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:54.511616 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:54.511568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:54.706286 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:54.706185    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"]
Jul 28 14:42:54.706510 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:54.706478    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy" containerID="cri-o://f36a98e1357baf1a4c18c8670a7b9fa0038de49918d8438d9b9265a45a2b58c6" gracePeriod=30
Jul 28 14:42:54.733704 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:54.733675    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:54.927775 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:54.927731    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:42:59.926457 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:59.926415    2558 generic.go:356] "Generic (PLEG): container finished" podID="27643b09-d536-4cbd-9499-34b2df20082d" containerID="f36a98e1357baf1a4c18c8670a7b9fa0038de49918d8438d9b9265a45a2b58c6" exitCode=0
Jul 28 14:42:59.926881 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:59.926484    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" event={"ID":"27643b09-d536-4cbd-9499-34b2df20082d","Type":"ContainerDied","Data":"f36a98e1357baf1a4c18c8670a7b9fa0038de49918d8438d9b9265a45a2b58c6"}
Jul 28 14:42:59.926881 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:59.926549    2558 scope.go:117] "RemoveContainer" containerID="36027153779e69fa6a22e22004a2c7f5b13ba65590a3b144d44fcb54d7c8ee90"
Jul 28 14:42:59.965121 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:42:59.965096    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:43:00.000193 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000167    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-socket\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000222    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-envoy\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000249    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-data\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000286    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27643b09-d536-4cbd-9499-34b2df20082d-istiod-ca-cert\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000305    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vx5b\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-kube-api-access-8vx5b\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000343    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27643b09-d536-4cbd-9499-34b2df20082d-istio-podinfo\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000374    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-istio-token\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000389    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-credential-socket\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000409    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-certs\") pod \"27643b09-d536-4cbd-9499-34b2df20082d\" (UID: \"27643b09-d536-4cbd-9499-34b2df20082d\") "
Jul 28 14:43:00.000645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000538    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:00.000860 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000734    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.000860 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000759    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:00.000969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000872    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27643b09-d536-4cbd-9499-34b2df20082d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:43:00.000969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.000902    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:00.001252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.001228    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-data" (OuterVolumeSpecName: "istio-data") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:00.002853 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.002824    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-istio-token" (OuterVolumeSpecName: "istio-token") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:00.002961 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.002845    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-kube-api-access-8vx5b" (OuterVolumeSpecName: "kube-api-access-8vx5b") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "kube-api-access-8vx5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:00.003085 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.003065    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:00.003136 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.003069    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27643b09-d536-4cbd-9499-34b2df20082d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27643b09-d536-4cbd-9499-34b2df20082d" (UID: "27643b09-d536-4cbd-9499-34b2df20082d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:43:00.102036 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.101991    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102058    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102068    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27643b09-d536-4cbd-9499-34b2df20082d-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102078    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vx5b\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-kube-api-access-8vx5b\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102088    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27643b09-d536-4cbd-9499-34b2df20082d-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102096    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27643b09-d536-4cbd-9499-34b2df20082d-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102104    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.102217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.102112    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27643b09-d536-4cbd-9499-34b2df20082d-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:00.932431 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.932399    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"
Jul 28 14:43:00.932888 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.932406    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs" event={"ID":"27643b09-d536-4cbd-9499-34b2df20082d","Type":"ContainerDied","Data":"81c1de2142666c26fc12406c3ec39da681ced227962e897f1e8baded84e90a3b"}
Jul 28 14:43:00.932888 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.932530    2558 scope.go:117] "RemoveContainer" containerID="f36a98e1357baf1a4c18c8670a7b9fa0038de49918d8438d9b9265a45a2b58c6"
Jul 28 14:43:00.956462 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.956434    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"]
Jul 28 14:43:00.961241 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:00.961214    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-4e9663-openshift-default-69d56db798-n7nfs"]
Jul 28 14:43:01.283911 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:01.283878    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27643b09-d536-4cbd-9499-34b2df20082d" path="/var/lib/kubelet/pods/27643b09-d536-4cbd-9499-34b2df20082d/volumes"
Jul 28 14:43:10.722390 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.722296    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:10.771918 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.771890    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"]
Jul 28 14:43:10.772162 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.772132    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6" podUID="1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" containerName="payload-pre-processing" containerID="cri-o://f2a8f12b3c00a6059af22d9e773262d47e85db0a5d86a78cffcb01a5ce188691" gracePeriod=30
Jul 28 14:43:10.807128 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.807096    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:10.907627 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.907596    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:10.987490 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.987406    2558 generic.go:356] "Generic (PLEG): container finished" podID="1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" containerID="f2a8f12b3c00a6059af22d9e773262d47e85db0a5d86a78cffcb01a5ce188691" exitCode=0
Jul 28 14:43:10.987639 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:10.987502    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6" event={"ID":"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f","Type":"ContainerDied","Data":"f2a8f12b3c00a6059af22d9e773262d47e85db0a5d86a78cffcb01a5ce188691"}
Jul 28 14:43:11.007361 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.007308    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:11.040310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.040284    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:43:11.107884 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.107849    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d88jt\" (UniqueName: \"kubernetes.io/projected/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-kube-api-access-d88jt\") pod \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") "
Jul 28 14:43:11.108080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.108039    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-plugins-config-volume\") pod \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\" (UID: \"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f\") "
Jul 28 14:43:11.108405 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.108380    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" (UID: "1f80fb2c-8679-4f4a-be0d-d0b475e2da0f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:43:11.109955 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.109937    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-kube-api-access-d88jt" (OuterVolumeSpecName: "kube-api-access-d88jt") pod "1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" (UID: "1f80fb2c-8679-4f4a-be0d-d0b475e2da0f"). InnerVolumeSpecName "kube-api-access-d88jt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:11.209318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.209278    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.209318 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.209313    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d88jt\" (UniqueName: \"kubernetes.io/projected/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f-kube-api-access-d88jt\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:11.380683 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.380630    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:11.994086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.994053    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"
Jul 28 14:43:11.994580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.994052    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6" event={"ID":"1f80fb2c-8679-4f4a-be0d-d0b475e2da0f","Type":"ContainerDied","Data":"a57eab8bb4d89b8e9c67e07b382b450ded38ff9dd2c7442828e7caf791c2d50b"}
Jul 28 14:43:11.994580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:11.994214    2558 scope.go:117] "RemoveContainer" containerID="f2a8f12b3c00a6059af22d9e773262d47e85db0a5d86a78cffcb01a5ce188691"
Jul 28 14:43:12.011595 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:12.011567    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"]
Jul 28 14:43:12.017912 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:12.017889    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-a409a3-68df8f4c5b-hp9j6"]
Jul 28 14:43:13.282045 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:13.281989    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" path="/var/lib/kubelet/pods/1f80fb2c-8679-4f4a-be0d-d0b475e2da0f/volumes"
Jul 28 14:43:17.893133 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:17.893076    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:17.995149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:17.995111    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:18.194463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:18.194367    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"]
Jul 28 14:43:18.194682 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:18.194654    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy" containerID="cri-o://1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13" gracePeriod=30
Jul 28 14:43:18.224037 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:18.223475    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:18.446748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:18.446659    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:18.813426 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:18.813383    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:19.124082 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.123987    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"]
Jul 28 14:43:19.124445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124375    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy"
Jul 28 14:43:19.124445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124387    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy"
Jul 28 14:43:19.124445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124397    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b03f15bb-4c3e-4814-9fca-eea8079f9f79" containerName="payload-processing"
Jul 28 14:43:19.124445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124404    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b03f15bb-4c3e-4814-9fca-eea8079f9f79" containerName="payload-processing"
Jul 28 14:43:19.124445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124424    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" containerName="payload-pre-processing"
Jul 28 14:43:19.124445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124431    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" containerName="payload-pre-processing"
Jul 28 14:43:19.124645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124483    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy"
Jul 28 14:43:19.124645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124491    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b03f15bb-4c3e-4814-9fca-eea8079f9f79" containerName="payload-processing"
Jul 28 14:43:19.124645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.124497    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f80fb2c-8679-4f4a-be0d-d0b475e2da0f" containerName="payload-pre-processing"
Jul 28 14:43:19.128501 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.128484    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.131086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.131065    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-910fb6-openshift-default-dockercfg-prk25\""
Jul 28 14:43:19.138818 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.138792    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"]
Jul 28 14:43:19.147070 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.147043    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:19.184161 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184122    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-socket\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184161 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184168    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-podinfo\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-data\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-token\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184333    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxhrc\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-kube-api-access-lxhrc\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-credential-socket\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184429 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184414    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-envoy\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184655 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184481    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istiod-ca-cert\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.184655 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.184513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-certs\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290503 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290466    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-data\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290509    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-token\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290549    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxhrc\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-kube-api-access-lxhrc\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290577    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-credential-socket\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290599    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-envoy\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290654    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istiod-ca-cert\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.290705 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290681    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-certs\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290757    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-socket\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290781    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-podinfo\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.290924    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-data\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.291247    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-certs\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291377 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.291310    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-socket\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291486 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.291466    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-credential-socket\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.291547 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.291469    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istiod-ca-cert\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.293441 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.293410    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-podinfo\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.293441 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.293417    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-envoy\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.303958 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.303935    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxhrc\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-kube-api-access-lxhrc\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.304085 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.304052    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-token\") pod \"e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") " pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.439856 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.439776    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:19.579619 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.579593    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"]
Jul 28 14:43:19.582047 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:43:19.582004    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaccb2f0c_9c30_4bfb_9f75_3e4bbf286ea6.slice/crio-d8f6718a085f0376bde36c2d48605aff717781b5fee27d99c23229fd516f6e3b WatchSource:0}: Error finding container d8f6718a085f0376bde36c2d48605aff717781b5fee27d99c23229fd516f6e3b: Status 404 returned error can't find the container with id d8f6718a085f0376bde36c2d48605aff717781b5fee27d99c23229fd516f6e3b
Jul 28 14:43:19.584254 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.584223    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:19.584344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.584286    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:19.584344 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.584314    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:19.697613 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:19.697499    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:20.036100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:20.036055    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" event={"ID":"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6","Type":"ContainerStarted","Data":"d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"}
Jul 28 14:43:20.036405 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:20.036118    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" event={"ID":"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6","Type":"ContainerStarted","Data":"d8f6718a085f0376bde36c2d48605aff717781b5fee27d99c23229fd516f6e3b"}
Jul 28 14:43:20.058529 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:20.058468    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" podStartSLOduration=1.058446509 podStartE2EDuration="1.058446509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:20.057202146 +0000 UTC m=+2613.291721617" watchObservedRunningTime="2026-07-28 14:43:20.058446509 +0000 UTC m=+2613.292965983"
Jul 28 14:43:20.440473 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:20.440377    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:20.445613 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:20.445588    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:21.040927 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:21.040897    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:21.041965 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:21.041945    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:22.027322 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.027281    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:22.113223 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.113171    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:22.183730 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.183691    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:22.502463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.502431    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:22.763477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.763402    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:22.865208 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.865168    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:22.870132 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.870104    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"]
Jul 28 14:43:22.870473 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.870459    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy"
Jul 28 14:43:22.870521 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.870475    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy"
Jul 28 14:43:22.870562 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.870554    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="27643b09-d536-4cbd-9499-34b2df20082d" containerName="istio-proxy"
Jul 28 14:43:22.873821 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.873790    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:22.876690 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.876516    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-910fb6\""
Jul 28 14:43:22.876809 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.876778    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-910fb6-dockercfg-67str\""
Jul 28 14:43:22.882275 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.882252    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"]
Jul 28 14:43:22.886147 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.886124    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"]
Jul 28 14:43:22.890762 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.890738    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:22.900699 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:22.900675    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"]
Jul 28 14:43:23.031227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.031137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc576\" (UniqueName: \"kubernetes.io/projected/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-kube-api-access-nc576\") pod \"payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.031227 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.031177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10f35cbf-3061-4690-bfca-12a36ba70998-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") " pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.031689 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.031348    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.031689 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.031395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjjjn\" (UniqueName: \"kubernetes.io/projected/10f35cbf-3061-4690-bfca-12a36ba70998-kube-api-access-vjjjn\") pod \"payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") " pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.132823 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.132783    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc576\" (UniqueName: \"kubernetes.io/projected/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-kube-api-access-nc576\") pod \"payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.132823 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.132825    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10f35cbf-3061-4690-bfca-12a36ba70998-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") " pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.133138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.132918    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.133138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.132949    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjjjn\" (UniqueName: \"kubernetes.io/projected/10f35cbf-3061-4690-bfca-12a36ba70998-kube-api-access-vjjjn\") pod \"payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") " pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.133645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.133622    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10f35cbf-3061-4690-bfca-12a36ba70998-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") " pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.133645 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.133640    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.142084 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.142063    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjjjn\" (UniqueName: \"kubernetes.io/projected/10f35cbf-3061-4690-bfca-12a36ba70998-kube-api-access-vjjjn\") pod \"payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") " pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.142183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.142089    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc576\" (UniqueName: \"kubernetes.io/projected/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-kube-api-access-nc576\") pod \"payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.187826 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.187789    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:23.201900 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.201876    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:23.382737 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.382702    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"]
Jul 28 14:43:23.383845 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:43:23.383814    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f35cbf_3061_4690_bfca_12a36ba70998.slice/crio-afb261a98b9021e72bae7937455448375eb1b8d21d2c74bb0352dafc9b9c33e4 WatchSource:0}: Error finding container afb261a98b9021e72bae7937455448375eb1b8d21d2c74bb0352dafc9b9c33e4: Status 404 returned error can't find the container with id afb261a98b9021e72bae7937455448375eb1b8d21d2c74bb0352dafc9b9c33e4
Jul 28 14:43:23.455909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.455885    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:43:23.538351 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538276    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-certs\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538351 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538317    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-socket\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538394    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-envoy\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538419    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-data\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538458    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-token\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538502    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istiod-ca-cert\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538531    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-credential-socket\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538546    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:23.538976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538577    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:23.538976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538626    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhpw8\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-kube-api-access-jhpw8\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538677    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-podinfo\") pod \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\" (UID: \"3f33f426-cd7c-4390-a58e-b7c373ce78d2\") "
Jul 28 14:43:23.538976 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.538774    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:23.539423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.539053    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.539423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.539076    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.539423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.539090    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.539423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.539248    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:23.539423 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.539287    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:43:23.540574 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.540551    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:43:23.540733 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.540713    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-kube-api-access-jhpw8" (OuterVolumeSpecName: "kube-api-access-jhpw8") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "kube-api-access-jhpw8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:23.540919 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.540899    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:43:23.540957 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.540940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f33f426-cd7c-4390-a58e-b7c373ce78d2" (UID: "3f33f426-cd7c-4390-a58e-b7c373ce78d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:43:23.551869 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.551848    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"]
Jul 28 14:43:23.553497 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:43:23.553473    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b1c6a5_ee3a_415c_a8e0_870d638694a6.slice/crio-94d15eaefec61a664d7c01125c2944a94c24e7b51d33ca8aa42959aedf16d445 WatchSource:0}: Error finding container 94d15eaefec61a664d7c01125c2944a94c24e7b51d33ca8aa42959aedf16d445: Status 404 returned error can't find the container with id 94d15eaefec61a664d7c01125c2944a94c24e7b51d33ca8aa42959aedf16d445
Jul 28 14:43:23.640519 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.640495    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.640626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.640536    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhpw8\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-kube-api-access-jhpw8\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.640626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.640547    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.640626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.640556    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.640626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.640564    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:23.640626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:23.640571    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f33f426-cd7c-4390-a58e-b7c373ce78d2-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:43:24.057919 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.057874    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz" event={"ID":"10f35cbf-3061-4690-bfca-12a36ba70998","Type":"ContainerStarted","Data":"6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469"}
Jul 28 14:43:24.058392 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.057964    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz" event={"ID":"10f35cbf-3061-4690-bfca-12a36ba70998","Type":"ContainerStarted","Data":"afb261a98b9021e72bae7937455448375eb1b8d21d2c74bb0352dafc9b9c33e4"}
Jul 28 14:43:24.058392 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.057994    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:24.059750 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.059713    2558 generic.go:356] "Generic (PLEG): container finished" podID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerID="1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13" exitCode=0
Jul 28 14:43:24.059900 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.059782    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"
Jul 28 14:43:24.059900 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.059792    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" event={"ID":"3f33f426-cd7c-4390-a58e-b7c373ce78d2","Type":"ContainerDied","Data":"1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13"}
Jul 28 14:43:24.059900 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.059852    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx" event={"ID":"3f33f426-cd7c-4390-a58e-b7c373ce78d2","Type":"ContainerDied","Data":"fe2c4f3e2cde99dac654e630d6c4e2efe0e5ba990a0b6b5b68ea310673ad34ac"}
Jul 28 14:43:24.059900 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.059884    2558 scope.go:117] "RemoveContainer" containerID="1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13"
Jul 28 14:43:24.061437 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.061411    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5" event={"ID":"d2b1c6a5-ee3a-415c-a8e0-870d638694a6","Type":"ContainerStarted","Data":"446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe"}
Jul 28 14:43:24.061605 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.061465    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:24.061605 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.061492    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5" event={"ID":"d2b1c6a5-ee3a-415c-a8e0-870d638694a6","Type":"ContainerStarted","Data":"94d15eaefec61a664d7c01125c2944a94c24e7b51d33ca8aa42959aedf16d445"}
Jul 28 14:43:24.069646 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.069631    2558 scope.go:117] "RemoveContainer" containerID="67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"
Jul 28 14:43:24.079828 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.079807    2558 scope.go:117] "RemoveContainer" containerID="1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13"
Jul 28 14:43:24.080235 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:43:24.080210    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13\": container with ID starting with 1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13 not found: ID does not exist" containerID="1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13"
Jul 28 14:43:24.080341 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.080244    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13"} err="failed to get container status \"1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13\": rpc error: code = NotFound desc = could not find container \"1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13\": container with ID starting with 1529eeecce98d03bf714aa4bb3ffbf2db6c142d934d7f4eab99adabd9555bc13 not found: ID does not exist"
Jul 28 14:43:24.080341 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.080268    2558 scope.go:117] "RemoveContainer" containerID="67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"
Jul 28 14:43:24.080520 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:43:24.080501    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085\": container with ID starting with 67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085 not found: ID does not exist" containerID="67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"
Jul 28 14:43:24.080588 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.080526    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085"} err="failed to get container status \"67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085\": rpc error: code = NotFound desc = could not find container \"67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085\": container with ID starting with 67ab705fcf4b22a24c09c8549ee63c9f8e42bb53ee981df1787c4cc750f87085 not found: ID does not exist"
Jul 28 14:43:24.100041 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.099986    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz" podStartSLOduration=2.099974261 podStartE2EDuration="2.099974261s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:24.098055164 +0000 UTC m=+2617.332574638" watchObservedRunningTime="2026-07-28 14:43:24.099974261 +0000 UTC m=+2617.334493732"
Jul 28 14:43:24.116572 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.116532    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5" podStartSLOduration=2.116519945 podStartE2EDuration="2.116519945s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:24.116431165 +0000 UTC m=+2617.350950638" watchObservedRunningTime="2026-07-28 14:43:24.116519945 +0000 UTC m=+2617.351039459"
Jul 28 14:43:24.130126 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.130102    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"]
Jul 28 14:43:24.135991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:24.135971    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a409a3-openshift-default-546fc45f94-nc9zx"]
Jul 28 14:43:25.283181 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:25.283143    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" path="/var/lib/kubelet/pods/3f33f426-cd7c-4390-a58e-b7c373ce78d2/volumes"
Jul 28 14:43:34.125978 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:34.125943    2558 generic.go:356] "Generic (PLEG): container finished" podID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerID="d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d" exitCode=0
Jul 28 14:43:34.126457 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:34.126031    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" event={"ID":"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6","Type":"ContainerDied","Data":"d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"}
Jul 28 14:43:34.126457 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:34.126427    2558 scope.go:117] "RemoveContainer" containerID="d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"
Jul 28 14:43:34.127425 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:34.127400    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:34.127482 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:34.127464    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:34.127528 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:34.127496    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:35.070626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:35.070593    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:43:35.070807 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:35.070668    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:43:35.134673 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:35.134640    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" event={"ID":"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6","Type":"ContainerStarted","Data":"367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a"}
Jul 28 14:43:35.440923 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:35.440818    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:35.442219 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:35.442187    2558 patch_prober.go:28] interesting pod/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 14:43:35.442351 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:35.442260    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 14:43:36.041367 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:36.041334    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:36.440488 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:36.440403    2558 patch_prober.go:28] interesting pod/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 14:43:36.440488 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:36.440467    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 14:43:37.440620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:37.440584    2558 patch_prober.go:28] interesting pod/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 14:43:37.441001 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:37.440644    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 14:43:38.440621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:38.440583    2558 patch_prober.go:28] interesting pod/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused" start-of-body=
Jul 28 14:43:38.441069 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:38.440640    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.68:15021/healthz/ready\": dial tcp 10.133.0.68:15021: connect: connection refused"
Jul 28 14:43:39.444772 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:39.444742    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:39.445703 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:39.445686    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:43:52.213707 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.213643    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:52.573184 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.573136    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:52.865255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.865175    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"]
Jul 28 14:43:52.865591 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.865578    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy"
Jul 28 14:43:52.865642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.865593    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy"
Jul 28 14:43:52.865642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.865602    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy"
Jul 28 14:43:52.865642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.865608    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy"
Jul 28 14:43:52.865736 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.865667    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy"
Jul 28 14:43:52.868752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.868733    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.871305 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.871281    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-baa216-openshift-default-dockercfg-dtctq\""
Jul 28 14:43:52.881889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.881865    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"]
Jul 28 14:43:52.891626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.891602    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:52.947223 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947186    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-certs\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947223 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947224    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24ttd\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-kube-api-access-24ttd\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-podinfo\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947311    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-credential-socket\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947340    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-data\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947380    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-envoy\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947450 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947436    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istiod-ca-cert\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947465    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-token\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.947620 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.947514    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-socket\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:52.967712 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:52.967679    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:53.048051 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048004    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-credential-socket\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048064    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-data\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048098    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-envoy\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048122    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istiod-ca-cert\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048142    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-token\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048201    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-socket\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048260 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048247    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-certs\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048583 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048267    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24ttd\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-kube-api-access-24ttd\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048583 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048300    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-podinfo\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048583 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048474    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-credential-socket\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048583 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-data\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048788 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048639    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-socket\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048788 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048700    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-certs\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.048959 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.048927    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istiod-ca-cert\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.050561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.050542    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-envoy\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.050786 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.050769    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-podinfo\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.057629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.057602    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-token\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.057727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.057683    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24ttd\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-kube-api-access-24ttd\") pod \"e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") " pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.182101 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.181997    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:53.333788 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.333762    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"]
Jul 28 14:43:53.335766 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:43:53.335740    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceda290b_0b5d_470f_a22e_5f1f948f7b39.slice/crio-a3a46f87ee1d31fcb9a69edcfaeea00f930b97bc7ed6549c722b268c08e525f6 WatchSource:0}: Error finding container a3a46f87ee1d31fcb9a69edcfaeea00f930b97bc7ed6549c722b268c08e525f6: Status 404 returned error can't find the container with id a3a46f87ee1d31fcb9a69edcfaeea00f930b97bc7ed6549c722b268c08e525f6
Jul 28 14:43:53.338047 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.337994    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:53.338137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.338070    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:53.338137 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:53.338104    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:43:54.234552 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:54.234494    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" event={"ID":"ceda290b-0b5d-470f-a22e-5f1f948f7b39","Type":"ContainerStarted","Data":"e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"}
Jul 28 14:43:54.234762 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:54.234571    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" event={"ID":"ceda290b-0b5d-470f-a22e-5f1f948f7b39","Type":"ContainerStarted","Data":"a3a46f87ee1d31fcb9a69edcfaeea00f930b97bc7ed6549c722b268c08e525f6"}
Jul 28 14:43:54.259081 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:54.258991    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podStartSLOduration=2.25897133 podStartE2EDuration="2.25897133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:54.256785555 +0000 UTC m=+2647.491305027" watchObservedRunningTime="2026-07-28 14:43:54.25897133 +0000 UTC m=+2647.493490802"
Jul 28 14:43:55.183228 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:55.183186    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:55.188922 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:55.188896    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:55.239921 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:55.239889    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:55.240968 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:55.240946    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:43:56.229444 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:56.229410    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:56.337100 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:56.337066    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:56.508827 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:56.508800    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:56.656990 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:56.656951    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:57.011728 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.011673    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:57.110898 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.110861    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:43:57.118784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.118756    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"]
Jul 28 14:43:57.119231 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.119217    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f33f426-cd7c-4390-a58e-b7c373ce78d2" containerName="istio-proxy"
Jul 28 14:43:57.121226 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.121211    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.123882 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.123862    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-baa216-dockercfg-jhjhd\""
Jul 28 14:43:57.124011 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.123976    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-baa216\""
Jul 28 14:43:57.131468 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.131444    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"]
Jul 28 14:43:57.296334 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.296257    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b784962-6fbf-4f08-bf36-6002b05db8ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.296698 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.296362    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47lqt\" (UniqueName: \"kubernetes.io/projected/7b784962-6fbf-4f08-bf36-6002b05db8ce-kube-api-access-47lqt\") pod \"payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.397717 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.397684    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b784962-6fbf-4f08-bf36-6002b05db8ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.397909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.397789    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47lqt\" (UniqueName: \"kubernetes.io/projected/7b784962-6fbf-4f08-bf36-6002b05db8ce-kube-api-access-47lqt\") pod \"payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.398530 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.398506    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b784962-6fbf-4f08-bf36-6002b05db8ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.406125 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.406104    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47lqt\" (UniqueName: \"kubernetes.io/projected/7b784962-6fbf-4f08-bf36-6002b05db8ce-kube-api-access-47lqt\") pod \"payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.433049 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.433003    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:57.573374 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:57.573345    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"]
Jul 28 14:43:57.575556 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:43:57.575528    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b784962_6fbf_4f08_bf36_6002b05db8ce.slice/crio-b5f8bfeca0495227d31342da2f84c89acb3e19c32a32129c59f43398aeaeade3 WatchSource:0}: Error finding container b5f8bfeca0495227d31342da2f84c89acb3e19c32a32129c59f43398aeaeade3: Status 404 returned error can't find the container with id b5f8bfeca0495227d31342da2f84c89acb3e19c32a32129c59f43398aeaeade3
Jul 28 14:43:58.258665 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:58.258627    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g" event={"ID":"7b784962-6fbf-4f08-bf36-6002b05db8ce","Type":"ContainerStarted","Data":"3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e"}
Jul 28 14:43:58.258831 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:58.258687    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g" event={"ID":"7b784962-6fbf-4f08-bf36-6002b05db8ce","Type":"ContainerStarted","Data":"b5f8bfeca0495227d31342da2f84c89acb3e19c32a32129c59f43398aeaeade3"}
Jul 28 14:43:58.258831 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:58.258715    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:43:59.525105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:43:59.525064    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:44:09.266199 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:09.266162    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:44:09.286610 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:09.286563    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g" podStartSLOduration=12.286548205 podStartE2EDuration="12.286548205s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:43:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:43:58.277264625 +0000 UTC m=+2651.511784099" watchObservedRunningTime="2026-07-28 14:44:09.286548205 +0000 UTC m=+2662.521067908"
Jul 28 14:44:11.283192 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:11.283158    2558 patch_prober.go:28] interesting pod/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 14:44:11.283626 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:11.283229    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 14:44:12.335169 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:12.335080    2558 generic.go:356] "Generic (PLEG): container finished" podID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerID="e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92" exitCode=0
Jul 28 14:44:12.335552 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:12.335160    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" event={"ID":"ceda290b-0b5d-470f-a22e-5f1f948f7b39","Type":"ContainerDied","Data":"e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"}
Jul 28 14:44:12.335629 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:12.335612    2558 scope.go:117] "RemoveContainer" containerID="e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"
Jul 28 14:44:12.336727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:12.336701    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:44:12.336791 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:12.336766    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:44:12.336829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:12.336801    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:44:13.341710 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:13.341673    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" event={"ID":"ceda290b-0b5d-470f-a22e-5f1f948f7b39","Type":"ContainerStarted","Data":"d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75"}
Jul 28 14:44:14.182194 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:14.182154    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:44:14.182582 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:14.182551    2558 patch_prober.go:28] interesting pod/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 14:44:14.182662 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:14.182610    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 14:44:15.182975 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:15.182928    2558 patch_prober.go:28] interesting pod/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 14:44:15.183524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:15.182998    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 14:44:16.183174 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:16.182639    2558 patch_prober.go:28] interesting pod/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 14:44:16.183174 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:16.182708    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 14:44:17.183051 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:17.182982    2558 patch_prober.go:28] interesting pod/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Jul 28 14:44:17.183277 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:17.183074    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Jul 28 14:44:17.705902 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:17.705858    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:44:18.186742 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:18.186713    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:44:18.187176 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:18.186972    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:44:18.187599 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:18.187584    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:44:21.402459 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:21.402425    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:44:25.550511 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:25.550477    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:44:47.370575 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:47.370545    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:44:47.375758 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:44:47.375739    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:45:00.146589 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.146546    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"]
Jul 28 14:45:00.149388 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.149371    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"
Jul 28 14:45:00.151846 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.151820    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s8tsp\""
Jul 28 14:45:00.158470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.158445    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"]
Jul 28 14:45:00.160282 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.160265    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"
Jul 28 14:45:00.301194 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.299392    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"]
Jul 28 14:45:00.303085 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:45:00.303055    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod734123f1_6a43_43d9_805e_3d3fd9022a95.slice/crio-25c49ac9b49c53a96c76a71b971eb9254f8ca24049ddd845785b87df2d99eceb WatchSource:0}: Error finding container 25c49ac9b49c53a96c76a71b971eb9254f8ca24049ddd845785b87df2d99eceb: Status 404 returned error can't find the container with id 25c49ac9b49c53a96c76a71b971eb9254f8ca24049ddd845785b87df2d99eceb
Jul 28 14:45:00.588889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:00.588856    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8" event={"ID":"734123f1-6a43-43d9-805e-3d3fd9022a95","Type":"ContainerStarted","Data":"25c49ac9b49c53a96c76a71b971eb9254f8ca24049ddd845785b87df2d99eceb"}
Jul 28 14:45:01.595507 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:01.595470    2558 generic.go:356] "Generic (PLEG): container finished" podID="734123f1-6a43-43d9-805e-3d3fd9022a95" containerID="aea23806cd6f5499d333bd35c74f6e72bab1eaf2cd347d551df16086739d3512" exitCode=0
Jul 28 14:45:01.595956 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:01.595556    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8" event={"ID":"734123f1-6a43-43d9-805e-3d3fd9022a95","Type":"ContainerDied","Data":"aea23806cd6f5499d333bd35c74f6e72bab1eaf2cd347d551df16086739d3512"}
Jul 28 14:45:02.736811 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:02.736786    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"
Jul 28 14:45:03.607055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:03.606941    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"
Jul 28 14:45:03.607055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:03.606936    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8" event={"ID":"734123f1-6a43-43d9-805e-3d3fd9022a95","Type":"ContainerDied","Data":"25c49ac9b49c53a96c76a71b971eb9254f8ca24049ddd845785b87df2d99eceb"}
Jul 28 14:45:03.607238 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:03.607087    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25c49ac9b49c53a96c76a71b971eb9254f8ca24049ddd845785b87df2d99eceb"
Jul 28 14:45:11.249597 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:45:11.249562    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:46:29.129562 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:46:29.129465    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:47:47.643099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:47:47.642990    2558 scope.go:117] "RemoveContainer" containerID="e40a8669e276d7aea6d4cabcd8aae9c2b870bf261c6bae0f0dd7adf9ed27477b"
Jul 28 14:48:04.736304 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:48:04.736269    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:49:20.187904 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:20.187866    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:49:24.248281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:24.248247    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:49:46.179457 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:46.179416    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:49:46.278213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:46.278180    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:49:47.404756 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:47.404723    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:49:47.411544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:47.411517    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:49:52.148985 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:52.148928    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:49:53.171999 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:49:53.171966    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:50:04.313288 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:50:04.313249    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:50:23.487750 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:50:23.487716    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:51:23.342517 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:23.342474    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:51:24.322330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:24.322300    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:51:32.942280 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.942242    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"]
Jul 28 14:51:32.942775 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.942636    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="734123f1-6a43-43d9-805e-3d3fd9022a95" containerName="cleanup"
Jul 28 14:51:32.942775 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.942648    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="734123f1-6a43-43d9-805e-3d3fd9022a95" containerName="cleanup"
Jul 28 14:51:32.942775 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.942751    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="734123f1-6a43-43d9-805e-3d3fd9022a95" containerName="cleanup"
Jul 28 14:51:32.953301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.953268    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:32.955675 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.955640    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"]
Jul 28 14:51:32.955842 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.955756    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-910fb6\"/\"openshift-service-ca.crt\""
Jul 28 14:51:32.955914 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.955756    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-910fb6\"/\"kube-root-ca.crt\""
Jul 28 14:51:32.956670 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.956648    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-910fb6\"/\"default-dockercfg-hnx2r\""
Jul 28 14:51:32.956794 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.956648    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-910fb6\"/\"rate-test-model-910fb6-kserve-self-signed-certs\""
Jul 28 14:51:32.993235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.993205    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj7rz\" (UniqueName: \"kubernetes.io/projected/fde922a0-303b-4cb3-b21b-16048e50cdea-kube-api-access-cj7rz\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:32.993370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.993247    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-home\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:32.993370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.993318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-model-cache\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:32.993370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.993334    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-dshm\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:32.993370 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.993353    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-tmp-dir\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:32.993509 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:32.993397    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde922a0-303b-4cb3-b21b-16048e50cdea-tls-certs\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.080201 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.080173    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:51:33.094472 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094444    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-model-cache\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094619 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094479    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-dshm\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094619 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094499    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-tmp-dir\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094619 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094593    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde922a0-303b-4cb3-b21b-16048e50cdea-tls-certs\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094653    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj7rz\" (UniqueName: \"kubernetes.io/projected/fde922a0-303b-4cb3-b21b-16048e50cdea-kube-api-access-cj7rz\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094784 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094678    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-home\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094896 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094857    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-model-cache\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.094953 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.094921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-tmp-dir\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.095074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.095057    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-home\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.096913 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.096893    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-dshm\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.097305 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.097285    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde922a0-303b-4cb3-b21b-16048e50cdea-tls-certs\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.103004 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.102987    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj7rz\" (UniqueName: \"kubernetes.io/projected/fde922a0-303b-4cb3-b21b-16048e50cdea-kube-api-access-cj7rz\") pod \"rate-test-model-910fb6-kserve-649486cfd7-pr9lx\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") " pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.263484 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.263451    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:33.406636 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.406609    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"]
Jul 28 14:51:33.408896 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:51:33.408865    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfde922a0_303b_4cb3_b21b_16048e50cdea.slice/crio-5d0fb23be5fbd90874e50d5ea5af6b51180e24bf146758a70b5fba5127a62c1c WatchSource:0}: Error finding container 5d0fb23be5fbd90874e50d5ea5af6b51180e24bf146758a70b5fba5127a62c1c: Status 404 returned error can't find the container with id 5d0fb23be5fbd90874e50d5ea5af6b51180e24bf146758a70b5fba5127a62c1c
Jul 28 14:51:33.634785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.634694    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx" event={"ID":"fde922a0-303b-4cb3-b21b-16048e50cdea","Type":"ContainerStarted","Data":"8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c"}
Jul 28 14:51:33.634785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.634736    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx" event={"ID":"fde922a0-303b-4cb3-b21b-16048e50cdea","Type":"ContainerStarted","Data":"5d0fb23be5fbd90874e50d5ea5af6b51180e24bf146758a70b5fba5127a62c1c"}
Jul 28 14:51:33.655086 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:33.655003    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx" podStartSLOduration=1.654986354 podStartE2EDuration="1.654986354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:51:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:51:33.652898567 +0000 UTC m=+3106.887418036" watchObservedRunningTime="2026-07-28 14:51:33.654986354 +0000 UTC m=+3106.889505825"
Jul 28 14:51:43.263599 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:43.263564    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:43.264078 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:43.263615    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:43.284299 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:43.284268    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:51:43.703706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:51:43.703609    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:52:23.641826 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:52:23.641698    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:31.687233 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:31.687195    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"]
Jul 28 14:53:31.707502 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:31.707472    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:32.545393 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:32.545353    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:46.706401 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:46.706256    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx" podUID="fde922a0-303b-4cb3-b21b-16048e50cdea" containerName="main" containerID="cri-o://8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c" gracePeriod=45
Jul 28 14:53:46.961418 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:46.961357    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:53:47.014631 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014599    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-dshm\") pod \"fde922a0-303b-4cb3-b21b-16048e50cdea\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") "
Jul 28 14:53:47.014819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014655    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-model-cache\") pod \"fde922a0-303b-4cb3-b21b-16048e50cdea\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") "
Jul 28 14:53:47.014819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014717    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-tmp-dir\") pod \"fde922a0-303b-4cb3-b21b-16048e50cdea\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") "
Jul 28 14:53:47.014819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014751    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj7rz\" (UniqueName: \"kubernetes.io/projected/fde922a0-303b-4cb3-b21b-16048e50cdea-kube-api-access-cj7rz\") pod \"fde922a0-303b-4cb3-b21b-16048e50cdea\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") "
Jul 28 14:53:47.014819 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014796    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-home\") pod \"fde922a0-303b-4cb3-b21b-16048e50cdea\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") "
Jul 28 14:53:47.015074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014824    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde922a0-303b-4cb3-b21b-16048e50cdea-tls-certs\") pod \"fde922a0-303b-4cb3-b21b-16048e50cdea\" (UID: \"fde922a0-303b-4cb3-b21b-16048e50cdea\") "
Jul 28 14:53:47.015074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.014994    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-model-cache" (OuterVolumeSpecName: "model-cache") pod "fde922a0-303b-4cb3-b21b-16048e50cdea" (UID: "fde922a0-303b-4cb3-b21b-16048e50cdea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:53:47.015074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.015006    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fde922a0-303b-4cb3-b21b-16048e50cdea" (UID: "fde922a0-303b-4cb3-b21b-16048e50cdea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:53:47.015279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.015254    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-home" (OuterVolumeSpecName: "home") pod "fde922a0-303b-4cb3-b21b-16048e50cdea" (UID: "fde922a0-303b-4cb3-b21b-16048e50cdea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:53:47.015352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.015305    2558 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-model-cache\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:53:47.015352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.015325    2558 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-tmp-dir\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:53:47.016938 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.016904    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-dshm" (OuterVolumeSpecName: "dshm") pod "fde922a0-303b-4cb3-b21b-16048e50cdea" (UID: "fde922a0-303b-4cb3-b21b-16048e50cdea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:53:47.017168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.017139    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fde922a0-303b-4cb3-b21b-16048e50cdea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fde922a0-303b-4cb3-b21b-16048e50cdea" (UID: "fde922a0-303b-4cb3-b21b-16048e50cdea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 14:53:47.017233 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.017167    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fde922a0-303b-4cb3-b21b-16048e50cdea-kube-api-access-cj7rz" (OuterVolumeSpecName: "kube-api-access-cj7rz") pod "fde922a0-303b-4cb3-b21b-16048e50cdea" (UID: "fde922a0-303b-4cb3-b21b-16048e50cdea"). InnerVolumeSpecName "kube-api-access-cj7rz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:53:47.116544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.116505    2558 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-dshm\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:53:47.116544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.116538    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj7rz\" (UniqueName: \"kubernetes.io/projected/fde922a0-303b-4cb3-b21b-16048e50cdea-kube-api-access-cj7rz\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:53:47.116544 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.116550    2558 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fde922a0-303b-4cb3-b21b-16048e50cdea-home\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:53:47.116792 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.116558    2558 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fde922a0-303b-4cb3-b21b-16048e50cdea-tls-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:53:47.336313 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.336277    2558 generic.go:356] "Generic (PLEG): container finished" podID="fde922a0-303b-4cb3-b21b-16048e50cdea" containerID="8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c" exitCode=0
Jul 28 14:53:47.336510 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.336332    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx" event={"ID":"fde922a0-303b-4cb3-b21b-16048e50cdea","Type":"ContainerDied","Data":"8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c"}
Jul 28 14:53:47.336510 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.336338    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"
Jul 28 14:53:47.336510 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.336374    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx" event={"ID":"fde922a0-303b-4cb3-b21b-16048e50cdea","Type":"ContainerDied","Data":"5d0fb23be5fbd90874e50d5ea5af6b51180e24bf146758a70b5fba5127a62c1c"}
Jul 28 14:53:47.336510 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.336398    2558 scope.go:117] "RemoveContainer" containerID="8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c"
Jul 28 14:53:47.345394 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.345378    2558 scope.go:117] "RemoveContainer" containerID="8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c"
Jul 28 14:53:47.345648 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:53:47.345624    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c\": container with ID starting with 8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c not found: ID does not exist" containerID="8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c"
Jul 28 14:53:47.345752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.345656    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c"} err="failed to get container status \"8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c\": rpc error: code = NotFound desc = could not find container \"8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c\": container with ID starting with 8e2a2d78fda85367c4b2c003e6229a67f25433111c167e54762342839e865f7c not found: ID does not exist"
Jul 28 14:53:47.356484 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.356450    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"]
Jul 28 14:53:47.361068 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:47.361044    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-910fb6/rate-test-model-910fb6-kserve-649486cfd7-pr9lx"]
Jul 28 14:53:49.283959 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:49.283921    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fde922a0-303b-4cb3-b21b-16048e50cdea" path="/var/lib/kubelet/pods/fde922a0-303b-4cb3-b21b-16048e50cdea/volumes"
Jul 28 14:53:51.840539 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:51.840483    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:52.156347 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:52.156259    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:52.392270 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:52.392218    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:55.593770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:55.593734    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:55.686144 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:55.686112    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:55.831818 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:55.831778    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:56.059283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.059251    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:56.433417 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.433305    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:56.531982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.531937    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:53:56.544865 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.544840    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"]
Jul 28 14:53:56.545394 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.545370    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fde922a0-303b-4cb3-b21b-16048e50cdea" containerName="main"
Jul 28 14:53:56.545394 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.545394    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="fde922a0-303b-4cb3-b21b-16048e50cdea" containerName="main"
Jul 28 14:53:56.545557 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.545542    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="fde922a0-303b-4cb3-b21b-16048e50cdea" containerName="main"
Jul 28 14:53:56.550242 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.550225    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.552726 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.552699    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-18ece0\""
Jul 28 14:53:56.560235 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.560214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"]
Jul 28 14:53:56.570773 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.570743    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"]
Jul 28 14:53:56.574452 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.574427    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.577013 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.576980    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-18ece0-dockercfg-srshc\""
Jul 28 14:53:56.585259 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.584976    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"]
Jul 28 14:53:56.610009 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.609980    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.610403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.610113    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbr2l\" (UniqueName: \"kubernetes.io/projected/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-kube-api-access-xbr2l\") pod \"payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.711524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.711436    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbr2l\" (UniqueName: \"kubernetes.io/projected/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-kube-api-access-xbr2l\") pod \"payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.711524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.711485    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d596f472-80bf-4d4a-997e-fe31db05168f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.711713 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.711562    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.711713 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.711589    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tw974\" (UniqueName: \"kubernetes.io/projected/d596f472-80bf-4d4a-997e-fe31db05168f-kube-api-access-tw974\") pod \"payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.712247 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.712229    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.720414 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.720389    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbr2l\" (UniqueName: \"kubernetes.io/projected/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-kube-api-access-xbr2l\") pod \"payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.812494 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.812456    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tw974\" (UniqueName: \"kubernetes.io/projected/d596f472-80bf-4d4a-997e-fe31db05168f-kube-api-access-tw974\") pod \"payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.812658 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.812540    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d596f472-80bf-4d4a-997e-fe31db05168f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.813320 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.813301    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d596f472-80bf-4d4a-997e-fe31db05168f-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.821139 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.821116    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tw974\" (UniqueName: \"kubernetes.io/projected/d596f472-80bf-4d4a-997e-fe31db05168f-kube-api-access-tw974\") pod \"payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:56.862008 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.861978    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:56.890204 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:56.890177    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:57.016464 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.016438    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"]
Jul 28 14:53:57.019409 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:53:57.019371    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74ccdab_3c5d_49df_bdfe_34ab6016cd9e.slice/crio-af4c8cbf90f8e28729ea81e9c033d64383eb3277b0881365c2c6497388dac296 WatchSource:0}: Error finding container af4c8cbf90f8e28729ea81e9c033d64383eb3277b0881365c2c6497388dac296: Status 404 returned error can't find the container with id af4c8cbf90f8e28729ea81e9c033d64383eb3277b0881365c2c6497388dac296
Jul 28 14:53:57.257079 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.257052    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"]
Jul 28 14:53:57.258622 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:53:57.258596    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd596f472_80bf_4d4a_997e_fe31db05168f.slice/crio-52dbb0374dfbc379a0c36210d03bb348bc9aadf8a11c4879a21a5e48c1b707f1 WatchSource:0}: Error finding container 52dbb0374dfbc379a0c36210d03bb348bc9aadf8a11c4879a21a5e48c1b707f1: Status 404 returned error can't find the container with id 52dbb0374dfbc379a0c36210d03bb348bc9aadf8a11c4879a21a5e48c1b707f1
Jul 28 14:53:57.393874 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.393829    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh" event={"ID":"d596f472-80bf-4d4a-997e-fe31db05168f","Type":"ContainerStarted","Data":"ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6"}
Jul 28 14:53:57.394077 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.393895    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh" event={"ID":"d596f472-80bf-4d4a-997e-fe31db05168f","Type":"ContainerStarted","Data":"52dbb0374dfbc379a0c36210d03bb348bc9aadf8a11c4879a21a5e48c1b707f1"}
Jul 28 14:53:57.394077 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.393985    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:53:57.395598 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.395568    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn" event={"ID":"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e","Type":"ContainerStarted","Data":"2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654"}
Jul 28 14:53:57.395735 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.395615    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn" event={"ID":"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e","Type":"ContainerStarted","Data":"af4c8cbf90f8e28729ea81e9c033d64383eb3277b0881365c2c6497388dac296"}
Jul 28 14:53:57.395735 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.395680    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:53:57.413118 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.413066    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh" podStartSLOduration=1.413053478 podStartE2EDuration="1.413053478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:53:57.41107114 +0000 UTC m=+3250.645590613" watchObservedRunningTime="2026-07-28 14:53:57.413053478 +0000 UTC m=+3250.647572949"
Jul 28 14:53:57.427987 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:53:57.427945    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn" podStartSLOduration=1.427930406 podStartE2EDuration="1.427930406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:53:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:53:57.426763889 +0000 UTC m=+3250.661283362" watchObservedRunningTime="2026-07-28 14:53:57.427930406 +0000 UTC m=+3250.662449879"
Jul 28 14:54:08.403909 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:08.403878    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:54:08.404528 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:08.404072    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:54:20.636367 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:20.636332    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:21.355830 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.355798    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:21.673153 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.673054    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"]
Jul 28 14:54:21.677335 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.677310    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.679826 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.679803    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-fd71df-openshift-default-dockercfg-dmnkz\""
Jul 28 14:54:21.690236 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.690214    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"]
Jul 28 14:54:21.759099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-certs\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759099 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759105    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-istio-token\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-envoy\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759217    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-data\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759260    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a42f7cc-82f9-4f83-beea-48503064174b-istiod-ca-cert\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759287    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-credential-socket\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759331    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-socket\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759371 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a42f7cc-82f9-4f83-beea-48503064174b-istio-podinfo\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.759594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.759386    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjdfx\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-kube-api-access-qjdfx\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861239    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-envoy\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861346    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-data\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861384    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a42f7cc-82f9-4f83-beea-48503064174b-istiod-ca-cert\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861414    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-credential-socket\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861458    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-socket\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861485    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a42f7cc-82f9-4f83-beea-48503064174b-istio-podinfo\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861530    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjdfx\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-kube-api-access-qjdfx\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861622    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-certs\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.863057 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.861671    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-istio-token\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.866250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.864971    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-envoy\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.866250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.865279    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-data\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.866250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.865933    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a42f7cc-82f9-4f83-beea-48503064174b-istiod-ca-cert\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.866250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.866100    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-socket\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.866250 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.866142    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-certs\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.866647 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.866620    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-credential-socket\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.869279 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.869254    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a42f7cc-82f9-4f83-beea-48503064174b-istio-podinfo\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.875058 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.875001    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-istio-token\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.876745 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.876723    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjdfx\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-kube-api-access-qjdfx\") pod \"e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") " pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:21.991252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:21.991161    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:22.142185 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.142159    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"]
Jul 28 14:54:22.143911 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:54:22.143884    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a42f7cc_82f9_4f83_beea_48503064174b.slice/crio-885f4a67c5e39c99fe7a383ae334030da07fb57a9cb7a457b7eb0b3f467d428e WatchSource:0}: Error finding container 885f4a67c5e39c99fe7a383ae334030da07fb57a9cb7a457b7eb0b3f467d428e: Status 404 returned error can't find the container with id 885f4a67c5e39c99fe7a383ae334030da07fb57a9cb7a457b7eb0b3f467d428e
Jul 28 14:54:22.146102 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.146070    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:54:22.146184 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.146140    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:54:22.146184 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.146169    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:54:22.530047 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.530004    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:22.537303 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.537276    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" event={"ID":"6a42f7cc-82f9-4f83-beea-48503064174b","Type":"ContainerStarted","Data":"ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"}
Jul 28 14:54:22.537445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.537327    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" event={"ID":"6a42f7cc-82f9-4f83-beea-48503064174b","Type":"ContainerStarted","Data":"885f4a67c5e39c99fe7a383ae334030da07fb57a9cb7a457b7eb0b3f467d428e"}
Jul 28 14:54:22.558918 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.558864    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podStartSLOduration=1.558846443 podStartE2EDuration="1.558846443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:54:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:54:22.557977147 +0000 UTC m=+3275.792496618" watchObservedRunningTime="2026-07-28 14:54:22.558846443 +0000 UTC m=+3275.793365906"
Jul 28 14:54:22.991789 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:22.991758    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:23.637152 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:23.637116    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:23.997114 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:23.997086    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:24.548760 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:24.548728    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:24.549621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:24.549597    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:24.555319 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:24.555295    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:24.654287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:24.654254    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:26.251602 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:26.251568    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:26.404604 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:26.404574    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:26.751691 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:26.751656    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:26.850911 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:26.850866    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:39.338065 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:39.338031    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:54:40.590213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:40.590163    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 28 14:54:40.590632 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:40.590238    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 28 14:54:42.645642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:42.645560    2558 generic.go:356] "Generic (PLEG): container finished" podID="6a42f7cc-82f9-4f83-beea-48503064174b" containerID="ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0" exitCode=0
Jul 28 14:54:42.645642 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:42.645616    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" event={"ID":"6a42f7cc-82f9-4f83-beea-48503064174b","Type":"ContainerDied","Data":"ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"}
Jul 28 14:54:42.646129 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:42.646075    2558 scope.go:117] "RemoveContainer" containerID="ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"
Jul 28 14:54:42.647213 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:42.647184    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:54:42.647312 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:42.647255    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:54:42.647312 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:42.647286    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:54:43.652411 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:43.652371    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" event={"ID":"6a42f7cc-82f9-4f83-beea-48503064174b","Type":"ContainerStarted","Data":"e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d"}
Jul 28 14:54:43.991807 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:43.991775    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:43.992203 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:43.992117    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 28 14:54:43.992390 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:43.992368    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 28 14:54:44.992545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:44.992504    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 28 14:54:44.993764 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:44.993727    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 28 14:54:45.992535 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:45.992491    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 28 14:54:45.992774 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:45.992559    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 28 14:54:46.992756 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:46.992708    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Jul 28 14:54:46.993094 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:46.993059    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Jul 28 14:54:47.444708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:47.444628    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:54:47.449438 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:47.449416    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j2qbx_c8d4e7a4-f8bf-4673-90bc-fe4f05155d60/ovn-acl-logging/0.log"
Jul 28 14:54:47.996167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:47.996135    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:47.996653 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:47.996443    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:47.997274 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:47.997252    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:54:58.128715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:54:58.128679    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:43.804406 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:43.804285    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh_d596f472-80bf-4d4a-997e-fe31db05168f/payload-processing/0.log"
Jul 28 14:55:44.361463 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.361423    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:44.636597 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.636513    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"]
Jul 28 14:55:44.642497 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.642458    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.645695 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.645670    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-694dae-openshift-default-dockercfg-989f5\""
Jul 28 14:55:44.653971 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.653947    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"]
Jul 28 14:55:44.657068 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.657043    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:44.768718 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.768676    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-token\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.768926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.768782    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-credential-socket\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.768926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.768801    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-data\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.768926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.768818    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-socket\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.768926 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.768901    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-podinfo\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.769198 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.768939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-certs\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.769198 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.769005    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.769198 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.769104    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-envoy\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.769198 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.769153    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jfjd\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-kube-api-access-2jfjd\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.828338 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.828280    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:44.870576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870531    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-podinfo\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.870576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870581    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-certs\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.870804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870621    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.870804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870679    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-envoy\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.870804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870719    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jfjd\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-kube-api-access-2jfjd\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.870804 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870752    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-token\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871014 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870867    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-credential-socket\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871014 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870896    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-data\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871014 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.870923    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-socket\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871403 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.871371    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-credential-socket\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871563 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.871411    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-certs\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871563 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.871554    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istiod-ca-cert\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.871429    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-socket\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.871693 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.871458    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-data\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.873508 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.873472    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-envoy\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.873683 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.873667    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-podinfo\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.880943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.880921    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-token\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.881398 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.881379    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jfjd\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-kube-api-access-2jfjd\") pod \"e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") " pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:44.955542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:44.955468    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:45.106845 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:45.106820    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"]
Jul 28 14:55:45.108608 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:55:45.108583    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1ffe0b_72f3_4cb7_b277_0817c2e49f5b.slice/crio-d2dbd93eba6c3846d01aa5b404dfd29ef53dc529b1ea2b337e4a5920eae88bd3 WatchSource:0}: Error finding container d2dbd93eba6c3846d01aa5b404dfd29ef53dc529b1ea2b337e4a5920eae88bd3: Status 404 returned error can't find the container with id d2dbd93eba6c3846d01aa5b404dfd29ef53dc529b1ea2b337e4a5920eae88bd3
Jul 28 14:55:45.110867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:45.110839    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:55:45.110943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:45.110901    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:55:45.110943 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:45.110931    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:55:45.998082 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:45.998039    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" event={"ID":"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b","Type":"ContainerStarted","Data":"cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"}
Jul 28 14:55:45.998529 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:45.998105    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" event={"ID":"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b","Type":"ContainerStarted","Data":"d2dbd93eba6c3846d01aa5b404dfd29ef53dc529b1ea2b337e4a5920eae88bd3"}
Jul 28 14:55:46.022727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:46.022675    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" podStartSLOduration=2.022659467 podStartE2EDuration="2.022659467s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:46.02142467 +0000 UTC m=+3359.255944141" watchObservedRunningTime="2026-07-28 14:55:46.022659467 +0000 UTC m=+3359.257178939"
Jul 28 14:55:46.956579 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:46.956541    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:46.961436 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:46.961408    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:47.003493 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:47.003459    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:47.004326 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:47.004305    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:55:48.088284 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:48.088253    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:48.188433 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:48.188398    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:48.960991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:48.960958    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:49.287281 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.287250    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:49.623352 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.623270    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:49.725782 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.725707    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:55:49.742419 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.742390    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"]
Jul 28 14:55:49.746143 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.746120    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:49.749114 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.749091    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-694dae\""
Jul 28 14:55:49.749221 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.749204    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-694dae-dockercfg-kdjxv\""
Jul 28 14:55:49.762704 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.762682    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"]
Jul 28 14:55:49.819953 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.819919    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:49.820120 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.819993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-kube-api-access-t2nt7\") pod \"payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:49.920822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.920734    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:49.920822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.920796    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-kube-api-access-t2nt7\") pod \"payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:49.921503 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.921481    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:49.930256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:49.930225    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-kube-api-access-t2nt7\") pod \"payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:50.057330 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:50.057298    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:50.199571 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:50.199539    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"]
Jul 28 14:55:50.201363 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:55:50.201335    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12ef0fd9_44b0_49b9_8783_4f46d3ec3f02.slice/crio-978bcaffe88fb373b4677881830372d28e6aa4d395946884bbe9cb13711b8fa9 WatchSource:0}: Error finding container 978bcaffe88fb373b4677881830372d28e6aa4d395946884bbe9cb13711b8fa9: Status 404 returned error can't find the container with id 978bcaffe88fb373b4677881830372d28e6aa4d395946884bbe9cb13711b8fa9
Jul 28 14:55:51.025454 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:51.025416    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr" event={"ID":"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02","Type":"ContainerStarted","Data":"676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592"}
Jul 28 14:55:51.025885 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:51.025467    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr" event={"ID":"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02","Type":"ContainerStarted","Data":"978bcaffe88fb373b4677881830372d28e6aa4d395946884bbe9cb13711b8fa9"}
Jul 28 14:55:51.025885 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:51.025561    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:55:51.043651 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:55:51.043609    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr" podStartSLOduration=2.043592891 podStartE2EDuration="2.043592891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 14:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:55:51.043308961 +0000 UTC m=+3364.277828432" watchObservedRunningTime="2026-07-28 14:55:51.043592891 +0000 UTC m=+3364.278112363"
Jul 28 14:56:02.032954 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:02.032923    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:56:02.778358 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:02.778309    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:06.119402 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:06.119365    2558 generic.go:356] "Generic (PLEG): container finished" podID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerID="cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d" exitCode=0
Jul 28 14:56:06.119811 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:06.119438    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" event={"ID":"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b","Type":"ContainerDied","Data":"cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"}
Jul 28 14:56:06.119855 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:06.119845    2558 scope.go:117] "RemoveContainer" containerID="cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"
Jul 28 14:56:06.121040 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:06.120994    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:56:06.121112 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:06.121083    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:56:06.121149 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:06.121117    2558 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 28 14:56:07.131207 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:07.131169    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" event={"ID":"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b","Type":"ContainerStarted","Data":"eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc"}
Jul 28 14:56:07.956062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:07.955992    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:56:07.956262 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:07.956234    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 28 14:56:07.956310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:07.956281    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 28 14:56:08.956594 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:08.956551    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 28 14:56:08.957000 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:08.956629    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 28 14:56:09.956121 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:09.956078    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 28 14:56:09.956320 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:09.956146    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 28 14:56:10.956325 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:10.956287    2558 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Jul 28 14:56:10.956743 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:10.956344    2558 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Jul 28 14:56:11.585415 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.585376    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:11.652671 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.652632    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"]
Jul 28 14:56:11.652924 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.652892    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr" podUID="12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" containerName="payload-pre-processing" containerID="cri-o://676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592" gracePeriod=30
Jul 28 14:56:11.687182 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.687148    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:11.763890 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.763860    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:11.867353 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.865361    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:11.929495 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.929470    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:56:11.961080 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.961054    2558 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:56:11.961542 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.961526    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:56:11.962345 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:11.962324    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:56:12.051520 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.051487    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-plugins-config-volume\") pod \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") "
Jul 28 14:56:12.051703 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.051584    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-kube-api-access-t2nt7\") pod \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\" (UID: \"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02\") "
Jul 28 14:56:12.051889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.051860    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" (UID: "12ef0fd9-44b0-49b9-8783-4f46d3ec3f02"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:56:12.052105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.052083    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:12.053766 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.053749    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-kube-api-access-t2nt7" (OuterVolumeSpecName: "kube-api-access-t2nt7") pod "12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" (UID: "12ef0fd9-44b0-49b9-8783-4f46d3ec3f02"). InnerVolumeSpecName "kube-api-access-t2nt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:56:12.152670 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.152585    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02-kube-api-access-t2nt7\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:12.161995 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.161957    2558 generic.go:356] "Generic (PLEG): container finished" podID="12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" containerID="676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592" exitCode=0
Jul 28 14:56:12.162183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.162011    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"
Jul 28 14:56:12.162183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.162048    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr" event={"ID":"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02","Type":"ContainerDied","Data":"676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592"}
Jul 28 14:56:12.162183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.162106    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr" event={"ID":"12ef0fd9-44b0-49b9-8783-4f46d3ec3f02","Type":"ContainerDied","Data":"978bcaffe88fb373b4677881830372d28e6aa4d395946884bbe9cb13711b8fa9"}
Jul 28 14:56:12.162183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.162137    2558 scope.go:117] "RemoveContainer" containerID="676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592"
Jul 28 14:56:12.171364 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.171345    2558 scope.go:117] "RemoveContainer" containerID="676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592"
Jul 28 14:56:12.171610 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:56:12.171586    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592\": container with ID starting with 676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592 not found: ID does not exist" containerID="676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592"
Jul 28 14:56:12.171706 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.171616    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592"} err="failed to get container status \"676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592\": rpc error: code = NotFound desc = could not find container \"676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592\": container with ID starting with 676a5c9c088908161f1abccb1e2cb189d332ff55a42f67529197e7b2eed61592 not found: ID does not exist"
Jul 28 14:56:12.189848 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.189822    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"]
Jul 28 14:56:12.195166 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.195144    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-694dae-5c4488f44d-vnfpr"]
Jul 28 14:56:12.280641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:12.280597    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:13.285255 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:13.285219    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" path="/var/lib/kubelet/pods/12ef0fd9-44b0-49b9-8783-4f46d3ec3f02/volumes"
Jul 28 14:56:19.426194 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:19.426147    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:19.488580 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:19.488547    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:19.713892 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:19.713803    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"]
Jul 28 14:56:19.714060 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:19.714041    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy" containerID="cri-o://eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc" gracePeriod=30
Jul 28 14:56:19.735843 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:19.735809    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:20.014980 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:20.014944    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:20.542931 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:20.542898    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:24.978346 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.978275    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:56:24.985251 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985226    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-token\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985408 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985258    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-envoy\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985408 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985314    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-socket\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985408 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985348    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-certs\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985408 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985367    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2jfjd\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-kube-api-access-2jfjd\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985432    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-podinfo\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985477    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-credential-socket\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985508    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-data\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985546    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istiod-ca-cert\") pod \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\" (UID: \"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b\") "
Jul 28 14:56:24.985871 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985646    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:56:24.985985 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.985949    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:24.986151 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.986042    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:56:24.986287 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.986264    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:56:24.986498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.986453    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:56:24.986498 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.986459    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:56:24.988054 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.988006    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:56:24.988157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.988114    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:56:24.988236 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.988196    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-kube-api-access-2jfjd" (OuterVolumeSpecName: "kube-api-access-2jfjd") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "kube-api-access-2jfjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:56:24.988554 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:24.988522    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" (UID: "6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:56:25.086815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086782    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.086815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086811    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2jfjd\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-kube-api-access-2jfjd\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.086815 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086823    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.087074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086832    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.087074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086840    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.087074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086848    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.087074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086855    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.087074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.086863    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:25.233431 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.233344    2558 generic.go:356] "Generic (PLEG): container finished" podID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerID="eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc" exitCode=0
Jul 28 14:56:25.233431 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.233395    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"
Jul 28 14:56:25.233431 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.233403    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" event={"ID":"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b","Type":"ContainerDied","Data":"eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc"}
Jul 28 14:56:25.233664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.233446    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn" event={"ID":"6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b","Type":"ContainerDied","Data":"d2dbd93eba6c3846d01aa5b404dfd29ef53dc529b1ea2b337e4a5920eae88bd3"}
Jul 28 14:56:25.233664 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.233467    2558 scope.go:117] "RemoveContainer" containerID="eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc"
Jul 28 14:56:25.243247 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.243230    2558 scope.go:117] "RemoveContainer" containerID="cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"
Jul 28 14:56:25.251770 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.251753    2558 scope.go:117] "RemoveContainer" containerID="eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc"
Jul 28 14:56:25.252076 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:56:25.252051    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc\": container with ID starting with eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc not found: ID does not exist" containerID="eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc"
Jul 28 14:56:25.252179 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.252079    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc"} err="failed to get container status \"eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc\": rpc error: code = NotFound desc = could not find container \"eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc\": container with ID starting with eaca299d31dee3517d8293932a5d3031fe8bf36debe2b9be5bb6449c21f88ecc not found: ID does not exist"
Jul 28 14:56:25.252179 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.252097    2558 scope.go:117] "RemoveContainer" containerID="cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"
Jul 28 14:56:25.252324 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:56:25.252300    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d\": container with ID starting with cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d not found: ID does not exist" containerID="cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"
Jul 28 14:56:25.252381 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.252336    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d"} err="failed to get container status \"cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d\": rpc error: code = NotFound desc = could not find container \"cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d\": container with ID starting with cc641afcc4d8e15e6d6f0c731f3900378554b75775220ac3dfa318ed627f8f3d not found: ID does not exist"
Jul 28 14:56:25.257607 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.257584    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"]
Jul 28 14:56:25.262218 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.262198    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-694dae-openshift-default-56f878f86b-prpgn"]
Jul 28 14:56:25.283420 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:25.283389    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" path="/var/lib/kubelet/pods/6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b/volumes"
Jul 28 14:56:38.622146 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.622103    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:38.639490 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.639037    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"]
Jul 28 14:56:38.639490 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.639399    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh" podUID="d596f472-80bf-4d4a-997e-fe31db05168f" containerName="payload-processing" containerID="cri-o://ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6" gracePeriod=30
Jul 28 14:56:38.646816 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.646782    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"]
Jul 28 14:56:38.647087 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.647058    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn" podUID="b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" containerName="payload-pre-processing" containerID="cri-o://2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654" gracePeriod=30
Jul 28 14:56:38.684252 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.684227    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:38.757134 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.757102    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:38.948047 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.947842    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:56:38.962608 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.962576    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:38.978412 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:38.978384    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:56:39.024478 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.024446    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbr2l\" (UniqueName: \"kubernetes.io/projected/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-kube-api-access-xbr2l\") pod \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") "
Jul 28 14:56:39.024679 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.024539    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tw974\" (UniqueName: \"kubernetes.io/projected/d596f472-80bf-4d4a-997e-fe31db05168f-kube-api-access-tw974\") pod \"d596f472-80bf-4d4a-997e-fe31db05168f\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") "
Jul 28 14:56:39.024679 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.024605    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-plugins-config-volume\") pod \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\" (UID: \"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e\") "
Jul 28 14:56:39.024679 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.024675    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d596f472-80bf-4d4a-997e-fe31db05168f-plugins-config-volume\") pod \"d596f472-80bf-4d4a-997e-fe31db05168f\" (UID: \"d596f472-80bf-4d4a-997e-fe31db05168f\") "
Jul 28 14:56:39.024986 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.024954    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" (UID: "b74ccdab-3c5d-49df-bdfe-34ab6016cd9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:56:39.025157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.025040    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d596f472-80bf-4d4a-997e-fe31db05168f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d596f472-80bf-4d4a-997e-fe31db05168f" (UID: "d596f472-80bf-4d4a-997e-fe31db05168f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:56:39.025157 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.025113    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:39.026550 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.026528    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d596f472-80bf-4d4a-997e-fe31db05168f-kube-api-access-tw974" (OuterVolumeSpecName: "kube-api-access-tw974") pod "d596f472-80bf-4d4a-997e-fe31db05168f" (UID: "d596f472-80bf-4d4a-997e-fe31db05168f"). InnerVolumeSpecName "kube-api-access-tw974". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:56:39.026614 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.026535    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-kube-api-access-xbr2l" (OuterVolumeSpecName: "kube-api-access-xbr2l") pod "b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" (UID: "b74ccdab-3c5d-49df-bdfe-34ab6016cd9e"). InnerVolumeSpecName "kube-api-access-xbr2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:56:39.125930 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.125893    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d596f472-80bf-4d4a-997e-fe31db05168f-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:39.125930 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.125924    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbr2l\" (UniqueName: \"kubernetes.io/projected/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e-kube-api-access-xbr2l\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:39.125930 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.125934    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tw974\" (UniqueName: \"kubernetes.io/projected/d596f472-80bf-4d4a-997e-fe31db05168f-kube-api-access-tw974\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:56:39.307590 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.307559    2558 generic.go:356] "Generic (PLEG): container finished" podID="d596f472-80bf-4d4a-997e-fe31db05168f" containerID="ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6" exitCode=0
Jul 28 14:56:39.307715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.307607    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"
Jul 28 14:56:39.307715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.307632    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh" event={"ID":"d596f472-80bf-4d4a-997e-fe31db05168f","Type":"ContainerDied","Data":"ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6"}
Jul 28 14:56:39.307715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.307679    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh" event={"ID":"d596f472-80bf-4d4a-997e-fe31db05168f","Type":"ContainerDied","Data":"52dbb0374dfbc379a0c36210d03bb348bc9aadf8a11c4879a21a5e48c1b707f1"}
Jul 28 14:56:39.307715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.307702    2558 scope.go:117] "RemoveContainer" containerID="ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6"
Jul 28 14:56:39.309050 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.309012    2558 generic.go:356] "Generic (PLEG): container finished" podID="b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" containerID="2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654" exitCode=0
Jul 28 14:56:39.309168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.309081    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"
Jul 28 14:56:39.309168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.309104    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn" event={"ID":"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e","Type":"ContainerDied","Data":"2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654"}
Jul 28 14:56:39.309168 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.309148    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn" event={"ID":"b74ccdab-3c5d-49df-bdfe-34ab6016cd9e","Type":"ContainerDied","Data":"af4c8cbf90f8e28729ea81e9c033d64383eb3277b0881365c2c6497388dac296"}
Jul 28 14:56:39.317154 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.317126    2558 scope.go:117] "RemoveContainer" containerID="ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6"
Jul 28 14:56:39.317417 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:56:39.317399    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6\": container with ID starting with ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6 not found: ID does not exist" containerID="ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6"
Jul 28 14:56:39.317460 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.317424    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6"} err="failed to get container status \"ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6\": rpc error: code = NotFound desc = could not find container \"ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6\": container with ID starting with ba2a65afc0b3811d3a361bf12c3682421ad667fcf59eb9a0b996270a9b08bbc6 not found: ID does not exist"
Jul 28 14:56:39.317460 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.317440    2558 scope.go:117] "RemoveContainer" containerID="2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654"
Jul 28 14:56:39.325249 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.325231    2558 scope.go:117] "RemoveContainer" containerID="2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654"
Jul 28 14:56:39.325504 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:56:39.325481    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654\": container with ID starting with 2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654 not found: ID does not exist" containerID="2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654"
Jul 28 14:56:39.325553 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.325511    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654"} err="failed to get container status \"2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654\": rpc error: code = NotFound desc = could not find container \"2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654\": container with ID starting with 2cdd8d86b3ef6b834ede4740ff24298182c89f577fb34f0eecd5ed3b8c0e0654 not found: ID does not exist"
Jul 28 14:56:39.331092 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.331065    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"]
Jul 28 14:56:39.334752 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.334728    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-18ece0-7bb5f5558-fwlxh"]
Jul 28 14:56:39.346180 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.346157    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"]
Jul 28 14:56:39.353388 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.353365    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-18ece0-75d756d4cb-skqzn"]
Jul 28 14:56:39.374563 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:39.374523    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:41.284460 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:41.284427    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" path="/var/lib/kubelet/pods/b74ccdab-3c5d-49df-bdfe-34ab6016cd9e/volumes"
Jul 28 14:56:41.284863 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:41.284817    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d596f472-80bf-4d4a-997e-fe31db05168f" path="/var/lib/kubelet/pods/d596f472-80bf-4d4a-997e-fe31db05168f/volumes"
Jul 28 14:56:44.455942 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:44.455910    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:56:55.785596 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:56:55.785558    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:20.647445 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:20.647409    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:23.147310 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:23.147266    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:30.288419 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:30.288384    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:30.396478 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:30.396437    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:30.576163 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:30.576073    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:30.810301 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:30.810266    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:38.349117 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:38.349078    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:38.423867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:38.423834    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:38.522858 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:38.522805    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:38.583582 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:38.583532    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:38.968662 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:38.968622    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:46.047477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:46.047445    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:46.148283 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:46.148252    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:46.305074 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:46.304972    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"]
Jul 28 14:57:46.305308 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:46.305281    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" containerID="cri-o://e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d" gracePeriod=30
Jul 28 14:57:46.327229 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:46.327194    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:46.560495 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:46.560366    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:47.999436 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:47.999395    2558 patch_prober.go:28] interesting pod/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 14:57:47.999829 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:47.999461    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 14:57:51.567055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.566960    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:57:51.632324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632287    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-envoy\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632324 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632324    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-certs\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632426    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-data\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632459    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-socket\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632497    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a42f7cc-82f9-4f83-beea-48503064174b-istiod-ca-cert\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632522    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-credential-socket\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632585 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632569    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a42f7cc-82f9-4f83-beea-48503064174b-istio-podinfo\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632594    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjdfx\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-kube-api-access-qjdfx\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.632867 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632625    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-istio-token\") pod \"6a42f7cc-82f9-4f83-beea-48503064174b\" (UID: \"6a42f7cc-82f9-4f83-beea-48503064174b\") "
Jul 28 14:57:51.633048 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632769    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:51.633142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632850    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:51.633142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632905    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:51.633142 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.632971    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a42f7cc-82f9-4f83-beea-48503064174b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:51.633457 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.633431    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:51.634636 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.634610    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:57:51.634862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.634844    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-kube-api-access-qjdfx" (OuterVolumeSpecName: "kube-api-access-qjdfx") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "kube-api-access-qjdfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:51.635167 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.635148    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:51.635245 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.635162    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a42f7cc-82f9-4f83-beea-48503064174b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a42f7cc-82f9-4f83-beea-48503064174b" (UID: "6a42f7cc-82f9-4f83-beea-48503064174b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:57:51.689089 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.689047    2558 generic.go:356] "Generic (PLEG): container finished" podID="6a42f7cc-82f9-4f83-beea-48503064174b" containerID="e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d" exitCode=0
Jul 28 14:57:51.689256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.689105    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"
Jul 28 14:57:51.689256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.689117    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" event={"ID":"6a42f7cc-82f9-4f83-beea-48503064174b","Type":"ContainerDied","Data":"e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d"}
Jul 28 14:57:51.689256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.689174    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9" event={"ID":"6a42f7cc-82f9-4f83-beea-48503064174b","Type":"ContainerDied","Data":"885f4a67c5e39c99fe7a383ae334030da07fb57a9cb7a457b7eb0b3f467d428e"}
Jul 28 14:57:51.689256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.689199    2558 scope.go:117] "RemoveContainer" containerID="e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d"
Jul 28 14:57:51.698256 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.698240    2558 scope.go:117] "RemoveContainer" containerID="ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"
Jul 28 14:57:51.706346 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.706327    2558 scope.go:117] "RemoveContainer" containerID="e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d"
Jul 28 14:57:51.706612 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:57:51.706596    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d\": container with ID starting with e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d not found: ID does not exist" containerID="e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d"
Jul 28 14:57:51.706657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.706619    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d"} err="failed to get container status \"e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d\": rpc error: code = NotFound desc = could not find container \"e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d\": container with ID starting with e0613f631a1effc6366f58059d50a711f85e421958281689f89fcfd88970694d not found: ID does not exist"
Jul 28 14:57:51.706657 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.706634    2558 scope.go:117] "RemoveContainer" containerID="ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"
Jul 28 14:57:51.706850 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:57:51.706831    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0\": container with ID starting with ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0 not found: ID does not exist" containerID="ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"
Jul 28 14:57:51.706913 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.706859    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0"} err="failed to get container status \"ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0\": rpc error: code = NotFound desc = could not find container \"ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0\": container with ID starting with ca95690047c453fdaf6448019c4c6e6ae73e7381a3ca37ab27ece44e700037c0 not found: ID does not exist"
Jul 28 14:57:51.713830 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.713806    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"]
Jul 28 14:57:51.718712 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.718691    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-fd71df-openshift-default-84b8b9d5b-wm7d9"]
Jul 28 14:57:51.734434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734412    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734434 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734433    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734441    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a42f7cc-82f9-4f83-beea-48503064174b-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734452    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734460    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a42f7cc-82f9-4f83-beea-48503064174b-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734469    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjdfx\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-kube-api-access-qjdfx\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734478    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a42f7cc-82f9-4f83-beea-48503064174b-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734485    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:51.734549 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:51.734493    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a42f7cc-82f9-4f83-beea-48503064174b-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:52.594972 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.594934    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:52.625242 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.625209    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"]
Jul 28 14:57:52.625466 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.625435    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz" podUID="10f35cbf-3061-4690-bfca-12a36ba70998" containerName="payload-processing" containerID="cri-o://6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469" gracePeriod=30
Jul 28 14:57:52.636246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.635903    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"]
Jul 28 14:57:52.636246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.636148    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5" podUID="d2b1c6a5-ee3a-415c-a8e0-870d638694a6" containerName="payload-pre-processing" containerID="cri-o://446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe" gracePeriod=30
Jul 28 14:57:52.698492 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.698436    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:52.799546 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.799425    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:52.864793 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.864760    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:52.902869 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.902844    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:57:52.940458 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.940431    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:57:52.945349 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.945320    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10f35cbf-3061-4690-bfca-12a36ba70998-plugins-config-volume\") pod \"10f35cbf-3061-4690-bfca-12a36ba70998\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") "
Jul 28 14:57:52.945519 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.945379    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjjjn\" (UniqueName: \"kubernetes.io/projected/10f35cbf-3061-4690-bfca-12a36ba70998-kube-api-access-vjjjn\") pod \"10f35cbf-3061-4690-bfca-12a36ba70998\" (UID: \"10f35cbf-3061-4690-bfca-12a36ba70998\") "
Jul 28 14:57:52.945671 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.945648    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10f35cbf-3061-4690-bfca-12a36ba70998-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "10f35cbf-3061-4690-bfca-12a36ba70998" (UID: "10f35cbf-3061-4690-bfca-12a36ba70998"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:52.947477 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:52.947452    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f35cbf-3061-4690-bfca-12a36ba70998-kube-api-access-vjjjn" (OuterVolumeSpecName: "kube-api-access-vjjjn") pod "10f35cbf-3061-4690-bfca-12a36ba70998" (UID: "10f35cbf-3061-4690-bfca-12a36ba70998"). InnerVolumeSpecName "kube-api-access-vjjjn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:53.045855 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.045820    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc576\" (UniqueName: \"kubernetes.io/projected/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-kube-api-access-nc576\") pod \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") "
Jul 28 14:57:53.046071 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.046047    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-plugins-config-volume\") pod \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\" (UID: \"d2b1c6a5-ee3a-415c-a8e0-870d638694a6\") "
Jul 28 14:57:53.046316 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.046302    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjjjn\" (UniqueName: \"kubernetes.io/projected/10f35cbf-3061-4690-bfca-12a36ba70998-kube-api-access-vjjjn\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:53.046365 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.046319    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/10f35cbf-3061-4690-bfca-12a36ba70998-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:53.046405 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.046358    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2b1c6a5-ee3a-415c-a8e0-870d638694a6" (UID: "d2b1c6a5-ee3a-415c-a8e0-870d638694a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:57:53.047919 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.047894    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-kube-api-access-nc576" (OuterVolumeSpecName: "kube-api-access-nc576") pod "d2b1c6a5-ee3a-415c-a8e0-870d638694a6" (UID: "d2b1c6a5-ee3a-415c-a8e0-870d638694a6"). InnerVolumeSpecName "kube-api-access-nc576". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:57:53.147641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.147545    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:53.147641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.147580    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc576\" (UniqueName: \"kubernetes.io/projected/d2b1c6a5-ee3a-415c-a8e0-870d638694a6-kube-api-access-nc576\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:57:53.214687 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.214653    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:57:53.283072 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.283000    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" path="/var/lib/kubelet/pods/6a42f7cc-82f9-4f83-beea-48503064174b/volumes"
Jul 28 14:57:53.703650 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.703617    2558 generic.go:356] "Generic (PLEG): container finished" podID="10f35cbf-3061-4690-bfca-12a36ba70998" containerID="6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469" exitCode=0
Jul 28 14:57:53.704148 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.703686    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"
Jul 28 14:57:53.704148 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.703716    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz" event={"ID":"10f35cbf-3061-4690-bfca-12a36ba70998","Type":"ContainerDied","Data":"6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469"}
Jul 28 14:57:53.704148 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.703780    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz" event={"ID":"10f35cbf-3061-4690-bfca-12a36ba70998","Type":"ContainerDied","Data":"afb261a98b9021e72bae7937455448375eb1b8d21d2c74bb0352dafc9b9c33e4"}
Jul 28 14:57:53.704148 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.703812    2558 scope.go:117] "RemoveContainer" containerID="6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469"
Jul 28 14:57:53.705427 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.705398    2558 generic.go:356] "Generic (PLEG): container finished" podID="d2b1c6a5-ee3a-415c-a8e0-870d638694a6" containerID="446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe" exitCode=0
Jul 28 14:57:53.705552 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.705437    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"
Jul 28 14:57:53.705552 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.705485    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5" event={"ID":"d2b1c6a5-ee3a-415c-a8e0-870d638694a6","Type":"ContainerDied","Data":"446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe"}
Jul 28 14:57:53.705552 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.705539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5" event={"ID":"d2b1c6a5-ee3a-415c-a8e0-870d638694a6","Type":"ContainerDied","Data":"94d15eaefec61a664d7c01125c2944a94c24e7b51d33ca8aa42959aedf16d445"}
Jul 28 14:57:53.712895 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.712874    2558 scope.go:117] "RemoveContainer" containerID="6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469"
Jul 28 14:57:53.713167 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:57:53.713146    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469\": container with ID starting with 6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469 not found: ID does not exist" containerID="6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469"
Jul 28 14:57:53.713248 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.713175    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469"} err="failed to get container status \"6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469\": rpc error: code = NotFound desc = could not find container \"6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469\": container with ID starting with 6f053962c8f382bd0059a5b9b3d575388c2ed5863b5b4521013d2df12c511469 not found: ID does not exist"
Jul 28 14:57:53.713248 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.713192    2558 scope.go:117] "RemoveContainer" containerID="446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe"
Jul 28 14:57:53.720766 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.720738    2558 scope.go:117] "RemoveContainer" containerID="446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe"
Jul 28 14:57:53.721211 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:57:53.721117    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe\": container with ID starting with 446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe not found: ID does not exist" containerID="446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe"
Jul 28 14:57:53.721211 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.721168    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe"} err="failed to get container status \"446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe\": rpc error: code = NotFound desc = could not find container \"446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe\": container with ID starting with 446ac9fb70681bfb3086a722c65c9fb468f51d9dbc60d30bb4235840d427f8fe not found: ID does not exist"
Jul 28 14:57:53.727596 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.727574    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"]
Jul 28 14:57:53.732493 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.732474    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-910fb6-7cd44788d4-k52d5"]
Jul 28 14:57:53.746576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.746556    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"]
Jul 28 14:57:53.751055 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:53.751009    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-910fb6-85bf977998-m25xz"]
Jul 28 14:57:55.284291 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:55.284256    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f35cbf-3061-4690-bfca-12a36ba70998" path="/var/lib/kubelet/pods/10f35cbf-3061-4690-bfca-12a36ba70998/volumes"
Jul 28 14:57:55.284715 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:57:55.284632    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b1c6a5-ee3a-415c-a8e0-870d638694a6" path="/var/lib/kubelet/pods/d2b1c6a5-ee3a-415c-a8e0-870d638694a6/volumes"
Jul 28 14:58:00.950748 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:00.950704    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:01.051357 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:01.051313    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:01.206257 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:01.206170    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"]
Jul 28 14:58:01.206699 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:01.206668    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy" containerID="cri-o://367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a" gracePeriod=30
Jul 28 14:58:01.246621 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:01.246590    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:01.461103 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:01.460975    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:06.485111 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.485087    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:58:06.578766 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.578716    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxhrc\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-kube-api-access-lxhrc\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.578766 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.578771    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-envoy\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579043 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.578809    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-certs\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579043 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.578842    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istiod-ca-cert\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579043 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.578879    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-data\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579043 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.578932    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-socket\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579105    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-podinfo\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579144    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-token\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579190    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-credential-socket\") pod \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\" (UID: \"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6\") "
Jul 28 14:58:06.579271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579193    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:06.579271 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579235    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:06.579558 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579281    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:58:06.579558 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579539    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:06.579558 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579547    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.579718 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579572    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.579718 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579586    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.579879 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.579851    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-data" (OuterVolumeSpecName: "istio-data") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:06.581205 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.581172    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:58:06.581205 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.581175    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-kube-api-access-lxhrc" (OuterVolumeSpecName: "kube-api-access-lxhrc") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "kube-api-access-lxhrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:06.581356 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.581207    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:06.581356 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.581248    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-token" (OuterVolumeSpecName: "istio-token") pod "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" (UID: "accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:06.671446 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.671405    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:06.680217 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680191    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"]
Jul 28 14:58:06.680632 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680612    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.680696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680635    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.680696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680644    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.680696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680652    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.680696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680661    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxhrc\" (UniqueName: \"kubernetes.io/projected/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-kube-api-access-lxhrc\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.680696 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.680672    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:06.682237 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.682218    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-baa216-29754165-vgsj8"]
Jul 28 14:58:06.727013 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.726703    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"]
Jul 28 14:58:06.727013 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.726989    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g" podUID="7b784962-6fbf-4f08-bf36-6002b05db8ce" containerName="payload-pre-processing" containerID="cri-o://3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e" gracePeriod=30
Jul 28 14:58:06.760856 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.760827    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:06.777755 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.777719    2558 generic.go:356] "Generic (PLEG): container finished" podID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerID="367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a" exitCode=0
Jul 28 14:58:06.777889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.777773    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" event={"ID":"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6","Type":"ContainerDied","Data":"367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a"}
Jul 28 14:58:06.777889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.777837    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4" event={"ID":"accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6","Type":"ContainerDied","Data":"d8f6718a085f0376bde36c2d48605aff717781b5fee27d99c23229fd516f6e3b"}
Jul 28 14:58:06.777889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.777781    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"
Jul 28 14:58:06.778011 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.777867    2558 scope.go:117] "RemoveContainer" containerID="367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a"
Jul 28 14:58:06.805613 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.805584    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"]
Jul 28 14:58:06.812526 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.812502    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-910fb6-openshift-default-6cb654d7fb-gdrx4"]
Jul 28 14:58:06.838619 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.838598    2558 scope.go:117] "RemoveContainer" containerID="d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"
Jul 28 14:58:06.846981 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.846961    2558 scope.go:117] "RemoveContainer" containerID="367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a"
Jul 28 14:58:06.847322 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:58:06.847296    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a\": container with ID starting with 367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a not found: ID does not exist" containerID="367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a"
Jul 28 14:58:06.847440 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.847327    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a"} err="failed to get container status \"367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a\": rpc error: code = NotFound desc = could not find container \"367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a\": container with ID starting with 367cc551444985cc40d07921d14692825e7af03182e0e75886a2d850d3b95d8a not found: ID does not exist"
Jul 28 14:58:06.847440 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.847346    2558 scope.go:117] "RemoveContainer" containerID="d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"
Jul 28 14:58:06.847610 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:58:06.847586    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d\": container with ID starting with d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d not found: ID does not exist" containerID="d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"
Jul 28 14:58:06.847678 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.847610    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d"} err="failed to get container status \"d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d\": rpc error: code = NotFound desc = could not find container \"d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d\": container with ID starting with d93bdd5db1f0310b8e22a1df3b91b78bc1684602ea7127007ec920db43a6693d not found: ID does not exist"
Jul 28 14:58:06.860634 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.860606    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:06.925122 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.925091    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:06.983576 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:06.983511    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:58:07.083449 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.083410    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b784962-6fbf-4f08-bf36-6002b05db8ce-plugins-config-volume\") pod \"7b784962-6fbf-4f08-bf36-6002b05db8ce\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") "
Jul 28 14:58:07.083449 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.083454    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47lqt\" (UniqueName: \"kubernetes.io/projected/7b784962-6fbf-4f08-bf36-6002b05db8ce-kube-api-access-47lqt\") pod \"7b784962-6fbf-4f08-bf36-6002b05db8ce\" (UID: \"7b784962-6fbf-4f08-bf36-6002b05db8ce\") "
Jul 28 14:58:07.083833 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.083808    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b784962-6fbf-4f08-bf36-6002b05db8ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7b784962-6fbf-4f08-bf36-6002b05db8ce" (UID: "7b784962-6fbf-4f08-bf36-6002b05db8ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:58:07.085535 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.085513    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b784962-6fbf-4f08-bf36-6002b05db8ce-kube-api-access-47lqt" (OuterVolumeSpecName: "kube-api-access-47lqt") pod "7b784962-6fbf-4f08-bf36-6002b05db8ce" (UID: "7b784962-6fbf-4f08-bf36-6002b05db8ce"). InnerVolumeSpecName "kube-api-access-47lqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:07.184945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.184915    2558 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7b784962-6fbf-4f08-bf36-6002b05db8ce-plugins-config-volume\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.184945 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.184942    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47lqt\" (UniqueName: \"kubernetes.io/projected/7b784962-6fbf-4f08-bf36-6002b05db8ce-kube-api-access-47lqt\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:07.289220 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.289189    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="734123f1-6a43-43d9-805e-3d3fd9022a95" path="/var/lib/kubelet/pods/734123f1-6a43-43d9-805e-3d3fd9022a95/volumes"
Jul 28 14:58:07.289569 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.289554    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" path="/var/lib/kubelet/pods/accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6/volumes"
Jul 28 14:58:07.333535 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.333504    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:07.784906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.784870    2558 generic.go:356] "Generic (PLEG): container finished" podID="7b784962-6fbf-4f08-bf36-6002b05db8ce" containerID="3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e" exitCode=0
Jul 28 14:58:07.785375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.784931    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g" event={"ID":"7b784962-6fbf-4f08-bf36-6002b05db8ce","Type":"ContainerDied","Data":"3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e"}
Jul 28 14:58:07.785375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.784967    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g" event={"ID":"7b784962-6fbf-4f08-bf36-6002b05db8ce","Type":"ContainerDied","Data":"b5f8bfeca0495227d31342da2f84c89acb3e19c32a32129c59f43398aeaeade3"}
Jul 28 14:58:07.785375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.784987    2558 scope.go:117] "RemoveContainer" containerID="3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e"
Jul 28 14:58:07.785375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.784932    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"
Jul 28 14:58:07.793771 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.793751    2558 scope.go:117] "RemoveContainer" containerID="3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e"
Jul 28 14:58:07.794070 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:58:07.794044    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e\": container with ID starting with 3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e not found: ID does not exist" containerID="3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e"
Jul 28 14:58:07.794174 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.794075    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e"} err="failed to get container status \"3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e\": rpc error: code = NotFound desc = could not find container \"3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e\": container with ID starting with 3e9f8d7dbf9ed41102d0915ef4083c0afd237740b5e74cc072d1f541a9463a6e not found: ID does not exist"
Jul 28 14:58:07.802672 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.802647    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"]
Jul 28 14:58:07.805640 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:07.805620    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-baa216-6f4bbbdd96-8z57g"]
Jul 28 14:58:09.282588 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:09.282482    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b784962-6fbf-4f08-bf36-6002b05db8ce" path="/var/lib/kubelet/pods/7b784962-6fbf-4f08-bf36-6002b05db8ce/volumes"
Jul 28 14:58:11.010331 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:11.010298    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:14.017375 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:14.017339    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:14.115453 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:14.115411    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:14.310906 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:14.310814    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"]
Jul 28 14:58:14.311147 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:14.311108    2558 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" containerID="cri-o://d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75" gracePeriod=30
Jul 28 14:58:14.315076 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:14.315042    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:14.556105 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:14.556068    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:18.190183 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:18.190137    2558 patch_prober.go:28] interesting pod/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 28 14:58:18.190673 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:18.190207    2558 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 28 14:58:19.576864 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.576795    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:58:19.605551 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605519    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-certs\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605572    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-podinfo\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605594    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-token\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605621    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-credential-socket\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605657    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istiod-ca-cert\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605708 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605681    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-socket\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605737    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-data\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605754    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:19.605991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605765    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24ttd\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-kube-api-access-24ttd\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605838    2558 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-envoy\") pod \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\" (UID: \"ceda290b-0b5d-470f-a22e-5f1f948f7b39\") "
Jul 28 14:58:19.605991 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.605940    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:19.606288 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.606154    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:19.606288 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.606264    2558 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-certs\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.606288 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.606285    2558 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-credential-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.606524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.606506    2558 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-workload-socket\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.606524 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.606467    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 14:58:19.606982 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.606954    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-data" (OuterVolumeSpecName: "istio-data") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:19.608035 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.607990    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-kube-api-access-24ttd" (OuterVolumeSpecName: "kube-api-access-24ttd") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "kube-api-access-24ttd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:19.608138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.608034    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-token" (OuterVolumeSpecName: "istio-token") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 14:58:19.608138 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.608046    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 14:58:19.608290 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.608277    2558 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ceda290b-0b5d-470f-a22e-5f1f948f7b39" (UID: "ceda290b-0b5d-470f-a22e-5f1f948f7b39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 28 14:58:19.706955 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.706902    2558 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-podinfo\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.706955 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.706946    2558 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-token\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.706955 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.706959    2558 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istiod-ca-cert\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.707246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.706970    2558 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-data\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.707246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.706985    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24ttd\" (UniqueName: \"kubernetes.io/projected/ceda290b-0b5d-470f-a22e-5f1f948f7b39-kube-api-access-24ttd\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.707246 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.706997    2558 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ceda290b-0b5d-470f-a22e-5f1f948f7b39-istio-envoy\") on node \"ip-10-0-141-71.ec2.internal\" DevicePath \"\""
Jul 28 14:58:19.847545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.847452    2558 generic.go:356] "Generic (PLEG): container finished" podID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerID="d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75" exitCode=0
Jul 28 14:58:19.847545 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.847498    2558 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"
Jul 28 14:58:19.847785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.847539    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" event={"ID":"ceda290b-0b5d-470f-a22e-5f1f948f7b39","Type":"ContainerDied","Data":"d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75"}
Jul 28 14:58:19.847785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.847597    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279" event={"ID":"ceda290b-0b5d-470f-a22e-5f1f948f7b39","Type":"ContainerDied","Data":"a3a46f87ee1d31fcb9a69edcfaeea00f930b97bc7ed6549c722b268c08e525f6"}
Jul 28 14:58:19.847785 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.847626    2558 scope.go:117] "RemoveContainer" containerID="d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75"
Jul 28 14:58:19.856897 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.856877    2558 scope.go:117] "RemoveContainer" containerID="e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"
Jul 28 14:58:19.864723 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.864707    2558 scope.go:117] "RemoveContainer" containerID="d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75"
Jul 28 14:58:19.864958 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:58:19.864942    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75\": container with ID starting with d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75 not found: ID does not exist" containerID="d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75"
Jul 28 14:58:19.864998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.864966    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75"} err="failed to get container status \"d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75\": rpc error: code = NotFound desc = could not find container \"d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75\": container with ID starting with d921099e87af6fc4cd3725f3a151dfcf50f5e98db05dac3e86537174a0b54c75 not found: ID does not exist"
Jul 28 14:58:19.864998 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.864982    2558 scope.go:117] "RemoveContainer" containerID="e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"
Jul 28 14:58:19.865216 ip-10-0-141-71 kubenswrapper[2558]: E0728 14:58:19.865200    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92\": container with ID starting with e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92 not found: ID does not exist" containerID="e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"
Jul 28 14:58:19.865251 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.865220    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92"} err="failed to get container status \"e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92\": rpc error: code = NotFound desc = could not find container \"e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92\": container with ID starting with e1cba0ca6c4923fad167ae117135062a0eb3b5744435025f0d17531fcda2db92 not found: ID does not exist"
Jul 28 14:58:19.871282 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.871257    2558 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"]
Jul 28 14:58:19.876700 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:19.876678    2558 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-baa216-openshift-default-75c6d7d4d4-wn279"]
Jul 28 14:58:20.694503 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:20.694469    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h585h_b44ea676-341a-43dc-8573-38af58216cad/manager/0.log"
Jul 28 14:58:21.283364 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:21.283329    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" path="/var/lib/kubelet/pods/ceda290b-0b5d-470f-a22e-5f1f948f7b39/volumes"
Jul 28 14:58:21.427069 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:21.427011    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-rk69m_08c2d094-31ad-4774-8620-310d1e0bf6c9/copy-manifests/0.log"
Jul 28 14:58:21.440969 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:21.440940    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-rk69m_08c2d094-31ad-4774-8620-310d1e0bf6c9/manager/0.log"
Jul 28 14:58:21.925650 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:21.925618    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754135-7qb62_d0f53e1e-9549-4c66-b7ba-c8325e4b801b/cleanup/0.log"
Jul 28 14:58:22.040180 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:22.040148    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754150-vkk9q_5ae34c7a-3fd1-4e2a-9ae8-4409a48b18e2/cleanup/0.log"
Jul 28 14:58:23.834753 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:23.834721    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kf29k_0d9be928-788a-4960-af4e-eaaf4ec45b39/manager/0.log"
Jul 28 14:58:24.074002 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:24.073964    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nqjzf_a5aa37fb-19ba-4976-be35-7cd723a7b43b/registry-server/0.log"
Jul 28 14:58:24.210442 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:24.210354    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-24c9h_44f8cec3-192d-4833-aae1-6a4b7f8b022f/manager/0.log"
Jul 28 14:58:24.452641 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:24.452607    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4hmks_0901b206-c5dd-40e4-b7b2-8413c4af59f0/manager/0.log"
Jul 28 14:58:24.824967 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:24.824939    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ccflh6_dacc540f-b0d0-41ac-a720-5ea6f71a433d/istio-proxy/0.log"
Jul 28 14:58:26.027561 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:26.027524    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fz9k9_58bb9286-0173-4b0a-8664-f09bee78a551/main/0.log"
Jul 28 14:58:26.257461 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:26.257427    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gzt2k_cb119198-9c19-49f3-bf2d-f36aa6322a3f/main/0.log"
Jul 28 14:58:32.464036 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:32.463994    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:32.561699 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:32.561663    2558 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log" limit=1024
Jul 28 14:58:35.479090 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:35.479047    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bc5tq_7e8e4996-66ef-4e59-b750-4aaff0ed34da/global-pull-secret-syncer/0.log"
Jul 28 14:58:35.579532 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:35.579501    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c977w_ba612107-ebfe-4a59-a4ae-7649e3178e63/konnectivity-agent/0.log"
Jul 28 14:58:35.708465 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:35.708430    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-71.ec2.internal_ee18178d793931ec5a7685e293ce85c6/haproxy/0.log"
Jul 28 14:58:40.785619 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:40.785585    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-kf29k_0d9be928-788a-4960-af4e-eaaf4ec45b39/manager/0.log"
Jul 28 14:58:40.867658 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:40.867629    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-nqjzf_a5aa37fb-19ba-4976-be35-7cd723a7b43b/registry-server/0.log"
Jul 28 14:58:41.033592 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:41.033553    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-24c9h_44f8cec3-192d-4833-aae1-6a4b7f8b022f/manager/0.log"
Jul 28 14:58:41.161822 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:41.161771    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4hmks_0901b206-c5dd-40e4-b7b2-8413c4af59f0/manager/0.log"
Jul 28 14:58:43.275062 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.275001    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6796c67f76-2sml9_044f6dc2-792c-43e6-a338-94ecbb1c0d4b/metrics-server/0.log"
Jul 28 14:58:43.506543 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.506515    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmz95_4e79cc43-c95e-4d6a-9d97-fa0a71eccce5/node-exporter/0.log"
Jul 28 14:58:43.530468 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.530395    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmz95_4e79cc43-c95e-4d6a-9d97-fa0a71eccce5/kube-rbac-proxy/0.log"
Jul 28 14:58:43.560649 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.560626    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pmz95_4e79cc43-c95e-4d6a-9d97-fa0a71eccce5/init-textfile/0.log"
Jul 28 14:58:43.590710 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.590687    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-8w865_a5a2d263-a4cb-484c-8024-4b5afc268431/kube-rbac-proxy-main/0.log"
Jul 28 14:58:43.615765 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.615746    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-8w865_a5a2d263-a4cb-484c-8024-4b5afc268431/kube-rbac-proxy-self/0.log"
Jul 28 14:58:43.640887 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.640857    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-8w865_a5a2d263-a4cb-484c-8024-4b5afc268431/openshift-state-metrics/0.log"
Jul 28 14:58:43.680282 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.680261    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/prometheus/0.log"
Jul 28 14:58:43.704001 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.703979    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/config-reloader/0.log"
Jul 28 14:58:43.728447 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.728426    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/thanos-sidecar/0.log"
Jul 28 14:58:43.751826 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.751805    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/kube-rbac-proxy-web/0.log"
Jul 28 14:58:43.774171 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.774153    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/kube-rbac-proxy/0.log"
Jul 28 14:58:43.802654 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.802595    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/kube-rbac-proxy-thanos/0.log"
Jul 28 14:58:43.826064 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.826040    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_3d24f14a-150e-407a-b2f7-4ac402291712/init-config-reloader/0.log"
Jul 28 14:58:43.853659 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.853639    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wxdcv_17585fb8-285e-4756-ac8b-4d20be6d2075/prometheus-operator/0.log"
Jul 28 14:58:43.873857 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.873837    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-wxdcv_17585fb8-285e-4756-ac8b-4d20be6d2075/kube-rbac-proxy/0.log"
Jul 28 14:58:43.903901 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:43.903871    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-k4pv8_3ebb7ef2-7412-4435-849c-fcbfe01d7334/prometheus-operator-admission-webhook/0.log"
Jul 28 14:58:45.348306 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.348250    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-q5k5p_d016e616-e01b-470b-9afc-0d78b2660ac8/networking-console-plugin/0.log"
Jul 28 14:58:45.470291 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470259    2558 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"]
Jul 28 14:58:45.470699 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470675    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" containerName="payload-pre-processing"
Jul 28 14:58:45.470699 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470699    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470716    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470725    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470742    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470750    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470759    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470765    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470772    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b784962-6fbf-4f08-bf36-6002b05db8ce" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470778    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b784962-6fbf-4f08-bf36-6002b05db8ce" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470786    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470792    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470800    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f35cbf-3061-4690-bfca-12a36ba70998" containerName="payload-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470805    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f35cbf-3061-4690-bfca-12a36ba70998" containerName="payload-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470813    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b1c6a5-ee3a-415c-a8e0-870d638694a6" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470821    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b1c6a5-ee3a-415c-a8e0-870d638694a6" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470828    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470833    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" containerName="payload-pre-processing"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470840    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470845    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470855    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy"
Jul 28 14:58:45.470850 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470860    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470875    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470880    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470887    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470894    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470904    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d596f472-80bf-4d4a-997e-fe31db05168f" containerName="payload-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.470913    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="d596f472-80bf-4d4a-997e-fe31db05168f" containerName="payload-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471007    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471038    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b784962-6fbf-4f08-bf36-6002b05db8ce" containerName="payload-pre-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471045    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471057    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d596f472-80bf-4d4a-997e-fe31db05168f" containerName="payload-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471066    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a42f7cc-82f9-4f83-beea-48503064174b" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471072    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f35cbf-3061-4690-bfca-12a36ba70998" containerName="payload-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471079    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceda290b-0b5d-470f-a22e-5f1f948f7b39" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471084    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="accb2f0c-9c30-4bfb-9f75-3e4bbf286ea6" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471090    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="12ef0fd9-44b0-49b9-8783-4f46d3ec3f02" containerName="payload-pre-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471095    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471103    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="b74ccdab-3c5d-49df-bdfe-34ab6016cd9e" containerName="payload-pre-processing"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471111    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1ffe0b-72f3-4cb7-b277-0817c2e49f5b" containerName="istio-proxy"
Jul 28 14:58:45.471536 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.471119    2558 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b1c6a5-ee3a-415c-a8e0-870d638694a6" containerName="payload-pre-processing"
Jul 28 14:58:45.474206 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.474187    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.476525 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.476503    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh668\"/\"kube-root-ca.crt\""
Jul 28 14:58:45.477889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.477610    2558 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-qh668\"/\"openshift-service-ca.crt\""
Jul 28 14:58:45.477889 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.477664    2558 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-qh668\"/\"default-dockercfg-gjnsx\""
Jul 28 14:58:45.482898 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.482871    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"]
Jul 28 14:58:45.539611 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.539571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-sys\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.539808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.539648    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fn8r2\" (UniqueName: \"kubernetes.io/projected/36d41144-ffc8-479e-a36d-8289e70672aa-kube-api-access-fn8r2\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.539808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.539671    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-lib-modules\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.539808 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.539688    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-proc\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.539940 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.539799    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-podres\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640505 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640408    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-podres\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640505 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640467    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-sys\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640514    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fn8r2\" (UniqueName: \"kubernetes.io/projected/36d41144-ffc8-479e-a36d-8289e70672aa-kube-api-access-fn8r2\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640539    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-lib-modules\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640556    2558 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-proc\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640633    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-podres\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640652    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-proc\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640646    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-sys\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.640727 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.640694    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36d41144-ffc8-479e-a36d-8289e70672aa-lib-modules\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.650146 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.650122    2558 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fn8r2\" (UniqueName: \"kubernetes.io/projected/36d41144-ffc8-479e-a36d-8289e70672aa-kube-api-access-fn8r2\") pod \"perf-node-gather-daemonset-5qxcg\" (UID: \"36d41144-ffc8-479e-a36d-8289e70672aa\") " pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.785685 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.785624    2558 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:45.921485 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.921459    2558 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"]
Jul 28 14:58:45.924159 ip-10-0-141-71 kubenswrapper[2558]: W0728 14:58:45.924128    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36d41144_ffc8_479e_a36d_8289e70672aa.slice/crio-7784e9025ebe9c8d2249a818003ec12e6c1be5999b03aee5e60da4247d49c911 WatchSource:0}: Error finding container 7784e9025ebe9c8d2249a818003ec12e6c1be5999b03aee5e60da4247d49c911: Status 404 returned error can't find the container with id 7784e9025ebe9c8d2249a818003ec12e6c1be5999b03aee5e60da4247d49c911
Jul 28 14:58:45.982386 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:45.982355    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg" event={"ID":"36d41144-ffc8-479e-a36d-8289e70672aa","Type":"ContainerStarted","Data":"7784e9025ebe9c8d2249a818003ec12e6c1be5999b03aee5e60da4247d49c911"}
Jul 28 14:58:46.566154 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:46.566121    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69c445bf58-scldl_769cccca-e76b-4d78-8bcf-2cf789115c9a/console/0.log"
Jul 28 14:58:46.602749 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:46.602714    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-z8kgr_0132ffa9-560b-49b6-be74-c14b4a622c98/download-server/0.log"
Jul 28 14:58:46.988454 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:46.988358    2558 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg" event={"ID":"36d41144-ffc8-479e-a36d-8289e70672aa","Type":"ContainerStarted","Data":"ea2306a6b4192e49ff5e4c845ad62f55cd397090f1a182ddfeeeabf3636c5dd1"}
Jul 28 14:58:46.988454 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:46.988450    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:47.007931 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:47.007871    2558 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg" podStartSLOduration=2.00784358 podStartE2EDuration="2.00784358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 14:58:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 14:58:47.005805395 +0000 UTC m=+3540.240324869" watchObservedRunningTime="2026-07-28 14:58:47.00784358 +0000 UTC m=+3540.242363051"
Jul 28 14:58:47.766155 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:47.766120    2558 scope.go:117] "RemoveContainer" containerID="aea23806cd6f5499d333bd35c74f6e72bab1eaf2cd347d551df16086739d3512"
Jul 28 14:58:48.355546 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:48.355516    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vh9b_4604fc28-4ec7-46ad-bef8-1275763faf66/dns/0.log"
Jul 28 14:58:48.384515 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:48.384479    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-9vh9b_4604fc28-4ec7-46ad-bef8-1275763faf66/kube-rbac-proxy/0.log"
Jul 28 14:58:48.543821 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:48.543788    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4sdxn_f849cc24-20cf-4f7e-a104-58a9d1ed9a9b/dns-node-resolver/0.log"
Jul 28 14:58:49.210474 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:49.210440    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75c555dd69-mjmpx_76beab67-f046-43de-9ddd-7f05a4eb7b79/registry/0.log"
Jul 28 14:58:49.262075 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:49.262039    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nbmn2_539fbdf4-b8da-4852-a4ae-e55d5a98a7da/node-ca/0.log"
Jul 28 14:58:50.284967 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:50.284936    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ccflh6_dacc540f-b0d0-41ac-a720-5ea6f71a433d/istio-proxy/0.log"
Jul 28 14:58:51.521033 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:51.520994    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-842zc_87ce1244-dcc1-464b-8971-15b4a0363402/serve-healthcheck-canary/0.log"
Jul 28 14:58:52.101587 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:52.101552    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7bw4s_69e07e8f-f868-4af9-ac6f-75d410526587/kube-rbac-proxy/0.log"
Jul 28 14:58:52.125470 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:52.125449    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7bw4s_69e07e8f-f868-4af9-ac6f-75d410526587/exporter/0.log"
Jul 28 14:58:52.152862 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:52.152836    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7bw4s_69e07e8f-f868-4af9-ac6f-75d410526587/extractor/0.log"
Jul 28 14:58:53.002853 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:53.002826    2558 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-qh668/perf-node-gather-daemonset-5qxcg"
Jul 28 14:58:54.812409 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:54.812374    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h585h_b44ea676-341a-43dc-8573-38af58216cad/manager/0.log"
Jul 28 14:58:55.420187 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:55.420156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-rk69m_08c2d094-31ad-4774-8620-310d1e0bf6c9/manager/0.log"
Jul 28 14:58:55.442469 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:55.442398    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b59958787-rk69m_08c2d094-31ad-4774-8620-310d1e0bf6c9/copy-manifests/0.log"
Jul 28 14:58:55.967297 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:55.967264    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ccflh6_dacc540f-b0d0-41ac-a720-5ea6f71a433d/istio-proxy/0.log"
Jul 28 14:58:56.728091 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:56.728064    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-84947845b-pnrwl_6adb5a07-1307-44cc-b051-193a47556b65/manager/0.log"
Jul 28 14:58:57.707586 ip-10-0-141-71 kubenswrapper[2558]: I0728 14:58:57.707500    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ccflh6_dacc540f-b0d0-41ac-a720-5ea6f71a433d/istio-proxy/0.log"