Sep 08 16:28:25.452431 ip-10-0-131-47 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 16:28:25.452446 ip-10-0-131-47 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 16:28:25.452457 ip-10-0-131-47 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 16:28:25.452810 ip-10-0-131-47 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 16:28:35.614937 ip-10-0-131-47 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 16:28:35.614954 ip-10-0-131-47 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot fb3ad330bc8f49068cd705a0b6e02633 --
Sep 08 16:30:30.243071 ip-10-0-131-47 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 16:30:30.617820 ip-10-0-131-47 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:30:30.617820 ip-10-0-131-47 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 16:30:30.617820 ip-10-0-131-47 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:30:30.617820 ip-10-0-131-47 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 16:30:30.617820 ip-10-0-131-47 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 16:30:30.619831 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.619730    2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 16:30:30.624748 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624721    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:30.624748 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624745    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:30.624748 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624749    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:30.624748 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624752    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624758    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624763    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624766    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624769    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624772    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624775    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624778    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624780    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624783    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624786    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624790    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624800    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624803    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624805    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624808    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624811    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624813    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624816    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:30.624877 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624818    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624821    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624823    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624826    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624828    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624832    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624834    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624837    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624840    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624842    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624845    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624847    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624850    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624853    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624856    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624861    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624865    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624867    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624870    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624873    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:30.625350 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624876    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624879    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624881    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624884    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624887    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624889    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624892    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624895    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624898    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624900    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624903    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624905    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624908    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624910    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624913    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624915    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624918    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624920    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624923    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624925    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:30.625912 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624927    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624930    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624932    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624935    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624937    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624941    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624944    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624947    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624950    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624953    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624956    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624960    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624963    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624966    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624968    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624972    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624975    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624978    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624980    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:30.626397 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624983    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624985    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624988    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624990    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624993    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624995    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.624998    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625001    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625003    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625006    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625008    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625011    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625032    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625035    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625037    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625040    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625042    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625045    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625851    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625860    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:30.626893 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625863    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625866    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625869    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625873    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625875    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625878    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625880    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625883    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625885    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625888    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625890    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625893    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625895    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625898    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625900    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625903    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625906    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625908    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625910    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625913    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:30.627394 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625916    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625918    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625921    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625924    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625927    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625929    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625932    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625934    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625937    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625940    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625943    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625945    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625948    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625950    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625953    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625955    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625958    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625961    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625963    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625966    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:30.627926 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625968    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625971    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625973    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625976    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625978    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625980    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625983    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625986    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625988    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625990    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625993    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625995    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.625997    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626000    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626002    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626005    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626008    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626010    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626014    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626016    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:30.628428 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626019    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626022    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626024    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626027    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626030    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626032    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626035    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626037    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626039    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626044    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626048    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626051    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626055    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626057    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626062    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626064    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626067    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626070    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626072    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:30.628981 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626075    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626077    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626080    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626082    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626084    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626087    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626089    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626092    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626094    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626099    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626101    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626104    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626106    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626110    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626114    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626117    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626120    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626122    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626526    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626531    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:30.629446 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626534    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626537    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626540    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626543    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626545    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626548    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626551    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626553    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626556    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626558    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626561    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626563    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626565    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626568    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626571    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626573    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626575    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626578    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626580    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626583    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:30.630072 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626585    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626590    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626593    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626596    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626599    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626602    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626605    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626607    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626610    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626612    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626615    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626617    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626620    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626622    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626624    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626627    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626630    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626632    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626635    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:30.630562 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626637    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626642    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626646    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626648    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626651    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626654    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626656    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626660    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626663    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626666    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626668    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626671    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626673    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626676    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626698    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626701    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626704    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626707    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626711    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:30.631069 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626714    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626717    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626720    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626722    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626725    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626728    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626730    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626733    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626735    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626738    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626741    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626743    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626746    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626749    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626751    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626753    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626756    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626759    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626761    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626764    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:30.631527 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626766    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626769    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626771    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626774    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626776    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626779    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626781    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626785    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626788    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626791    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626793    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626798    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626800    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626803    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626806    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626809    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626811    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626814    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.626816    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626892    2581 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626927    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 16:30:30.632090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626939    2581 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626944    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626950    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626953    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626957    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626962    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626966    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626969    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626972    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626975    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626979    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626982    2581 flags.go:64] FLAG: --cgroup-root=""
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626985    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626988    2581 flags.go:64] FLAG: --client-ca-file=""
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626991    2581 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626994    2581 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.626998    2581 flags.go:64] FLAG: --cluster-domain=""
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627001    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627005    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627008    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627011    2581 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627015    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627019    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 16:30:30.632608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627022    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627026    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627029    2581 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627032    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627035    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627038    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627041    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627045    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627051    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627054    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627057    2581 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627060    2581 flags.go:64] FLAG: --enable-server="true"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627063    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627068    2581 flags.go:64] FLAG: --event-burst="100"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627071    2581 flags.go:64] FLAG: --event-qps="50"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627073    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627076    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627079    2581 flags.go:64] FLAG: --eviction-hard=""
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627083    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627087    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627090    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627093    2581 flags.go:64] FLAG: --eviction-soft=""
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627096    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627099    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627102    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 16:30:30.633186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627105    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627108    2581 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627111    2581 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627114    2581 flags.go:64] FLAG: --feature-gates=""
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627118    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627121    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627126    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627129    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627132    2581 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627135    2581 flags.go:64] FLAG: --help="false"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627138    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-131-47.ec2.internal"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627141    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627144    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627147    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627150    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627154    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627156    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627159    2581 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627163    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627166    2581 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627175    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627178    2581 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627181    2581 flags.go:64] FLAG: --kube-reserved=""
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627184    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 16:30:30.633845 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627186    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627189    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627192    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627195    2581 flags.go:64] FLAG: --lock-file=""
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627197    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627200    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627203    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627209    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627211    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627214    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627217    2581 flags.go:64] FLAG: --logging-format="text"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627219    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627223    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627225    2581 flags.go:64] FLAG: --manifest-url=""
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627230    2581 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627235    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627237    2581 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627241    2581 flags.go:64] FLAG: --max-pods="110"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627244    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627247    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627250    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627253    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627256    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627259    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627261    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 16:30:30.634454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627269    2581 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627272    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627275    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627278    2581 flags.go:64] FLAG: --pod-cidr=""
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627291    2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627297    2581 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627300    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627302    2581 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627305    2581 flags.go:64] FLAG: --port="10250"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627308    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627311    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07f822f51f82fa8a8"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627314    2581 flags.go:64] FLAG: --qos-reserved=""
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627317    2581 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627320    2581 flags.go:64] FLAG: --register-node="true"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627323    2581 flags.go:64] FLAG: --register-with-taints=""
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627326    2581 flags.go:64] FLAG: --registry-burst="10"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627329    2581 flags.go:64] FLAG: --registry-qps="5"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627332    2581 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627334    2581 flags.go:64] FLAG: --reserved-memory=""
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627338    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627343    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627346    2581 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627350    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627353    2581 flags.go:64] FLAG: --runonce="false"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627355    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 16:30:30.635087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627358    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627361    2581 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627364    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627367    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627370    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627373    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627376    2581 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627379    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627382    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627385    2581 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627387    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627390    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627399    2581 flags.go:64] FLAG: --system-cgroups=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627402    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627407    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627410    2581 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627413    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627420    2581 flags.go:64] FLAG: --tls-min-version=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627423    2581 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627426    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627429    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627431    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627434    2581 flags.go:64] FLAG: --v="2"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627438    2581 flags.go:64] FLAG: --version="false"
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627443    2581 flags.go:64] FLAG: --vmodule=""
Sep 08 16:30:30.635822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627446    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.627449    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627615    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627620    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627626    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627629    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627631    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627634    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627637    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627639    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627642    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627645    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627648    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627651    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627653    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627656    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627659    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627663    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627666    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627668    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:30.636449 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627676    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627695    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627698    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627700    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627703    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627705    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627708    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627710    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627714    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627716    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627719    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627722    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627724    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627728    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627735    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627738    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627742    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627744    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627747    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:30.636973 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627750    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627753    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627755    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627758    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627760    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627763    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627766    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627768    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627771    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627774    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627776    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627779    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627781    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627784    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627787    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627798    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627801    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627804    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627806    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627809    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:30.637451 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627812    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627815    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627818    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627820    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627823    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627826    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627828    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627832    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627835    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627839    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627842    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627845    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627847    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627850    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627853    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627855    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627858    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627861    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627863    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627866    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:30.638017 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627869    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627871    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627874    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627876    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627879    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627882    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627884    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627887    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627890    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627892    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627895    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627898    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627900    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627903    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627905    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627908    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627910    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627913    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627917    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:30.638533 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627922    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627925    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.627929    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.628448    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.635410    2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.635430    2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.636249    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.636258    2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636322    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636328    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636332    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636335    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636338    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636341    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636344    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:30.639073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636346    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636349    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636351    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636354    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636356    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636359    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636361    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636364    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636367    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636369    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636373    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636375    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636377    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636380    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636383    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636385    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636388    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636390    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636393    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636396    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:30.639525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636399    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636402    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636405    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636408    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636411    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636413    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636416    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636418    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636421    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636423    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636426    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636428    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636430    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636433    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636435    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636438    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636440    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636443    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636445    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636448    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:30.640042 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636451    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636454    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636456    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636459    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636462    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636465    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636467    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636470    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636472    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636475    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636477    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636479    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636483    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636487    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636491    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636495    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636498    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636500    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636503    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:30.640545 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636505    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636508    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636510    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636513    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636515    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636517    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636520    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636522    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636525    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636528    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636530    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636533    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636535    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636539    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636541    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636544    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636546    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636548    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636551    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636553    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:30.641033 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636556    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636559    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636562    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636564    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636567    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636569    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636573    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636577    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636580    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636583    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636586    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636590    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636593    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.636599    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:30:30.641525 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636732    2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636738    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636741    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636744    2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636747    2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636750    2581 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636753    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636756    2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636759    2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636761    2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636764    2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636766    2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636769    2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636772    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636775    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636777    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636780    2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636782    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636785    2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636787    2581 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 16:30:30.641963 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636790    2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636792    2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636795    2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636797    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636800    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636803    2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636805    2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636808    2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636811    2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636815    2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636819    2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636822    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636825    2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636827    2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636829    2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636832    2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636834    2581 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636837    2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636839    2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 16:30:30.642467 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636842    2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636844    2581 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636847    2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636849    2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636852    2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636856    2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636860    2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636864    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636867    2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636871    2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636873    2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636876    2581 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636878    2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636881    2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636883    2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636886    2581 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636888    2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636891    2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636893    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 16:30:30.643022 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636896    2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636898    2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636901    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636904    2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636906    2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636909    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636911    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636914    2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636916    2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636919    2581 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636921    2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636924    2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636926    2581 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636928    2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636931    2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636933    2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636936    2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636938    2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636941    2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636943    2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 16:30:30.643489 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636946    2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636948    2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636951    2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636953    2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636956    2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636958    2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636961    2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636963    2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636966    2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636968    2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636970    2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636973    2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636975    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636978    2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636981    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636984    2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636987    2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636990    2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636992    2581 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 16:30:30.644007 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636995    2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:30.636997    2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.637002    2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.637138    2581 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.639404    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.640383    2581 server.go:1019] "Starting client certificate rotation"
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.640489    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.641206    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 16:30:30.644496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.643747    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 16:30:30.647255 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.647225    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 16:30:30.666577 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.666551    2581 log.go:25] "Validated CRI v1 runtime API"
Sep 08 16:30:30.669850 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.669820    2581 log.go:25] "Validated CRI v1 image API"
Sep 08 16:30:30.670747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.670727    2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 16:30:30.674315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.674287    2581 fs.go:135] Filesystem UUIDs: map[44e28450-896d-4a57-99dc-889b6e3f5a07:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8d0bc7a6-d05f-4659-8e2a-c727bd73f48d:/dev/nvme0n1p3]
Sep 08 16:30:30.674392 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.674315    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 16:30:30.679027 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.679007    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 16:30:30.680672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.680540    2581 manager.go:216] Machine: {Timestamp:2026-09-08 16:30:30.678987319 +0000 UTC m=+0.316574956 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087077 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2898122017322de38d8c982010bb60 SystemUUID:ec289812-2017-322d-e38d-8c982010bb60 BootID:fb3ad330-bc8f-4906-8cd7-05a0b6e02633 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:f0:bf:76:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:f0:bf:76:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6a:c3:79:71:96:d3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 16:30:30.680672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.680670    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 16:30:30.680801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.680782    2581 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 16:30:30.682550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.682519    2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 16:30:30.682749 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.682554    2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 16:30:30.683211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.683199    2581 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 16:30:30.683248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.683214    2581 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 16:30:30.683248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.683222    2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 16:30:30.683248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.683237    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 16:30:30.684463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.684450    2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 16:30:30.688697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688666    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 16:30:30.688850 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688839    2581 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 16:30:30.688886 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688879    2581 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 16:30:30.688914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688892    2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 16:30:30.688942 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688917    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 16:30:30.688942 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688931    2581 kubelet.go:398] "Adding apiserver pod source"
Sep 08 16:30:30.689006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.688945    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 16:30:30.689440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.689424    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 16:30:30.689478 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.689452    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 16:30:30.691774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.691753    2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 16:30:30.695073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695050    2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 16:30:30.695158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695085    2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 16:30:30.695348 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695324    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 16:30:30.695392 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695365    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 16:30:30.695392 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695377    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 16:30:30.695392 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695383    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 16:30:30.695392 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695392    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 16:30:30.695500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.695398    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 16:30:30.696707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.696670    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 16:30:30.696812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.696710    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 16:30:30.696812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.696723    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 16:30:30.696812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.696733    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 16:30:30.696812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.696747    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 16:30:30.696812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.696762    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 16:30:30.697802 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.697787    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 16:30:30.697839 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.697806    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 16:30:30.702020 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.702001    2581 server.go:1268] "Started kubelet"
Sep 08 16:30:30.702118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.702059    2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 16:30:30.702170 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.702110    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 16:30:30.702219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.702191    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 16:30:30.702528 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.702483    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 16:30:30.702626 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.702551    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 16:30:30.702626 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.702556    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 16:30:30.703004 ip-10-0-131-47 systemd[1]: Started Kubernetes Kubelet.
Sep 08 16:30:30.703535 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.703511    2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 16:30:30.704215 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.704203    2581 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 16:30:30.707357 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.707328    2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 16:30:30.708692 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.707764    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-47.ec2.internal.18d365751f0121ec  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-47.ec2.internal,UID:ip-10-0-131-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-47.ec2.internal,},FirstTimestamp:2026-09-08 16:30:30.701965804 +0000 UTC m=+0.339553489,LastTimestamp:2026-09-08 16:30:30.701965804 +0000 UTC m=+0.339553489,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-47.ec2.internal,}"
Sep 08 16:30:30.710026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.710011    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 16:30:30.710648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.710622    2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 16:30:30.710891 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.710817    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:30.711482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711259    2581 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 16:30:30.711482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711278    2581 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 16:30:30.711482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711259    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 16:30:30.711482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711372    2581 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 16:30:30.711482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711379    2581 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 16:30:30.711922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711851    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 16:30:30.711922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711868    2581 factory.go:55] Registering systemd factory
Sep 08 16:30:30.711922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.711879    2581 factory.go:223] Registration of the systemd container factory successfully
Sep 08 16:30:30.712733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.712714    2581 factory.go:153] Registering CRI-O factory
Sep 08 16:30:30.712733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.712729    2581 factory.go:223] Registration of the crio container factory successfully
Sep 08 16:30:30.712863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.712744    2581 factory.go:103] Registering Raw factory
Sep 08 16:30:30.712863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.712753    2581 manager.go:1196] Started watching for new ooms in manager
Sep 08 16:30:30.713253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.713239    2581 manager.go:349] Starting recovery of all containers
Sep 08 16:30:30.714643 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.714619    2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 16:30:30.714851 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.714820    2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 16:30:30.728121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.727977    2581 manager.go:354] Recovery completed
Sep 08 16:30:30.732362 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.732341    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.734257 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.734232    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.734360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.734271    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.734360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.734282    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.735001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.734985    2581 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 16:30:30.735001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.735001    2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 16:30:30.735142 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.735020    2581 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 16:30:30.735142 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.735051    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.735862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.735842    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.735919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.735884    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.735919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.735902    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.736330 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.736315    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hf9rc"
Sep 08 16:30:30.736675 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.736610    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-47.ec2.internal.18d3657520eddbd1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-47.ec2.internal,UID:ip-10-0-131-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-47.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-47.ec2.internal,},FirstTimestamp:2026-09-08 16:30:30.734257105 +0000 UTC m=+0.371844744,LastTimestamp:2026-09-08 16:30:30.734257105 +0000 UTC m=+0.371844744,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-47.ec2.internal,}"
Sep 08 16:30:30.737201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.737188    2581 policy_none.go:49] "None policy: Start"
Sep 08 16:30:30.737254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.737207    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 16:30:30.737254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.737221    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 16:30:30.739277 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.739263    2581 policy_none.go:47] "Start"
Sep 08 16:30:30.747216 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.747134    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-47.ec2.internal.18d3657520ee26ff  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-47.ec2.internal,UID:ip-10-0-131-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-131-47.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-131-47.ec2.internal,},FirstTimestamp:2026-09-08 16:30:30.734276351 +0000 UTC m=+0.371863991,LastTimestamp:2026-09-08 16:30:30.734276351 +0000 UTC m=+0.371863991,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-47.ec2.internal,}"
Sep 08 16:30:30.757084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.757060    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hf9rc"
Sep 08 16:30:30.761210 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.761134    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-47.ec2.internal.18d3657520ee4b75  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-47.ec2.internal,UID:ip-10-0-131-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-131-47.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-131-47.ec2.internal,},FirstTimestamp:2026-09-08 16:30:30.734285685 +0000 UTC m=+0.371873321,LastTimestamp:2026-09-08 16:30:30.734285685 +0000 UTC m=+0.371873321,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-47.ec2.internal,}"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776301    2581 manager.go:337] "Starting Device Plugin manager"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.776337    2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776347    2581 server.go:87] "Starting device plugin registration server"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776718    2581 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776728    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776824    2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776900    2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.776908    2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.777542    2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 16:30:30.791510 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.777585    2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:30.809954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.809913    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 16:30:30.811331 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.811313    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 16:30:30.811391 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.811370    2581 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 16:30:30.811442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.811392    2581 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 16:30:30.811504 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.811490    2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 16:30:30.813787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.813761    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:30.877875 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.877749    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.878874 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.878851    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.878975 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.878882    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.878975 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.878892    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.878975 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.878914    2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-47.ec2.internal"
Sep 08 16:30:30.894464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.894439    2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-47.ec2.internal"
Sep 08 16:30:30.894568 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.894470    2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-47.ec2.internal\": node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:30.911804 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.911771    2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"]
Sep 08 16:30:30.911893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.911855    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.912925 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.912909    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.912980 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.912943    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.912980 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.912957    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.915144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915124    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.915320 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915296    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:30.915427 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915331    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.915959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915942    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.916023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915973    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.916023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915983    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.916106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.915945    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.916106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.916050    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.916106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.916060    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.918206 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.918192    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:30.918270 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.918221    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:30.918978 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.918961    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:30.919053 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.918989    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:30.919053 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:30.918999    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:30.930291 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.930265    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:30.937533 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.937510    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-47.ec2.internal\" not found" node="ip-10-0-131-47.ec2.internal"
Sep 08 16:30:30.941832 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:30.941815    2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-47.ec2.internal\" not found" node="ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.012568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.012528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68defcdbb2da9f7cb5b175cccb2ea2c9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-47.ec2.internal\" (UID: \"68defcdbb2da9f7cb5b175cccb2ea2c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.012759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.012562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf9d0993412bc723b85854f04de3a2a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"bf9d0993412bc723b85854f04de3a2a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.012759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.012614    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9d0993412bc723b85854f04de3a2a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"bf9d0993412bc723b85854f04de3a2a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.030675 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.030640    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.113493 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.113450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf9d0993412bc723b85854f04de3a2a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"bf9d0993412bc723b85854f04de3a2a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.113658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.113504    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9d0993412bc723b85854f04de3a2a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"bf9d0993412bc723b85854f04de3a2a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.113658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.113521    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68defcdbb2da9f7cb5b175cccb2ea2c9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-47.ec2.internal\" (UID: \"68defcdbb2da9f7cb5b175cccb2ea2c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.113658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.113594    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9d0993412bc723b85854f04de3a2a2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"bf9d0993412bc723b85854f04de3a2a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.113658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.113620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68defcdbb2da9f7cb5b175cccb2ea2c9-config\") pod \"kube-apiserver-proxy-ip-10-0-131-47.ec2.internal\" (UID: \"68defcdbb2da9f7cb5b175cccb2ea2c9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.113658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.113584    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bf9d0993412bc723b85854f04de3a2a2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal\" (UID: \"bf9d0993412bc723b85854f04de3a2a2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.130869 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.130790    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.231748 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.231711    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.240886 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.240852    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.246114 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.245894    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:31.332784 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.332742    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.433343 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.433259    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.533849 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.533806    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.632153 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.632123    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:31.634668 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.634647    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.639777 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.639745    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 16:30:31.639918 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.639899    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 16:30:31.639974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.639919    2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 16:30:31.654214 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.654182    2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:31.735174 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.735079    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.760253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.760212    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 16:25:32 +0000 UTC" deadline="2028-02-25 11:08:22.859410354 +0000 UTC"
Sep 08 16:30:31.760253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.760248    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12834h37m51.099165779s"
Sep 08 16:30:31.829143 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:31.829104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68defcdbb2da9f7cb5b175cccb2ea2c9.slice/crio-1c7310ce73aa32094a9636bcb5dc63fe26d5e4a9b179b9ca20d8b0759771442e WatchSource:0}: Error finding container 1c7310ce73aa32094a9636bcb5dc63fe26d5e4a9b179b9ca20d8b0759771442e: Status 404 returned error can't find the container with id 1c7310ce73aa32094a9636bcb5dc63fe26d5e4a9b179b9ca20d8b0759771442e
Sep 08 16:30:31.829396 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:31.829370    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9d0993412bc723b85854f04de3a2a2.slice/crio-e3c98b0cae26ba72cd03e9437c83ccf39e0f824a9985b54a200b67ed8d4b4dd0 WatchSource:0}: Error finding container e3c98b0cae26ba72cd03e9437c83ccf39e0f824a9985b54a200b67ed8d4b4dd0: Status 404 returned error can't find the container with id e3c98b0cae26ba72cd03e9437c83ccf39e0f824a9985b54a200b67ed8d4b4dd0
Sep 08 16:30:31.833951 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.833932    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:30:31.835602 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.835582    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:31.841636 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.841613    2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 16:30:31.842588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.842569    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 16:30:31.842695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.842607    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 16:30:31.842695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:31.842622    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeHasSufficientPID"
Sep 08 16:30:31.936446 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:31.936395    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:32.036956 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:32.036925    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:32.137540 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:32.137505    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:33.887625 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:33.887586    2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-47.ec2.internal\" not found"
Sep 08 16:30:33.907345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:33.907316    2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:33.960870 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:33.960791    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:33.972849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:33.972814    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 16:30:33.973966 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:33.973949    2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal"
Sep 08 16:30:33.984889 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:33.984861    2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 16:30:34.339825 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.339742    2581 apiserver.go:52] "Watching apiserver"
Sep 08 16:30:34.347340 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.347308    2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 16:30:34.348463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.348427    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-v4llq","kube-system/global-pull-secret-syncer-qhq59","kube-system/konnectivity-agent-7ggbr","openshift-cluster-node-tuning-operator/tuned-s8snx","openshift-dns/node-resolver-spd2m","openshift-image-registry/node-ca-zvrpv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal","openshift-multus/multus-kgxbg","openshift-network-operator/iptables-alerter-j82r7","kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778","openshift-multus/multus-additional-cni-plugins-2mln5","openshift-multus/network-metrics-daemon-2xzdt","openshift-network-diagnostics/network-check-target-jcwk9"]
Sep 08 16:30:34.351084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.351058    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.351198 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.351142    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:34.353185 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.353153    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.353297 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.353236    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:34.358272 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.358249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.360858 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.360355    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 16:30:34.360858 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.360388    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.361357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.361337    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rcwqc\""
Sep 08 16:30:34.361671 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.361654    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 16:30:34.361927 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.361912    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 16:30:34.362538 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.362522    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.363361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.363338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.363925 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.363901    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.364014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.363955    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bl5d2\""
Sep 08 16:30:34.365515 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.365496    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.366014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.365991    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.366532 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.366510    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.366950 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.366935    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fgdln\""
Sep 08 16:30:34.367889 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.367730    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.368494 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.368085    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.368494 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.368263    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 16:30:34.368598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.368556    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-r2w9c\""
Sep 08 16:30:34.368639 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.368604    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.370491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.370467    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.376234 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.376203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:34.376362 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.376301    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:34.376520 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.376502    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.377016 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.376991    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.377363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.377346    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 16:30:34.377670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.377654    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.377934 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.377891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hkw95\""
Sep 08 16:30:34.378131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378101    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 16:30:34.378335 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378313    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-host\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.378414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-tuned\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.378414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378394    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b571ac4f-aa42-485c-a499-31ec1ce3ca21-hosts-file\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.378511 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b571ac4f-aa42-485c-a499-31ec1ce3ca21-tmp-dir\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.378511 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378468    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kccwq\" (UniqueName: \"kubernetes.io/projected/b571ac4f-aa42-485c-a499-31ec1ce3ca21-kube-api-access-kccwq\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.378609 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.378609 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b37c92e-b1a1-449a-b8df-88ccdce752d4-agent-certs\") pod \"konnectivity-agent-7ggbr\" (UID: \"6b37c92e-b1a1-449a-b8df-88ccdce752d4\") " pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.378704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378631    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f98447df-0d7e-4dc2-98a3-086a49235fb6-tmp\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.378704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd2vc\" (UniqueName: \"kubernetes.io/projected/f98447df-0d7e-4dc2-98a3-086a49235fb6-kube-api-access-kd2vc\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.378802 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378722    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/640c101e-4720-47c2-97a7-742527783b4a-kubelet-config\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.378802 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378760    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/640c101e-4720-47c2-97a7-742527783b4a-dbus\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.378912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysconfig\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.378912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378827    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-kubernetes\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.378912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378878    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysctl-conf\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.379058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378931    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-systemd\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.379058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.378988    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7lrb\" (UniqueName: \"kubernetes.io/projected/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-kube-api-access-f7lrb\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.379058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379016    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 16:30:34.379201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379189    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 16:30:34.379298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379018    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.379370 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b37c92e-b1a1-449a-b8df-88ccdce752d4-konnectivity-ca\") pod \"konnectivity-agent-7ggbr\" (UID: \"6b37c92e-b1a1-449a-b8df-88ccdce752d4\") " pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.379370 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysctl-d\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.379487 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379469    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-run\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.380483 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379750    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.380866 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.379882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.380995 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.380977    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.381885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.380329    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-ps52j\""
Sep 08 16:30:34.383252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.382289    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.383252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.382307    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 16:30:34.383252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.382592    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.383252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.382894    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 16:30:34.383252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.382966    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8dnfs\""
Sep 08 16:30:34.383252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.383088    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 16:30:34.383665 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.383643    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.383961 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.383939    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384140    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cvhxf\""
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.380442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-sys\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-var-lib-kubelet\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-modprobe-d\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384352    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384374    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-lib-modules\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384478    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384582    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xnw89\""
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384590    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 16:30:34.385212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.384730    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 16:30:34.385910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.385887    2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 16:30:34.415034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.414026    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jts9c"
Sep 08 16:30:34.425046 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.425019    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jts9c"
Sep 08 16:30:34.462016 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.461986    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 16:30:34.469020 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.468965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" event={"ID":"68defcdbb2da9f7cb5b175cccb2ea2c9","Type":"ContainerStarted","Data":"1c7310ce73aa32094a9636bcb5dc63fe26d5e4a9b179b9ca20d8b0759771442e"}
Sep 08 16:30:34.470814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.470784    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" event={"ID":"bf9d0993412bc723b85854f04de3a2a2","Type":"ContainerStarted","Data":"e3c98b0cae26ba72cd03e9437c83ccf39e0f824a9985b54a200b67ed8d4b4dd0"}
Sep 08 16:30:34.484810 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.484753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b37c92e-b1a1-449a-b8df-88ccdce752d4-konnectivity-ca\") pod \"konnectivity-agent-7ggbr\" (UID: \"6b37c92e-b1a1-449a-b8df-88ccdce752d4\") " pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.485104 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.484821    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysctl-d\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.485104 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-run\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.485220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-var-lib-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.485220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-cni-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.485220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485139    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysctl-d\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.485220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485162    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-hostroot\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485243    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485252    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-run\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485273    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-modprobe-d\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b571ac4f-aa42-485c-a499-31ec1ce3ca21-tmp-dir\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kccwq\" (UniqueName: \"kubernetes.io/projected/b571ac4f-aa42-485c-a499-31ec1ce3ca21-kube-api-access-kccwq\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485349    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-run-netns\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f9d4276-bad2-4034-8011-0ba5b03a071c-serviceca\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485378    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3039dd15-d556-414e-b1d4-36556ee85f6d-cni-binary-copy\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485392    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-log-socket\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hr2tp\" (UniqueName: \"kubernetes.io/projected/7410971c-bb47-449c-adf9-6be20e3e332c-kube-api-access-hr2tp\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-modprobe-d\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485446    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skgpg\" (UniqueName: \"kubernetes.io/projected/ce87c54d-5305-49d3-8180-412d2aad997b-kube-api-access-skgpg\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.485468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-kubernetes\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485528    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485647    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-kubernetes\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485713    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-ovnkube-config\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b571ac4f-aa42-485c-a499-31ec1ce3ca21-tmp-dir\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-ovnkube-script-lib\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-system-cni-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485957    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-daemon-config\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7lrb\" (UniqueName: \"kubernetes.io/projected/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-kube-api-access-f7lrb\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.486008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.485999    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-tuned\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-kubelet\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486046    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-env-overrides\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-lib-modules\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486117    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-host\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486132    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4b04399-60ff-45ee-992f-e680b8f498a8-ovn-node-metrics-cert\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dsv\" (UniqueName: \"kubernetes.io/projected/7f9d4276-bad2-4034-8011-0ba5b03a071c-kube-api-access-z8dsv\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486182    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f98447df-0d7e-4dc2-98a3-086a49235fb6-tmp\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd2vc\" (UniqueName: \"kubernetes.io/projected/f98447df-0d7e-4dc2-98a3-086a49235fb6-kube-api-access-kd2vc\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486229    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-k8s-cni-cncf-io\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486244    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtt24\" (UniqueName: \"kubernetes.io/projected/77e29550-28a7-47dc-979d-52e72877e925-kube-api-access-qtt24\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/640c101e-4720-47c2-97a7-742527783b4a-kubelet-config\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/640c101e-4720-47c2-97a7-742527783b4a-dbus\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486315    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-systemd\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-systemd\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-var-lib-kubelet\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-systemd-units\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486473    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-systemd\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-etc-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-cni-multus\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486619    2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486684    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-host\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/640c101e-4720-47c2-97a7-742527783b4a-kubelet-config\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486743    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/640c101e-4720-47c2-97a7-742527783b4a-dbus\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486802    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6b37c92e-b1a1-449a-b8df-88ccdce752d4-konnectivity-ca\") pod \"konnectivity-agent-7ggbr\" (UID: \"6b37c92e-b1a1-449a-b8df-88ccdce752d4\") " pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-lib-modules\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gxx2\" (UniqueName: \"kubernetes.io/projected/3039dd15-d556-414e-b1d4-36556ee85f6d-kube-api-access-6gxx2\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.486933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486933    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-device-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486966    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-slash\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.486987    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-var-lib-kubelet\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487001    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqtlz\" (UniqueName: \"kubernetes.io/projected/e4b04399-60ff-45ee-992f-e680b8f498a8-kube-api-access-mqtlz\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487086    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-node-log\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.487151    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487195    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-cni-netd\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487267    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-cni-bin\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.487301    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:30:34.987267877 +0000 UTC m=+2.975703832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487392    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysconfig\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487440    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-ovn\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487462    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-cnibin\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysconfig\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487486    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-socket-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487513    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.487801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-sys\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.487626    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487640    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b571ac4f-aa42-485c-a499-31ec1ce3ca21-hosts-file\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.487671    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:30:34.987654646 +0000 UTC m=+2.976090578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-netns\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b571ac4f-aa42-485c-a499-31ec1ce3ca21-hosts-file\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487721    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-cni-bin\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f9d4276-bad2-4034-8011-0ba5b03a071c-host\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487752    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-sys\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487776    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-kubelet\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-multus-certs\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487817    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487865    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b37c92e-b1a1-449a-b8df-88ccdce752d4-agent-certs\") pod \"konnectivity-agent-7ggbr\" (UID: \"6b37c92e-b1a1-449a-b8df-88ccdce752d4\") " pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7410971c-bb47-449c-adf9-6be20e3e332c-host-slash\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487912    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-socket-dir-parent\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-system-cni-dir\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-cnibin\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.488788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487965    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysctl-conf\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7410971c-bb47-449c-adf9-6be20e3e332c-iptables-alerter-script\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.487993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-conf-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.488006    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-etc-kubernetes\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.488020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-registration-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.488034    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-sys-fs\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.488049    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.489946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.488176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-sysctl-conf\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.491174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.491149    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f98447df-0d7e-4dc2-98a3-086a49235fb6-tmp\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.491277 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.491205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f98447df-0d7e-4dc2-98a3-086a49235fb6-etc-tuned\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.492855 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.492818    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6b37c92e-b1a1-449a-b8df-88ccdce752d4-agent-certs\") pod \"konnectivity-agent-7ggbr\" (UID: \"6b37c92e-b1a1-449a-b8df-88ccdce752d4\") " pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.496483 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.496448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7lrb\" (UniqueName: \"kubernetes.io/projected/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-kube-api-access-f7lrb\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.497325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.497290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kccwq\" (UniqueName: \"kubernetes.io/projected/b571ac4f-aa42-485c-a499-31ec1ce3ca21-kube-api-access-kccwq\") pod \"node-resolver-spd2m\" (UID: \"b571ac4f-aa42-485c-a499-31ec1ce3ca21\") " pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.498512 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.498487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd2vc\" (UniqueName: \"kubernetes.io/projected/f98447df-0d7e-4dc2-98a3-086a49235fb6-kube-api-access-kd2vc\") pod \"tuned-s8snx\" (UID: \"f98447df-0d7e-4dc2-98a3-086a49235fb6\") " pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.526707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.526664    2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:34.588576 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588532    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-run-netns\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.588576 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f9d4276-bad2-4034-8011-0ba5b03a071c-serviceca\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3039dd15-d556-414e-b1d4-36556ee85f6d-cni-binary-copy\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588635    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-log-socket\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-run-netns\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hr2tp\" (UniqueName: \"kubernetes.io/projected/7410971c-bb47-449c-adf9-6be20e3e332c-kube-api-access-hr2tp\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skgpg\" (UniqueName: \"kubernetes.io/projected/ce87c54d-5305-49d3-8180-412d2aad997b-kube-api-access-skgpg\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588725    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588794    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-ovnkube-config\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.588854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588820    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-ovnkube-script-lib\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-system-cni-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-daemon-config\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588913    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-kubelet\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588935    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-env-overrides\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588958    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.588984    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4b04399-60ff-45ee-992f-e680b8f498a8-ovn-node-metrics-cert\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dsv\" (UniqueName: \"kubernetes.io/projected/7f9d4276-bad2-4034-8011-0ba5b03a071c-kube-api-access-z8dsv\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-k8s-cni-cncf-io\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589057    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtt24\" (UniqueName: \"kubernetes.io/projected/77e29550-28a7-47dc-979d-52e72877e925-kube-api-access-qtt24\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589083    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-systemd\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-systemd-units\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-etc-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589155    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-cni-multus\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.589294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gxx2\" (UniqueName: \"kubernetes.io/projected/3039dd15-d556-414e-b1d4-36556ee85f6d-kube-api-access-6gxx2\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-device-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589217    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-slash\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589231    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqtlz\" (UniqueName: \"kubernetes.io/projected/e4b04399-60ff-45ee-992f-e680b8f498a8-kube-api-access-mqtlz\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589269    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3039dd15-d556-414e-b1d4-36556ee85f6d-cni-binary-copy\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589388    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-log-socket\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589708    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f9d4276-bad2-4034-8011-0ba5b03a071c-serviceca\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589755    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-node-log\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589792    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-cni-netd\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-cni-bin\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589828    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-ovn\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589867    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-cnibin\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589896    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-socket-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-netns\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589971    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-cni-bin\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.589995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f9d4276-bad2-4034-8011-0ba5b03a071c-host\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-kubelet\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.590201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590044    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-multus-certs\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590064    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7410971c-bb47-449c-adf9-6be20e3e332c-host-slash\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-socket-dir-parent\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-system-cni-dir\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590160    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-cnibin\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590178    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7410971c-bb47-449c-adf9-6be20e3e332c-iptables-alerter-script\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-conf-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590220    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-etc-kubernetes\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590263    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-registration-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590296    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-sys-fs\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590306    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590314    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590346    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-var-lib-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590367    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-cni-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590394    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-hostroot\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590440    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.591096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590792    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-node-log\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590868    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-cni-binary-copy\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-cni-netd\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590899    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-cni-bin\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590935    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-systemd\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-etc-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-run-ovn\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591061    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-cnibin\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591165    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-socket-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591167    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-cni-multus\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591220    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-netns\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-cni-bin\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f9d4276-bad2-4034-8011-0ba5b03a071c-host\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-device-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-var-lib-kubelet\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.591899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591367    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-slash\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591379    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-multus-certs\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591402    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-var-lib-openvswitch\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591464    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-cni-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591489    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7410971c-bb47-449c-adf9-6be20e3e332c-host-slash\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-env-overrides\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591506    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-hostroot\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-socket-dir-parent\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591549    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-system-cni-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-system-cni-dir\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591601    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-host-kubelet\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.590264    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/77e29550-28a7-47dc-979d-52e72877e925-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591639    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-cnibin\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591657    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-conf-dir\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-etc-kubernetes\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591747    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-registration-dir\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.591789    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3039dd15-d556-414e-b1d4-36556ee85f6d-host-run-k8s-cni-cncf-io\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.592826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.592013    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-ovnkube-script-lib\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.593766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.592053    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.593766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.592085    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7410971c-bb47-449c-adf9-6be20e3e332c-iptables-alerter-script\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.593766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.592176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/77e29550-28a7-47dc-979d-52e72877e925-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.593766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.592205    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ce87c54d-5305-49d3-8180-412d2aad997b-sys-fs\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.593766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.592202    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3039dd15-d556-414e-b1d4-36556ee85f6d-multus-daemon-config\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.597673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.594965    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4b04399-60ff-45ee-992f-e680b8f498a8-systemd-units\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.597673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.595239    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4b04399-60ff-45ee-992f-e680b8f498a8-ovn-node-metrics-cert\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.597673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.595470    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4b04399-60ff-45ee-992f-e680b8f498a8-ovnkube-config\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.603410 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.603380    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:34.603410 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.603412    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:34.603601 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.603428    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:34.603601 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.603505    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:35.103482839 +0000 UTC m=+3.091918774 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:34.606603 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.606551    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skgpg\" (UniqueName: \"kubernetes.io/projected/ce87c54d-5305-49d3-8180-412d2aad997b-kube-api-access-skgpg\") pod \"aws-ebs-csi-driver-node-7l778\" (UID: \"ce87c54d-5305-49d3-8180-412d2aad997b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.608579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.608352    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dsv\" (UniqueName: \"kubernetes.io/projected/7f9d4276-bad2-4034-8011-0ba5b03a071c-kube-api-access-z8dsv\") pod \"node-ca-zvrpv\" (UID: \"7f9d4276-bad2-4034-8011-0ba5b03a071c\") " pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.608579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.608532    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtt24\" (UniqueName: \"kubernetes.io/projected/77e29550-28a7-47dc-979d-52e72877e925-kube-api-access-qtt24\") pod \"multus-additional-cni-plugins-2mln5\" (UID: \"77e29550-28a7-47dc-979d-52e72877e925\") " pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.608769 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.608726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hr2tp\" (UniqueName: \"kubernetes.io/projected/7410971c-bb47-449c-adf9-6be20e3e332c-kube-api-access-hr2tp\") pod \"iptables-alerter-j82r7\" (UID: \"7410971c-bb47-449c-adf9-6be20e3e332c\") " pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.609566 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.609198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqtlz\" (UniqueName: \"kubernetes.io/projected/e4b04399-60ff-45ee-992f-e680b8f498a8-kube-api-access-mqtlz\") pod \"ovnkube-node-v4llq\" (UID: \"e4b04399-60ff-45ee-992f-e680b8f498a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.609566 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.609529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gxx2\" (UniqueName: \"kubernetes.io/projected/3039dd15-d556-414e-b1d4-36556ee85f6d-kube-api-access-6gxx2\") pod \"multus-kgxbg\" (UID: \"3039dd15-d556-414e-b1d4-36556ee85f6d\") " pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.678320 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.678280    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:34.691881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.691828    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s8snx"
Sep 08 16:30:34.702784 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.702757    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-spd2m"
Sep 08 16:30:34.707597 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.707567    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zvrpv"
Sep 08 16:30:34.716380 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.716347    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:34.724360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.724331    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kgxbg"
Sep 08 16:30:34.733300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.733276    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-j82r7"
Sep 08 16:30:34.742183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.742152    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778"
Sep 08 16:30:34.750033 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.750002    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2mln5"
Sep 08 16:30:34.992761 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.992717    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:34.992963 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:34.992772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:34.992963 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.992892    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:34.992963 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.992905    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:34.993079 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.992969    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:30:35.99295225 +0000 UTC m=+3.981388202 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:34.993079 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:34.992985    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:30:35.992978667 +0000 UTC m=+3.981414599 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:35.193981 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:35.193901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:35.194160 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.194082    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:35.194160 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.194112    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:35.194160 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.194124    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:35.194257 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.194187    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:36.194167757 +0000 UTC m=+4.182603706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:35.428477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:35.428439    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 16:25:34 +0000 UTC" deadline="2028-05-09 23:17:20.045888219 +0000 UTC"
Sep 08 16:30:35.428477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:35.428480    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14622h46m44.61741643s"
Sep 08 16:30:35.554897 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.554874    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b04399_60ff_45ee_992f_e680b8f498a8.slice/crio-9095d76fb6feb043bff7614a2d4698f50a285794974276e49d3aa87e5aaa1f6b WatchSource:0}: Error finding container 9095d76fb6feb043bff7614a2d4698f50a285794974276e49d3aa87e5aaa1f6b: Status 404 returned error can't find the container with id 9095d76fb6feb043bff7614a2d4698f50a285794974276e49d3aa87e5aaa1f6b
Sep 08 16:30:35.558889 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.558857    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f9d4276_bad2_4034_8011_0ba5b03a071c.slice/crio-875ab4781529e66d35c8d1188b1554b485cedd91bad68011fba0a757516e8a99 WatchSource:0}: Error finding container 875ab4781529e66d35c8d1188b1554b485cedd91bad68011fba0a757516e8a99: Status 404 returned error can't find the container with id 875ab4781529e66d35c8d1188b1554b485cedd91bad68011fba0a757516e8a99
Sep 08 16:30:35.561324 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.560663    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77e29550_28a7_47dc_979d_52e72877e925.slice/crio-6308c23f115a474800e8803e4a2e9e51ec8ebf5d50abd7f6cc50b9449d7a8c27 WatchSource:0}: Error finding container 6308c23f115a474800e8803e4a2e9e51ec8ebf5d50abd7f6cc50b9449d7a8c27: Status 404 returned error can't find the container with id 6308c23f115a474800e8803e4a2e9e51ec8ebf5d50abd7f6cc50b9449d7a8c27
Sep 08 16:30:35.562120 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.561565    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb571ac4f_aa42_485c_a499_31ec1ce3ca21.slice/crio-e61cafa9397438d7bbb87742dec4a09b8796623738d8ceb89ed5c5bd5df92a61 WatchSource:0}: Error finding container e61cafa9397438d7bbb87742dec4a09b8796623738d8ceb89ed5c5bd5df92a61: Status 404 returned error can't find the container with id e61cafa9397438d7bbb87742dec4a09b8796623738d8ceb89ed5c5bd5df92a61
Sep 08 16:30:35.564276 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.562814    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3039dd15_d556_414e_b1d4_36556ee85f6d.slice/crio-46a9f17209d812561e53336c8aa8e51cce2d8640c8027611557f081ee5920771 WatchSource:0}: Error finding container 46a9f17209d812561e53336c8aa8e51cce2d8640c8027611557f081ee5920771: Status 404 returned error can't find the container with id 46a9f17209d812561e53336c8aa8e51cce2d8640c8027611557f081ee5920771
Sep 08 16:30:35.564276 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.563753    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b37c92e_b1a1_449a_b8df_88ccdce752d4.slice/crio-984a559af4c531983bbb5758ca63e370e00ea4415ca31b8d8208035a474f90c1 WatchSource:0}: Error finding container 984a559af4c531983bbb5758ca63e370e00ea4415ca31b8d8208035a474f90c1: Status 404 returned error can't find the container with id 984a559af4c531983bbb5758ca63e370e00ea4415ca31b8d8208035a474f90c1
Sep 08 16:30:35.568014 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:30:35.567963    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7410971c_bb47_449c_adf9_6be20e3e332c.slice/crio-43f8fa4e4921e8b8aa3bd601dfca2bff1145aa10114db712db2976cd34e7e393 WatchSource:0}: Error finding container 43f8fa4e4921e8b8aa3bd601dfca2bff1145aa10114db712db2976cd34e7e393: Status 404 returned error can't find the container with id 43f8fa4e4921e8b8aa3bd601dfca2bff1145aa10114db712db2976cd34e7e393
Sep 08 16:30:35.834561 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:35.834382    2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 16:30:35.999148 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:35.999114    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:35.999305 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:35.999156    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:35.999372 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.999350    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:35.999431 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.999414    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:30:37.999395 +0000 UTC m=+5.987830951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:35.999850 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.999813    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:35.999921 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:35.999885    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:30:37.999870465 +0000 UTC m=+5.988306412 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:36.201147 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.201106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:36.201335 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.201318    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:36.201414 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.201339    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:36.201414 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.201352    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:36.201414 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.201413    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:38.201394266 +0000 UTC m=+6.189830219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:36.429554 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.429451    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 16:25:34 +0000 UTC" deadline="2028-02-22 12:40:08.527025268 +0000 UTC"
Sep 08 16:30:36.429554 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.429514    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12764h9m32.097516176s"
Sep 08 16:30:36.462347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.461961    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:36.462347 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.462074    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:36.462347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.461958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:36.462347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.462139    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:36.462347 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.462249    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:36.462347 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:36.462328    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:36.495939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.495904    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j82r7" event={"ID":"7410971c-bb47-449c-adf9-6be20e3e332c","Type":"ContainerStarted","Data":"43f8fa4e4921e8b8aa3bd601dfca2bff1145aa10114db712db2976cd34e7e393"}
Sep 08 16:30:36.515690 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.515493    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778" event={"ID":"ce87c54d-5305-49d3-8180-412d2aad997b","Type":"ContainerStarted","Data":"e03a08a8dbede7b002c74b6491ee94e1b500c0feab7e235a65feb1f28c54c960"}
Sep 08 16:30:36.530189 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.530086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s8snx" event={"ID":"f98447df-0d7e-4dc2-98a3-086a49235fb6","Type":"ContainerStarted","Data":"77b5b7a7cf078104898db534e4afb3f62c50fd3b99cf137ce69990c870cbe127"}
Sep 08 16:30:36.534468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.534432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerStarted","Data":"6308c23f115a474800e8803e4a2e9e51ec8ebf5d50abd7f6cc50b9449d7a8c27"}
Sep 08 16:30:36.537066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.537021    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgxbg" event={"ID":"3039dd15-d556-414e-b1d4-36556ee85f6d","Type":"ContainerStarted","Data":"46a9f17209d812561e53336c8aa8e51cce2d8640c8027611557f081ee5920771"}
Sep 08 16:30:36.542470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.542380    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zvrpv" event={"ID":"7f9d4276-bad2-4034-8011-0ba5b03a071c","Type":"ContainerStarted","Data":"875ab4781529e66d35c8d1188b1554b485cedd91bad68011fba0a757516e8a99"}
Sep 08 16:30:36.545502 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.545365    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"9095d76fb6feb043bff7614a2d4698f50a285794974276e49d3aa87e5aaa1f6b"}
Sep 08 16:30:36.556869 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.556816    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" event={"ID":"68defcdbb2da9f7cb5b175cccb2ea2c9","Type":"ContainerStarted","Data":"1a68069f3d6379935308a9d03d5a1b10aa44d3874407515561ded01d437758e6"}
Sep 08 16:30:36.567713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.567682    2581 generic.go:356] "Generic (PLEG): container finished" podID="bf9d0993412bc723b85854f04de3a2a2" containerID="5c752deec80cbf9bb47057a157d47c16aa7d0633146156ae0e598f147bf9e9fe" exitCode=0
Sep 08 16:30:36.567871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.567767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" event={"ID":"bf9d0993412bc723b85854f04de3a2a2","Type":"ContainerDied","Data":"5c752deec80cbf9bb47057a157d47c16aa7d0633146156ae0e598f147bf9e9fe"}
Sep 08 16:30:36.578008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.577976    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ggbr" event={"ID":"6b37c92e-b1a1-449a-b8df-88ccdce752d4","Type":"ContainerStarted","Data":"984a559af4c531983bbb5758ca63e370e00ea4415ca31b8d8208035a474f90c1"}
Sep 08 16:30:36.581822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.581796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-spd2m" event={"ID":"b571ac4f-aa42-485c-a499-31ec1ce3ca21","Type":"ContainerStarted","Data":"e61cafa9397438d7bbb87742dec4a09b8796623738d8ceb89ed5c5bd5df92a61"}
Sep 08 16:30:36.588529 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:36.588474    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-47.ec2.internal" podStartSLOduration=3.588453824 podStartE2EDuration="3.588453824s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:36.572747028 +0000 UTC m=+4.561182984" watchObservedRunningTime="2026-09-08 16:30:36.588453824 +0000 UTC m=+4.576889779"
Sep 08 16:30:37.602021 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:37.601936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" event={"ID":"bf9d0993412bc723b85854f04de3a2a2","Type":"ContainerStarted","Data":"a9aa71f02d1c82615b955f3797c917ac3665f631643271fd2c320fe3b55f373c"}
Sep 08 16:30:38.017353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:38.017286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:38.017353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:38.017339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:38.017612 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.017491    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:38.017612 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.017493    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:38.017612 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.017560    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:30:42.017542331 +0000 UTC m=+10.005978276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:38.017612 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.017580    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:30:42.017569958 +0000 UTC m=+10.006005904 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:38.218267 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:38.218232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:38.218445 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.218398    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:38.218445 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.218417    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:38.218445 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.218427    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:38.218639 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.218473    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:42.218459041 +0000 UTC m=+10.206894986 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:38.462018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:38.461981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:38.462204 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.462127    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:38.462524 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:38.461982    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:38.462622 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.462597    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:38.462984 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:38.462794    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:38.462984 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:38.462919    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:40.461869 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:40.461511    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:40.461869 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:40.461655    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:40.462353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:40.462135    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:40.462353 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:40.462255    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:40.462425 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:40.462393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:40.464406 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:40.462475    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:42.053784 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:42.053739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:42.053784 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:42.053788    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:42.054286 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.053942    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:42.054286 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.053952    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:42.054286 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.054023    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:30:50.054002883 +0000 UTC m=+18.042438815 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:42.054286 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.054040    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:30:50.054031292 +0000 UTC m=+18.042467225 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:42.255709 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:42.255623    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:42.255912 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.255808    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:42.255912 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.255857    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:42.255912 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.255873    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:42.256077 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.255937    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:30:50.255918763 +0000 UTC m=+18.244354712 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:42.473138 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:42.473089    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:42.473552 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:42.473493    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:42.473674 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.473606    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:42.474455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:42.473201    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:42.474455 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.474132    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:42.474455 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:42.474264    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:44.462993 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:44.462964    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:44.462993 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:44.462996    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:44.463521 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:44.462973    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:44.463521 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:44.463097    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:44.463521 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:44.463193    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:44.463521 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:44.463291    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:46.461611 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:46.461144    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:46.461611 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:46.461140    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:46.461611 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:46.461262    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:46.461611 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:46.461374    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:46.461611 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:46.461158    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:46.461611 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:46.461489    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:48.461097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:48.461057    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:48.461546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:48.461054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:48.461546 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:48.461192    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:48.461546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:48.461249    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:48.461546 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:48.461390    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:48.461546 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:48.461475    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:50.116849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:50.116807    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:50.117326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:50.116864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:50.117326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.116969    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:50.117326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.116985    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:50.117326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.117051    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:31:06.117030667 +0000 UTC m=+34.105466611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:30:50.117326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.117070    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:31:06.11706163 +0000 UTC m=+34.105497598 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:30:50.318646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:50.318606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:50.318809 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.318767    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:30:50.318809 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.318793    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:30:50.318809 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.318803    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:50.318958 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.318870    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:06.318854772 +0000 UTC m=+34.307290717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:30:50.460935 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:50.460896    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:50.460935 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:50.460944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:50.461153 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.461047    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:50.461509 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.461481    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:50.461657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:50.461637    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:50.461773 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:50.461745    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:52.462049 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:52.462011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:52.462506 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:52.462117    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:52.462506 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:52.462126    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:52.462506 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:52.462236    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:52.462506 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:52.462299    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:52.462506 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:52.462372    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:53.640478 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.640438    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-spd2m" event={"ID":"b571ac4f-aa42-485c-a499-31ec1ce3ca21","Type":"ContainerStarted","Data":"adb13fb5811864350d7dfd4f8827b4414857f6904b7067d3993d701847bf5617"}
Sep 08 16:30:53.642116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.642088    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778" event={"ID":"ce87c54d-5305-49d3-8180-412d2aad997b","Type":"ContainerStarted","Data":"690a482e49a70b349620f6329b8c46281092119ace7e5e66959cb1c3f270763c"}
Sep 08 16:30:53.643681 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.643653    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s8snx" event={"ID":"f98447df-0d7e-4dc2-98a3-086a49235fb6","Type":"ContainerStarted","Data":"b2c55a02461db79e2aae165155c9793ae49aa055a8fab398fdfb913dc84da3a0"}
Sep 08 16:30:53.645317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.645292    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e29550-28a7-47dc-979d-52e72877e925" containerID="e76a9bc6f27bf87e12c2468c9b999865ec7929231ef8c48e6e936a4bb2985515" exitCode=0
Sep 08 16:30:53.645414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.645382    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerDied","Data":"e76a9bc6f27bf87e12c2468c9b999865ec7929231ef8c48e6e936a4bb2985515"}
Sep 08 16:30:53.647111 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.647084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kgxbg" event={"ID":"3039dd15-d556-414e-b1d4-36556ee85f6d","Type":"ContainerStarted","Data":"0fe30930a506ee5a5b3bb0396bf2ecd76cf2b0b401d7173be1ea0d8cda65de7f"}
Sep 08 16:30:53.648765 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.648743    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zvrpv" event={"ID":"7f9d4276-bad2-4034-8011-0ba5b03a071c","Type":"ContainerStarted","Data":"7f376b0e698e90535cfbf4a03350b85fcbbbf2b5f129fdd9bdb0d628ff454724"}
Sep 08 16:30:53.650536 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.650513    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:30:53.650944 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.650911    2581 generic.go:356] "Generic (PLEG): container finished" podID="e4b04399-60ff-45ee-992f-e680b8f498a8" containerID="bad1539a028f3c2098a6aa199c541f4f600ec457d86c73331dc2031605d1bc52" exitCode=1
Sep 08 16:30:53.651045 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.650979    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerDied","Data":"bad1539a028f3c2098a6aa199c541f4f600ec457d86c73331dc2031605d1bc52"}
Sep 08 16:30:53.651099 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.651045    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"3f55a02e1772d799ca66f4ba2a1e8dec5e564b984907e8ad8ba5b8fd8b9b17d4"}
Sep 08 16:30:53.652747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.652719    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7ggbr" event={"ID":"6b37c92e-b1a1-449a-b8df-88ccdce752d4","Type":"ContainerStarted","Data":"b01bb3abfd9386fd2af18564cf48335d551fbd6990045f7a55a72c566a068ac4"}
Sep 08 16:30:53.659000 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.658945    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-47.ec2.internal" podStartSLOduration=20.658928588 podStartE2EDuration="20.658928588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:37.624743635 +0000 UTC m=+5.613179590" watchObservedRunningTime="2026-09-08 16:30:53.658928588 +0000 UTC m=+21.647364542"
Sep 08 16:30:53.687299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.687236    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-spd2m" podStartSLOduration=4.088902492 podStartE2EDuration="21.687215114s" totalImagesPullingTime="17.598312622s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:53.659456017 +0000 UTC m=+21.647891972" watchObservedRunningTime="2026-09-08 16:30:53.687215114 +0000 UTC m=+21.675651069"
Sep 08 16:30:53.687462 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.687435    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kgxbg" podStartSLOduration=4.004053108 podStartE2EDuration="21.687427457s" totalImagesPullingTime="17.683374349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:53.686942474 +0000 UTC m=+21.675378428" watchObservedRunningTime="2026-09-08 16:30:53.687427457 +0000 UTC m=+21.675863415"
Sep 08 16:30:53.708251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.708202    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7ggbr" podStartSLOduration=8.215978852 podStartE2EDuration="21.708184628s" totalImagesPullingTime="13.492205776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:53.707895738 +0000 UTC m=+21.696331703" watchObservedRunningTime="2026-09-08 16:30:53.708184628 +0000 UTC m=+21.696620582"
Sep 08 16:30:53.729378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.729322    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zvrpv" podStartSLOduration=4.486066226 podStartE2EDuration="21.729306801s" totalImagesPullingTime="17.243240575s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:53.728786814 +0000 UTC m=+21.717222767" watchObservedRunningTime="2026-09-08 16:30:53.729306801 +0000 UTC m=+21.717742754"
Sep 08 16:30:53.798767 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.798594    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s8snx" podStartSLOduration=4.228459852 podStartE2EDuration="21.798576302s" totalImagesPullingTime="17.57011645s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:53.798095975 +0000 UTC m=+21.786531929" watchObservedRunningTime="2026-09-08 16:30:53.798576302 +0000 UTC m=+21.787012351"
Sep 08 16:30:53.848621 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.848586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:53.928277 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:53.928229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:54.196259 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.196175    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-spd2m_b571ac4f-aa42-485c-a499-31ec1ce3ca21/dns-node-resolver/0.log"
Sep 08 16:30:54.231973 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.231934    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:54.302323 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.302270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:54.461883 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.461791    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:54.462023 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:54.461935    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:54.462452 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.462430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:54.462548 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:54.462510    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:54.462697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.462680    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:54.462810 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:54.462789    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:54.657967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.657936    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:30:54.658670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.658326    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"dd1fc07ac3c37e4df87f23f0953fe0f98fe7f2679526a61e8573ec2932aeb2b8"}
Sep 08 16:30:54.658670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.658409    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"772a716b6955deba0da5ed9d521c54f26b0c98d514597ceaf0dee372a75a9b3c"}
Sep 08 16:30:54.658670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.658453    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"1bfaec005ab7f0188a0a4217d0f8c04570436ecdb48bae84d0536a2ed73e22dc"}
Sep 08 16:30:54.658670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.658485    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"e0958b7345e4544ba5c26f829843192123b1308edee48dc8adc04b28a257bb30"}
Sep 08 16:30:54.666421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.666388    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:54.755252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.755217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:54.861656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.861600    2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 16:30:54.904981 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.904949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:54.988303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.988202    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:54.988949 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:54.988928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:55.067046 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.067008    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:55.193986 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.193958    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zvrpv_7f9d4276-bad2-4034-8011-0ba5b03a071c/node-ca/0.log"
Sep 08 16:30:55.197500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.197473    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:55.437579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.437472    2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T16:30:54.861620928Z","UUID":"8b5a2383-821e-47ce-8e74-a6b2f8862ee7","Handler":null,"Name":"","Endpoint":""}
Sep 08 16:30:55.439372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.439348    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 16:30:55.439490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.439380    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 16:30:55.663881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.663758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-j82r7" event={"ID":"7410971c-bb47-449c-adf9-6be20e3e332c","Type":"ContainerStarted","Data":"4b165b51cb6f93d4c22abaaf40ae395174a24cf4709735ae45a150032638be6a"}
Sep 08 16:30:55.666107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.666079    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778" event={"ID":"ce87c54d-5305-49d3-8180-412d2aad997b","Type":"ContainerStarted","Data":"afc8f70e20472a7be4fcc989b224e4206d8cd5418066eebd795cb7cf7a919adb"}
Sep 08 16:30:55.666806 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.666789    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7ggbr"
Sep 08 16:30:55.709137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.709028    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-j82r7" podStartSLOduration=6.138741981 podStartE2EDuration="23.709006074s" totalImagesPullingTime="17.570264093s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:55.685527393 +0000 UTC m=+23.673963348" watchObservedRunningTime="2026-09-08 16:30:55.709006074 +0000 UTC m=+23.697442029"
Sep 08 16:30:55.892926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:55.892887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:56.250483 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.250206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:56.364102 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.364063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:56.461716 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.461681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:56.461906 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.461681    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:56.461906 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:56.461809    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:56.461999 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:56.461909    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:56.461999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.461693    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:56.462068 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:56.462013    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:56.671234 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.671147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778" event={"ID":"ce87c54d-5305-49d3-8180-412d2aad997b","Type":"ContainerStarted","Data":"4afac8f0d3a07b28bc46d80a6bb6a5a2f1dcdd4ddc9e74d31045b87da5f52acc"}
Sep 08 16:30:56.674268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.674247    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:30:56.674606 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.674583    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"61e2d41699b9db7ad44b91adbb2eed2c085bdb58d12fe39260decbb78a14c120"}
Sep 08 16:30:56.697129 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.697027    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7l778" podStartSLOduration=5.106790037 podStartE2EDuration="24.696980826s" totalImagesPullingTime="19.590190789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:56.696735722 +0000 UTC m=+24.685171675" watchObservedRunningTime="2026-09-08 16:30:56.696980826 +0000 UTC m=+24.685416779"
Sep 08 16:30:56.781701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.781666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:56.903753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:56.903721    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:30:58.461508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.461470    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:30:58.462003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.461469    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:30:58.462003 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:58.461611    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:30:58.462003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.461627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:30:58.462003 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:58.461708    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:30:58.462003 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:30:58.461768    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:30:58.683757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.683730    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:30:58.684241 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.684207    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"eb65eac7af11f2e92c0d0063569765358f98cf37c8be748a2eb4372f79f90a2f"}
Sep 08 16:30:58.684512 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.684479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:58.685261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.684540    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:58.685261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.684806    2581 scope.go:117] "RemoveContainer" containerID="bad1539a028f3c2098a6aa199c541f4f600ec457d86c73331dc2031605d1bc52"
Sep 08 16:30:58.689481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.689449    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerStarted","Data":"a1c677fc2fe61ea6a668e8900838ba2a8268419286134e90d96f54919376107f"}
Sep 08 16:30:58.702518 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:58.702490    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:59.693920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.693714    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e29550-28a7-47dc-979d-52e72877e925" containerID="a1c677fc2fe61ea6a668e8900838ba2a8268419286134e90d96f54919376107f" exitCode=0
Sep 08 16:30:59.694400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.693802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerDied","Data":"a1c677fc2fe61ea6a668e8900838ba2a8268419286134e90d96f54919376107f"}
Sep 08 16:30:59.698034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.698017    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:30:59.698412 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.698388    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" event={"ID":"e4b04399-60ff-45ee-992f-e680b8f498a8","Type":"ContainerStarted","Data":"42eec5b3008183a72887b7804715ce5858e77a5fca7e518e2a814a0d0486648b"}
Sep 08 16:30:59.698645 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.698627    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:59.714680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.714653    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:30:59.757775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:30:59.757667    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq" podStartSLOduration=10.113403179 podStartE2EDuration="27.757650914s" totalImagesPullingTime="17.644247735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:30:59.756250636 +0000 UTC m=+27.744686600" watchObservedRunningTime="2026-09-08 16:30:59.757650914 +0000 UTC m=+27.746086868"
Sep 08 16:31:00.136108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.136026    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:00.340378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.340348    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:00.461196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.461170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:00.461363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.461170    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:00.461363 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:00.461272    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:00.461363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.461171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:00.461461 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:00.461362    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:00.461461 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:00.461414    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:00.522285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.522248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:00.622464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.622427    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:00.805771 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:00.805737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:01.176235 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:01.176155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:01.284288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:01.284247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:01.435449 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:01.435424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:01.705354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:01.705271    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e29550-28a7-47dc-979d-52e72877e925" containerID="d868371bc6ce09a55bc0a98b5cfb8970451b03fc0361148dc97a9d64c68fa84a" exitCode=0
Sep 08 16:31:01.705354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:01.705325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerDied","Data":"d868371bc6ce09a55bc0a98b5cfb8970451b03fc0361148dc97a9d64c68fa84a"}
Sep 08 16:31:02.420012 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:02.419981    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:02.461540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:02.461498    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:02.461733 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:02.461609    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:02.461733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:02.461632    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:02.461733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:02.461620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:02.461733 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:02.461699    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:02.461981 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:02.461776    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:02.670129 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:02.670000    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:02.838796 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:02.838770    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:03.613828 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:03.613789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:03.711821 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:03.711790    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e29550-28a7-47dc-979d-52e72877e925" containerID="bbcf38e89129316fd4dcf4e8010b1efd1549bf3a8ced4a05bc04f1ab9d17971d" exitCode=0
Sep 08 16:31:03.711994 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:03.711849    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerDied","Data":"bbcf38e89129316fd4dcf4e8010b1efd1549bf3a8ced4a05bc04f1ab9d17971d"}
Sep 08 16:31:03.715565 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:03.715540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:04.028465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.028433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:04.458531 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.458498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:04.461723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.461705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:04.461812 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:04.461793    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:04.461865 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.461705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:04.461915 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.461705    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:04.461915 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:04.461905    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:04.462001 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:04.461958    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:04.646172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.646136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:04.825250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:04.825165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:05.032167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:05.032132    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:05.230615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:05.230583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:05.331802 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:05.331774    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:05.452144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:05.452105    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:05.551358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:05.551282    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:05.653797 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:05.653760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:06.140138 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.140096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:06.140138 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.140137    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:06.140365 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.140230    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 16:31:06.140365 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.140240    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:31:06.140365 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.140284    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret podName:640c101e-4720-47c2-97a7-742527783b4a nodeName:}" failed. No retries permitted until 2026-09-08 16:31:38.14027037 +0000 UTC m=+66.128706316 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret") pod "global-pull-secret-syncer-qhq59" (UID: "640c101e-4720-47c2-97a7-742527783b4a") : object "kube-system"/"original-pull-secret" not registered
Sep 08 16:31:06.140365 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.140297    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs podName:e02a6337-79f6-47aa-8f2f-aaec08c9d13b nodeName:}" failed. No retries permitted until 2026-09-08 16:31:38.140290936 +0000 UTC m=+66.128726868 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs") pod "network-metrics-daemon-2xzdt" (UID: "e02a6337-79f6-47aa-8f2f-aaec08c9d13b") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 16:31:06.342004 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.341962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:06.342185 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.342134    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 16:31:06.342185 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.342159    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 16:31:06.342185 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.342168    2581 projected.go:196] Error preparing data for projected volume kube-api-access-j7985 for pod openshift-network-diagnostics/network-check-target-jcwk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:31:06.342285 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.342223    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985 podName:97942e10-27a9-4363-ae81-c160c6704611 nodeName:}" failed. No retries permitted until 2026-09-08 16:31:38.342209637 +0000 UTC m=+66.330645569 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-j7985" (UniqueName: "kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985") pod "network-check-target-jcwk9" (UID: "97942e10-27a9-4363-ae81-c160c6704611") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 16:31:06.461059 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.461020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:06.461255 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.461020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:06.461255 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.461137    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:06.461255 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.461218    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:06.461255 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.461020    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:06.461432 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:06.461312    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:06.634141 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.634108    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:06.833331 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:06.833248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:07.029313 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:07.029279    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:07.234916 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:07.234883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:07.433686 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:07.433647    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:07.631007 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:07.630922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:08.229766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:08.229728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:08.461067 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:08.461033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:08.461254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:08.461033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:08.461254 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:08.461163    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:08.461254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:08.461033    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:08.461420 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:08.461229    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:08.461420 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:08.461326    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:08.623435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:08.623326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:08.833652 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:08.833607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:09.427792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:09.427760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:09.621921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:09.621874    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:10.027695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.027594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:10.461008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.460971    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:10.461468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.460984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:10.461468 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:10.461112    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:10.461468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.460986    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:10.461468 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:10.461170    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:10.461468 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:10.461221    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:10.643133 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.643100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:10.730983 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.730885    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e29550-28a7-47dc-979d-52e72877e925" containerID="c410ff3784aadbb9f7a1ac123652525e5c371c0282a0af2cdd1fe1d01cfdd47e" exitCode=0
Sep 08 16:31:10.730983 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.730944    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerDied","Data":"c410ff3784aadbb9f7a1ac123652525e5c371c0282a0af2cdd1fe1d01cfdd47e"}
Sep 08 16:31:10.824518 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:10.824488    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:11.031317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:11.031229    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:11.736334 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:11.736297    2581 generic.go:356] "Generic (PLEG): container finished" podID="77e29550-28a7-47dc-979d-52e72877e925" containerID="7a4f754980f963462e4551b0145c60b1d55dc39f64013205663c54e49234d19e" exitCode=0
Sep 08 16:31:11.736877 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:11.736369    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerDied","Data":"7a4f754980f963462e4551b0145c60b1d55dc39f64013205663c54e49234d19e"}
Sep 08 16:31:11.763495 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:11.763457    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:11.863486 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:11.863442    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:12.464153 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:12.464123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:12.464340 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:12.464200    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:12.464340 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:12.464218    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:12.464340 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:12.464286    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:12.464340 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:12.464315    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:12.464552 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:12.464413    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:12.742633 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:12.742534    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2mln5" event={"ID":"77e29550-28a7-47dc-979d-52e72877e925","Type":"ContainerStarted","Data":"8be192ac40c2eafed2b16cbb0586c9903cd0d8f7949e0b19e0faa774962f6fce"}
Sep 08 16:31:14.461887 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:14.461686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:14.462330 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:14.461686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:14.462330 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:14.461953    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:14.462330 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:14.462073    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:14.462330 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:14.461686    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:14.462330 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:14.462154    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:14.687321 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:14.687277    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:14.782586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:14.782476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:15.012647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.012606    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:15.616614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.616574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:15.737397 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.737346    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2mln5" podStartSLOduration=13.275879365 podStartE2EDuration="43.737320891s" totalImagesPullingTime="30.461441526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:12.770299488 +0000 UTC m=+40.758735442" watchObservedRunningTime="2026-09-08 16:31:15.737320891 +0000 UTC m=+43.725756846"
Sep 08 16:31:15.737931 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.737904    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhq59"]
Sep 08 16:31:15.738069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.738023    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:15.738179 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:15.738140    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:15.740772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.740747    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jcwk9"]
Sep 08 16:31:15.741168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.741150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:15.741420 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:15.741393    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:15.741648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.741621    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2xzdt"]
Sep 08 16:31:15.741890 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:15.741871    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:15.742013 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:15.741992    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:16.232990 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:16.232958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:16.331242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:16.331210    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:16.417698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:16.417670    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:16.492236 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:16.492155    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:16.845746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:16.845659    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:16.946776 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:16.946743    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:17.461001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:17.460968    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:17.461001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:17.460998    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:17.461212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:17.460969    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:17.461212 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:17.461083    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:17.461212 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:17.461137    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:17.461307 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:17.461207    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:17.646319 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:17.646288    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:17.747405 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:17.747321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:18.190136 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:18.190103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:18.289242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:18.289207    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:18.862716 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:18.862680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:18.964767 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:18.964734    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:19.227801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:19.227768    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:19.328540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:19.328506    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:19.461080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:19.461044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:19.461080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:19.461078    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:19.461326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:19.461044    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:19.461326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:19.461165    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qhq59" podUID="640c101e-4720-47c2-97a7-742527783b4a"
Sep 08 16:31:19.461326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:19.461226    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jcwk9" podUID="97942e10-27a9-4363-ae81-c160c6704611"
Sep 08 16:31:19.461326 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:19.461285    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2xzdt" podUID="e02a6337-79f6-47aa-8f2f-aaec08c9d13b"
Sep 08 16:31:19.862647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:19.862609    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:20.059466 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.059429    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:20.157354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.157319    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:20.281128 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.281100    2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-47.ec2.internal" event="NodeReady"
Sep 08 16:31:20.281490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.281223    2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 16:31:20.356046 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.355957    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-86f9f"]
Sep 08 16:31:20.384964 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.384933    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wpptf"]
Sep 08 16:31:20.385122 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.385092    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.396128 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.396106    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 16:31:20.396252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.396241    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7zsf6\""
Sep 08 16:31:20.396296 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.396281    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 16:31:20.398884 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.398859    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-86f9f"]
Sep 08 16:31:20.398973 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.398944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.406327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.406303    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 16:31:20.406572 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.406557    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 16:31:20.406774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.406757    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 16:31:20.406849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.406794    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 16:31:20.406849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.406762    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mpsgj\""
Sep 08 16:31:20.421254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.421205    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wpptf"]
Sep 08 16:31:20.453514 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.453479    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2jxkw"]
Sep 08 16:31:20.472573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.472534    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.475854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.475810    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2jxkw"]
Sep 08 16:31:20.476284 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.476266    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 16:31:20.476710 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.476691    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 16:31:20.476800 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.476712    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-sqr8x\""
Sep 08 16:31:20.476991 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.476974    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 16:31:20.495046 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.495014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:20.549114 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549075    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.549256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a05ddf23-324a-4306-94db-ba8c35725f98-config-volume\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.549256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a05ddf23-324a-4306-94db-ba8c35725f98-metrics-tls\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.549256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549207    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-data-volume\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.549413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549273    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.549413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fmkf\" (UniqueName: \"kubernetes.io/projected/a05ddf23-324a-4306-94db-ba8c35725f98-kube-api-access-6fmkf\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.549413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549321    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-crio-socket\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.549413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhtzg\" (UniqueName: \"kubernetes.io/projected/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-kube-api-access-qhtzg\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.549413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.549382    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05ddf23-324a-4306-94db-ba8c35725f98-tmp-dir\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.570045 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.570014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:20.649897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.649799    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05c0e76-b0d6-404f-ab9a-345bad345f71-cert\") pod \"ingress-canary-2jxkw\" (UID: \"a05c0e76-b0d6-404f-ab9a-345bad345f71\") " pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.649897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.649863    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a05ddf23-324a-4306-94db-ba8c35725f98-config-volume\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.650073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.649915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a05ddf23-324a-4306-94db-ba8c35725f98-metrics-tls\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.650073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.649970    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-data-volume\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.649997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650016    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5b6k\" (UniqueName: \"kubernetes.io/projected/a05c0e76-b0d6-404f-ab9a-345bad345f71-kube-api-access-w5b6k\") pod \"ingress-canary-2jxkw\" (UID: \"a05c0e76-b0d6-404f-ab9a-345bad345f71\") " pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.650073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650037    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fmkf\" (UniqueName: \"kubernetes.io/projected/a05ddf23-324a-4306-94db-ba8c35725f98-kube-api-access-6fmkf\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.650073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650062    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-crio-socket\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650085    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhtzg\" (UniqueName: \"kubernetes.io/projected/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-kube-api-access-qhtzg\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650106    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05ddf23-324a-4306-94db-ba8c35725f98-tmp-dir\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.650332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650444    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-crio-socket\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650565 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650543    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-data-volume\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.650621 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a05ddf23-324a-4306-94db-ba8c35725f98-tmp-dir\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.650954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.650764    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a05ddf23-324a-4306-94db-ba8c35725f98-config-volume\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.652322 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.652297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:20.654362 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.654333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.654486 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.654369    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a05ddf23-324a-4306-94db-ba8c35725f98-metrics-tls\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.655494 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.655474    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.659114 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.659081    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fmkf\" (UniqueName: \"kubernetes.io/projected/a05ddf23-324a-4306-94db-ba8c35725f98-kube-api-access-6fmkf\") pod \"dns-default-86f9f\" (UID: \"a05ddf23-324a-4306-94db-ba8c35725f98\") " pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.659298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.659280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhtzg\" (UniqueName: \"kubernetes.io/projected/e852cdd4-a83f-47cd-a2b6-87a8f8b970d4-kube-api-access-qhtzg\") pod \"insights-runtime-extractor-wpptf\" (UID: \"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4\") " pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.695282 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.695245    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:20.707368 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.707338    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wpptf"
Sep 08 16:31:20.751354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.751319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05c0e76-b0d6-404f-ab9a-345bad345f71-cert\") pod \"ingress-canary-2jxkw\" (UID: \"a05c0e76-b0d6-404f-ab9a-345bad345f71\") " pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.751532 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.751420    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5b6k\" (UniqueName: \"kubernetes.io/projected/a05c0e76-b0d6-404f-ab9a-345bad345f71-kube-api-access-w5b6k\") pod \"ingress-canary-2jxkw\" (UID: \"a05c0e76-b0d6-404f-ab9a-345bad345f71\") " pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.754958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.754903    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a05c0e76-b0d6-404f-ab9a-345bad345f71-cert\") pod \"ingress-canary-2jxkw\" (UID: \"a05c0e76-b0d6-404f-ab9a-345bad345f71\") " pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.760638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.760606    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5b6k\" (UniqueName: \"kubernetes.io/projected/a05c0e76-b0d6-404f-ab9a-345bad345f71-kube-api-access-w5b6k\") pod \"ingress-canary-2jxkw\" (UID: \"a05c0e76-b0d6-404f-ab9a-345bad345f71\") " pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:20.782478 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:20.782195    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2jxkw"
Sep 08 16:31:21.005932 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.005894    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-86f9f"]
Sep 08 16:31:21.010771 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.010739    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wpptf"]
Sep 08 16:31:21.011266 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:21.011241    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05ddf23_324a_4306_94db_ba8c35725f98.slice/crio-c2eaa7648af7eab78e0d986b20f6859e3ffa8fd387327374fdce8297430a5932 WatchSource:0}: Error finding container c2eaa7648af7eab78e0d986b20f6859e3ffa8fd387327374fdce8297430a5932: Status 404 returned error can't find the container with id c2eaa7648af7eab78e0d986b20f6859e3ffa8fd387327374fdce8297430a5932
Sep 08 16:31:21.013987 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:21.013964    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode852cdd4_a83f_47cd_a2b6_87a8f8b970d4.slice/crio-e37c548b6ef1daa1978e66bc40df78e26d2716caafd24447ee03a1f4c238c884 WatchSource:0}: Error finding container e37c548b6ef1daa1978e66bc40df78e26d2716caafd24447ee03a1f4c238c884: Status 404 returned error can't find the container with id e37c548b6ef1daa1978e66bc40df78e26d2716caafd24447ee03a1f4c238c884
Sep 08 16:31:21.070224 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.070191    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2jxkw"]
Sep 08 16:31:21.074323 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:21.074292    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05c0e76_b0d6_404f_ab9a_345bad345f71.slice/crio-4784b378e0b9e862c30ce68419bc21ea7bb8ab6b418a8d2d41504e03da568393 WatchSource:0}: Error finding container 4784b378e0b9e862c30ce68419bc21ea7bb8ab6b418a8d2d41504e03da568393: Status 404 returned error can't find the container with id 4784b378e0b9e862c30ce68419bc21ea7bb8ab6b418a8d2d41504e03da568393
Sep 08 16:31:21.444503 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.444472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:21.460880 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.460820    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:21.460880 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.460885    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:21.461103 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.460856    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:21.464987 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.464959    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6b8s\""
Sep 08 16:31:21.465656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.465643    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 16:31:21.465929 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.465914    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86r89\""
Sep 08 16:31:21.465997 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.465980    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 16:31:21.466051 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.466035    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 16:31:21.468555 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.468202    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 16:31:21.482192 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.482167    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-smt86"]
Sep 08 16:31:21.499110 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.499075    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-smt86"]
Sep 08 16:31:21.499269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.499183    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.501877 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.501850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 16:31:21.502045 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.501850    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 16:31:21.502045 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.501926    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 16:31:21.502278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.502263    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 16:31:21.502314 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.502268    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-8b28p\""
Sep 08 16:31:21.502623 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.502606    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 16:31:21.521485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.521450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:21.658619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.658490    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9681c43-4c1c-4d15-a615-cb2892850dac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.658619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.658538    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs4dn\" (UniqueName: \"kubernetes.io/projected/d9681c43-4c1c-4d15-a615-cb2892850dac-kube-api-access-qs4dn\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.658878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.658618    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9681c43-4c1c-4d15-a615-cb2892850dac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.658878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.658669    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9681c43-4c1c-4d15-a615-cb2892850dac-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.743998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.743914    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:21.760124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.760089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9681c43-4c1c-4d15-a615-cb2892850dac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.760124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.760130    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9681c43-4c1c-4d15-a615-cb2892850dac-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.760315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.760232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9681c43-4c1c-4d15-a615-cb2892850dac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.760315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.760259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs4dn\" (UniqueName: \"kubernetes.io/projected/d9681c43-4c1c-4d15-a615-cb2892850dac-kube-api-access-qs4dn\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.761185 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.761132    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d9681c43-4c1c-4d15-a615-cb2892850dac-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.763877 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.763826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/d9681c43-4c1c-4d15-a615-cb2892850dac-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.765195 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.765166    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d9681c43-4c1c-4d15-a615-cb2892850dac-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.767728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.767695    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpptf" event={"ID":"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4","Type":"ContainerStarted","Data":"5c514d74b37f59f698b9b6ae07f0ba520f128bcea687ac1789a35f534ab1270e"}
Sep 08 16:31:21.767886 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.767771    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpptf" event={"ID":"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4","Type":"ContainerStarted","Data":"e37c548b6ef1daa1978e66bc40df78e26d2716caafd24447ee03a1f4c238c884"}
Sep 08 16:31:21.769521 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.769489    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2jxkw" event={"ID":"a05c0e76-b0d6-404f-ab9a-345bad345f71","Type":"ContainerStarted","Data":"4784b378e0b9e862c30ce68419bc21ea7bb8ab6b418a8d2d41504e03da568393"}
Sep 08 16:31:21.772093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.772056    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86f9f" event={"ID":"a05ddf23-324a-4306-94db-ba8c35725f98","Type":"ContainerStarted","Data":"c2eaa7648af7eab78e0d986b20f6859e3ffa8fd387327374fdce8297430a5932"}
Sep 08 16:31:21.776941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.776829    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs4dn\" (UniqueName: \"kubernetes.io/projected/d9681c43-4c1c-4d15-a615-cb2892850dac-kube-api-access-qs4dn\") pod \"prometheus-operator-6f4946db56-smt86\" (UID: \"d9681c43-4c1c-4d15-a615-cb2892850dac\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:21.808940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:21.808899    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86"
Sep 08 16:31:22.272143 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:22.271693    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-smt86"]
Sep 08 16:31:22.297567 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:22.297519    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9681c43_4c1c_4d15_a615_cb2892850dac.slice/crio-360f07f41ba8e7f188916c03b6f9a9783512d94faeb6b3cc1715ad3a24765731 WatchSource:0}: Error finding container 360f07f41ba8e7f188916c03b6f9a9783512d94faeb6b3cc1715ad3a24765731: Status 404 returned error can't find the container with id 360f07f41ba8e7f188916c03b6f9a9783512d94faeb6b3cc1715ad3a24765731
Sep 08 16:31:22.777734 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:22.777691    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpptf" event={"ID":"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4","Type":"ContainerStarted","Data":"1be82e3c25d02285b2d41e42bf0c83e71708bc9420bc0d2ae360fd32f2448ba5"}
Sep 08 16:31:22.779132 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:22.779099    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86" event={"ID":"d9681c43-4c1c-4d15-a615-cb2892850dac","Type":"ContainerStarted","Data":"360f07f41ba8e7f188916c03b6f9a9783512d94faeb6b3cc1715ad3a24765731"}
Sep 08 16:31:23.463675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.463637    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59d4df67c6-s2lzc"]
Sep 08 16:31:23.481688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.481644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d4df67c6-s2lzc"]
Sep 08 16:31:23.481885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.481772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.485211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.485187    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 16:31:23.485211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.485207    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 16:31:23.485411 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.485341    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 16:31:23.485411 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.485389    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 16:31:23.485661 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.485637    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4hvzs\""
Sep 08 16:31:23.485661 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.485654    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 16:31:23.486123 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.486018    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 16:31:23.486123 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.486089    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 16:31:23.575590 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.575547    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mbbz\" (UniqueName: \"kubernetes.io/projected/5729a780-3e82-4a0e-91a6-baae7f5f88c5-kube-api-access-5mbbz\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.575760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.575602    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-service-ca\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.575760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.575658    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-oauth-config\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.575760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.575699    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-oauth-serving-cert\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.575911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.575829    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-serving-cert\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.575911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.575869    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-config\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.676898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.676861    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mbbz\" (UniqueName: \"kubernetes.io/projected/5729a780-3e82-4a0e-91a6-baae7f5f88c5-kube-api-access-5mbbz\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.676898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.676908    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-service-ca\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.677157 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.677115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-oauth-config\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.677220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.677174    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-oauth-serving-cert\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.677269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.677252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-serving-cert\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.677317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.677286    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-config\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.677692 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.677663    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-service-ca\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.677881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.677862    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-oauth-serving-cert\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.678363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.678345    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-config\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.681233 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.681198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-oauth-config\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.681337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.681244    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-serving-cert\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.688070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.688018    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mbbz\" (UniqueName: \"kubernetes.io/projected/5729a780-3e82-4a0e-91a6-baae7f5f88c5-kube-api-access-5mbbz\") pod \"console-59d4df67c6-s2lzc\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") " pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:23.793108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:23.793016    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:24.807676 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:24.807408    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:24.907303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:24.907264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:24.945854 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:24.945801    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59d4df67c6-s2lzc"]
Sep 08 16:31:25.198117 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:25.198043    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5729a780_3e82_4a0e_91a6_baae7f5f88c5.slice/crio-61375ba803d341929eb971add6d0ecd307af94456d61940677fcf7c58b2f8d78 WatchSource:0}: Error finding container 61375ba803d341929eb971add6d0ecd307af94456d61940677fcf7c58b2f8d78: Status 404 returned error can't find the container with id 61375ba803d341929eb971add6d0ecd307af94456d61940677fcf7c58b2f8d78
Sep 08 16:31:25.762615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.762384    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:25.791245 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.791173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2jxkw" event={"ID":"a05c0e76-b0d6-404f-ab9a-345bad345f71","Type":"ContainerStarted","Data":"d479073e8d623b3c997f7884975c34ae5c6ec7840e79b9ba1be8b00c9c042b1f"}
Sep 08 16:31:25.794233 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.794196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86f9f" event={"ID":"a05ddf23-324a-4306-94db-ba8c35725f98","Type":"ContainerStarted","Data":"b3d71a859ca5d666dbd947ec69093fe2b37bb18420d2b929a6684f247ef67a01"}
Sep 08 16:31:25.794416 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.794264    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-86f9f" event={"ID":"a05ddf23-324a-4306-94db-ba8c35725f98","Type":"ContainerStarted","Data":"0318b0a26a820dc2d2afd5b4ef283ae20b5b1250b0cbe0b43e0fe57c0c280bb8"}
Sep 08 16:31:25.794416 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.794296    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:25.795887 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.795858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d4df67c6-s2lzc" event={"ID":"5729a780-3e82-4a0e-91a6-baae7f5f88c5","Type":"ContainerStarted","Data":"61375ba803d341929eb971add6d0ecd307af94456d61940677fcf7c58b2f8d78"}
Sep 08 16:31:25.798152 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.798123    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wpptf" event={"ID":"e852cdd4-a83f-47cd-a2b6-87a8f8b970d4","Type":"ContainerStarted","Data":"d5f798195eae09eac5879a892f65e7e15de66e00655c5f249af8fe2031f6c079"}
Sep 08 16:31:25.799992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.799964    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86" event={"ID":"d9681c43-4c1c-4d15-a615-cb2892850dac","Type":"ContainerStarted","Data":"34b6d7702b363ea8a49c02a9c46c8b18633e6a686ed72f02397be799f99f26f4"}
Sep 08 16:31:25.800134 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.800009    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86" event={"ID":"d9681c43-4c1c-4d15-a615-cb2892850dac","Type":"ContainerStarted","Data":"4550fa13212a9cd2cc5c1f6da8cfec5073f0dd623dc88254992961c3a493f781"}
Sep 08 16:31:25.815063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.815011    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2jxkw" podStartSLOduration=2.216224833 podStartE2EDuration="5.814990784s" totalImagesPullingTime="3.598765951s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:25.814344943 +0000 UTC m=+53.802780898" watchObservedRunningTime="2026-09-08 16:31:25.814990784 +0000 UTC m=+53.803426737"
Sep 08 16:31:25.833787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.833733    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-86f9f" podStartSLOduration=2.181714741 podStartE2EDuration="5.833715771s" totalImagesPullingTime="3.65200103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:25.832774109 +0000 UTC m=+53.821210063" watchObservedRunningTime="2026-09-08 16:31:25.833715771 +0000 UTC m=+53.822151715"
Sep 08 16:31:25.852489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.852430    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wpptf" podStartSLOduration=1.885752628 podStartE2EDuration="5.852411797s" totalImagesPullingTime="3.966659169s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:31:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:25.851688433 +0000 UTC m=+53.840124388" watchObservedRunningTime="2026-09-08 16:31:25.852411797 +0000 UTC m=+53.840847750"
Sep 08 16:31:25.872604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:25.872549    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-smt86" podStartSLOduration=1.740029946 podStartE2EDuration="4.872529347s" totalImagesPullingTime="3.132499401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:25.871914909 +0000 UTC m=+53.860350863" watchObservedRunningTime="2026-09-08 16:31:25.872529347 +0000 UTC m=+53.860965312"
Sep 08 16:31:27.349849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.349796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:27.418660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.418625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:27.653669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.653587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:27.848614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.848583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:27.885219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.884988    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"]
Sep 08 16:31:27.889038 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.889012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:27.892266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.892238    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 16:31:27.892422 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.892373    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-j4pcv\""
Sep 08 16:31:27.892531 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.892514    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 16:31:27.907026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.906933    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"]
Sep 08 16:31:27.913525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.912346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:27.913525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.912470    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:27.913525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.912499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:27.913525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.912523    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5679\" (UniqueName: \"kubernetes.io/projected/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-kube-api-access-f5679\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:27.915168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.914096    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dcn4x"]
Sep 08 16:31:27.916881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.916860    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:27.920076 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.920053    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-lhmx8\""
Sep 08 16:31:27.920306 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.920289    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 16:31:27.920586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.920569    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 16:31:27.920779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.920762    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 16:31:27.946552 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.946521    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"]
Sep 08 16:31:27.949540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.949509    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:27.956531 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.956505    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 16:31:27.956636 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.956607    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 16:31:27.957005 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.956984    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-wqwlg\""
Sep 08 16:31:27.957094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.956984    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 16:31:27.965558 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.965529    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"]
Sep 08 16:31:27.985067 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:27.985034    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:28.013232 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013198    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-wtmp\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013232 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/06195537-483b-4474-8aae-29ec273796cb-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.013454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-root\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013339    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12015c5f-400c-4736-a670-8faf8cd6f0a8-metrics-client-ca\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.013454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-textfile\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06195537-483b-4474-8aae-29ec273796cb-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.013673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.013673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013591    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013618    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.013673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013635    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.013673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.013673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-sys\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.013926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013714    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5679\" (UniqueName: \"kubernetes.io/projected/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-kube-api-access-f5679\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.013926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013732    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64g8x\" (UniqueName: \"kubernetes.io/projected/12015c5f-400c-4736-a670-8faf8cd6f0a8-kube-api-access-64g8x\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.013926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013772    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khtxd\" (UniqueName: \"kubernetes.io/projected/06195537-483b-4474-8aae-29ec273796cb-kube-api-access-khtxd\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.013926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.013801    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-tls\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.014126 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:28.013963    2581 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 08 16:31:28.014126 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:28.014009    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-tls podName:adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb nodeName:}" failed. No retries permitted until 2026-09-08 16:31:28.513995726 +0000 UTC m=+56.502431671 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-7x4cr" (UID: "adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb") : secret "openshift-state-metrics-tls" not found
Sep 08 16:31:28.014847 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.014811    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.018917 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.018884    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.034904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.034859    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5679\" (UniqueName: \"kubernetes.io/projected/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-kube-api-access-f5679\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.099117 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.099080    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:28.114292 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114254    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06195537-483b-4474-8aae-29ec273796cb-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.114480 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.114480 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114366    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.114480 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:28.114415    2581 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 08 16:31:28.114480 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.114480 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:31:28.114480    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-tls podName:06195537-483b-4474-8aae-29ec273796cb nodeName:}" failed. No retries permitted until 2026-09-08 16:31:28.614460845 +0000 UTC m=+56.602896783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-b5gzw" (UID: "06195537-483b-4474-8aae-29ec273796cb") : secret "kube-state-metrics-tls" not found
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114497    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-sys\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114524    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64g8x\" (UniqueName: \"kubernetes.io/projected/12015c5f-400c-4736-a670-8faf8cd6f0a8-kube-api-access-64g8x\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khtxd\" (UniqueName: \"kubernetes.io/projected/06195537-483b-4474-8aae-29ec273796cb-kube-api-access-khtxd\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114608    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-tls\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114655    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-wtmp\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/06195537-483b-4474-8aae-29ec273796cb-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.114757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-root\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12015c5f-400c-4736-a670-8faf8cd6f0a8-metrics-client-ca\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114810    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.115083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.114868    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-textfile\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115164    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06195537-483b-4474-8aae-29ec273796cb-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.115227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115190    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-textfile\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115212    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.115360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115344    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-wtmp\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115404 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-sys\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115671 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115646    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.115780 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115702    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/06195537-483b-4474-8aae-29ec273796cb-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.115780 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.115757    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/12015c5f-400c-4736-a670-8faf8cd6f0a8-root\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.116235 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.116184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/12015c5f-400c-4736-a670-8faf8cd6f0a8-metrics-client-ca\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.118410 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.118383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.118584 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.118564    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/12015c5f-400c-4736-a670-8faf8cd6f0a8-node-exporter-tls\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.119020 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.118999    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.129339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.129280    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-64g8x\" (UniqueName: \"kubernetes.io/projected/12015c5f-400c-4736-a670-8faf8cd6f0a8-kube-api-access-64g8x\") pod \"node-exporter-dcn4x\" (UID: \"12015c5f-400c-4736-a670-8faf8cd6f0a8\") " pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.131111 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.131091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khtxd\" (UniqueName: \"kubernetes.io/projected/06195537-483b-4474-8aae-29ec273796cb-kube-api-access-khtxd\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.228713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.228682    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dcn4x"
Sep 08 16:31:28.228919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.228795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:28.289674 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:28.289645    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12015c5f_400c_4736_a670_8faf8cd6f0a8.slice/crio-3cc523bccc14560b6d7cb092488094b2ac47e3317e1822bfb2897f72030b286e WatchSource:0}: Error finding container 3cc523bccc14560b6d7cb092488094b2ac47e3317e1822bfb2897f72030b286e: Status 404 returned error can't find the container with id 3cc523bccc14560b6d7cb092488094b2ac47e3317e1822bfb2897f72030b286e
Sep 08 16:31:28.321183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.321160    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:28.434375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.434347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:28.519131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.519036    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.521576 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.521553    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-7x4cr\" (UID: \"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.537829 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.537803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:28.620334 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.620301    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.622804 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.622785    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/06195537-483b-4474-8aae-29ec273796cb-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-b5gzw\" (UID: \"06195537-483b-4474-8aae-29ec273796cb\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.801066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.800975    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"
Sep 08 16:31:28.813120 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.813081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d4df67c6-s2lzc" event={"ID":"5729a780-3e82-4a0e-91a6-baae7f5f88c5","Type":"ContainerStarted","Data":"b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4"}
Sep 08 16:31:28.814400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.814376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcn4x" event={"ID":"12015c5f-400c-4736-a670-8faf8cd6f0a8","Type":"ContainerStarted","Data":"3cc523bccc14560b6d7cb092488094b2ac47e3317e1822bfb2897f72030b286e"}
Sep 08 16:31:28.859261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.859230    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"
Sep 08 16:31:28.869471 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.868948    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59d4df67c6-s2lzc" podStartSLOduration=2.765968127 podStartE2EDuration="5.868923648s" totalImagesPullingTime="3.102955521s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:28.867732379 +0000 UTC m=+56.856168336" watchObservedRunningTime="2026-09-08 16:31:28.868923648 +0000 UTC m=+56.857359602"
Sep 08 16:31:28.919762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:28.919727    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:29.047408 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.047371    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:29.083782 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.083757    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr"]
Sep 08 16:31:29.086367 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:29.086339    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadcfdcfa_65ac_4c39_bac4_42c6aa5ac7cb.slice/crio-c8e35e30971cc9451114ce8afff0a4f2f78274c4b9fd423eccddc6304b98ce9f WatchSource:0}: Error finding container c8e35e30971cc9451114ce8afff0a4f2f78274c4b9fd423eccddc6304b98ce9f: Status 404 returned error can't find the container with id c8e35e30971cc9451114ce8afff0a4f2f78274c4b9fd423eccddc6304b98ce9f
Sep 08 16:31:29.144887 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.144865    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw"]
Sep 08 16:31:29.147694 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:29.147663    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06195537_483b_4474_8aae_29ec273796cb.slice/crio-def5b35b5ab48d32ec6351840d8342a52c5ae5365da7469d2dcac0163f1a22c1 WatchSource:0}: Error finding container def5b35b5ab48d32ec6351840d8342a52c5ae5365da7469d2dcac0163f1a22c1: Status 404 returned error can't find the container with id def5b35b5ab48d32ec6351840d8342a52c5ae5365da7469d2dcac0163f1a22c1
Sep 08 16:31:29.173469 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.173436    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:31:29.177074 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.177048    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.180145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.179776    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 16:31:29.180145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.179917    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 16:31:29.180145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.180139    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 16:31:29.180863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.180691    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:29.180863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.180776    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 16:31:29.180967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.180908    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 16:31:29.181108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.181078    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 16:31:29.181108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.181108    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 16:31:29.181565 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.181370    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 16:31:29.181565 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.181380    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 16:31:29.181691 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.181626    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w57xr\""
Sep 08 16:31:29.205281 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.205225    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:31:29.227465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qml4n\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-kube-api-access-qml4n\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227498    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-out\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227633    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227816 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227736    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227816 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227816 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227800    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227953 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227953 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.227953 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227925    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-web-config\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.228071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.227961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328541 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328509    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328541 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328546    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328582    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-web-config\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328680    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328743    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qml4n\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-kube-api-access-qml4n\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.328862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328802    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-out\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.329312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328950    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.329312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.328980    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.329312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.329065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.329493 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.329472    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.329934 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.329886    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.330872 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.330826    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.332161 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.332134    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-out\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.332431 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.332389    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.332606 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.332577    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.332689 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.332665    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-web-config\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.332746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.332718    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.333093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.333074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.333282 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.333225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.333729 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.333709    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.334799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.334768    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-volume\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.352707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.352649    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qml4n\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-kube-api-access-qml4n\") pod \"alertmanager-main-0\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.491693 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.491652    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:31:29.788272 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.788167    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:31:29.825481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.825436    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr" event={"ID":"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb","Type":"ContainerStarted","Data":"d380d4deb2b50d667840bbff2571911e4a886a74dd685eec64a53e46c9c0e493"}
Sep 08 16:31:29.825649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.825538    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr" event={"ID":"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb","Type":"ContainerStarted","Data":"6e984841d67bdf494d78a6f1ed3e0beebab1037b34d34458f877202bf46d38fe"}
Sep 08 16:31:29.825649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.825560    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr" event={"ID":"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb","Type":"ContainerStarted","Data":"c8e35e30971cc9451114ce8afff0a4f2f78274c4b9fd423eccddc6304b98ce9f"}
Sep 08 16:31:29.826660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:29.826636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw" event={"ID":"06195537-483b-4474-8aae-29ec273796cb","Type":"ContainerStarted","Data":"def5b35b5ab48d32ec6351840d8342a52c5ae5365da7469d2dcac0163f1a22c1"}
Sep 08 16:31:29.830971 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:29.830936    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcedd289_d9ef_496d_bf17_027e139f5fa9.slice/crio-9e01abe779dd251007d1a9f78a0ea38fa2f1c6a3574943e0ca0a04f41275360a WatchSource:0}: Error finding container 9e01abe779dd251007d1a9f78a0ea38fa2f1c6a3574943e0ca0a04f41275360a: Status 404 returned error can't find the container with id 9e01abe779dd251007d1a9f78a0ea38fa2f1c6a3574943e0ca0a04f41275360a
Sep 08 16:31:30.833243 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:30.833201    2581 generic.go:356] "Generic (PLEG): container finished" podID="12015c5f-400c-4736-a670-8faf8cd6f0a8" containerID="154f198fb1375475a9b76b881acbb57e11c5553dc077020bcfbc7bfa555d4abc" exitCode=0
Sep 08 16:31:30.833620 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:30.833287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcn4x" event={"ID":"12015c5f-400c-4736-a670-8faf8cd6f0a8","Type":"ContainerDied","Data":"154f198fb1375475a9b76b881acbb57e11c5553dc077020bcfbc7bfa555d4abc"}
Sep 08 16:31:30.834867 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:30.834813    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"9e01abe779dd251007d1a9f78a0ea38fa2f1c6a3574943e0ca0a04f41275360a"}
Sep 08 16:31:30.922507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:30.922468    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:31.021755 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.021706    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:31.071733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.071697    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85c7f68df9-95fxq"]
Sep 08 16:31:31.074279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.074258    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.082165 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.082136    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 16:31:31.093084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.093053    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85c7f68df9-95fxq"]
Sep 08 16:31:31.102886 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.102849    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:31.121471 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.121438    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-f47d7dc8d-9487d"]
Sep 08 16:31:31.123771 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.123748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.126318 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.126290    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 16:31:31.126435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.126374    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-46zps\""
Sep 08 16:31:31.126645 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.126623    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 16:31:31.126723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.126689    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 16:31:31.126769 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.126738    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 16:31:31.127042 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.127029    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8bbu85q7kseoo\""
Sep 08 16:31:31.127042 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.127036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 16:31:31.139679 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.139655    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f47d7dc8d-9487d"]
Sep 08 16:31:31.146775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.146590    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sptgr\" (UniqueName: \"kubernetes.io/projected/2a346583-b512-4dc9-95ba-e64d89014a8c-kube-api-access-sptgr\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.146775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.146660    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-trusted-ca-bundle\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.146775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.146690    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-console-config\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.146775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.146708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147070    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-tls\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147125    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-serving-cert\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147235    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlllx\" (UniqueName: \"kubernetes.io/projected/2899abfb-a708-4049-b324-23c18bf0e65f-kube-api-access-nlllx\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-grpc-tls\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147314    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-oauth-config\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147341    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-oauth-serving-cert\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147366    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147389    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2899abfb-a708-4049-b324-23c18bf0e65f-metrics-client-ca\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.147598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.147448    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-service-ca\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.249466 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sptgr\" (UniqueName: \"kubernetes.io/projected/2a346583-b512-4dc9-95ba-e64d89014a8c-kube-api-access-sptgr\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.249614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-trusted-ca-bundle\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.249614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249511    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-console-config\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.249614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.249614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249585    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-tls\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.249614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.249808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-serving-cert\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.249808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.249808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlllx\" (UniqueName: \"kubernetes.io/projected/2899abfb-a708-4049-b324-23c18bf0e65f-kube-api-access-nlllx\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.249808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249730    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-grpc-tls\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.249808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249766    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-oauth-config\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.249808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249790    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-oauth-serving-cert\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.250111 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249812    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.250111 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249858    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2899abfb-a708-4049-b324-23c18bf0e65f-metrics-client-ca\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.250111 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.249888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-service-ca\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.252442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.250637    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-console-config\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.252442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.251525    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-trusted-ca-bundle\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.252442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.252169    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-oauth-serving-cert\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.254498 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.254235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2899abfb-a708-4049-b324-23c18bf0e65f-metrics-client-ca\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.254792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.254652    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-service-ca\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.257416 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.257278    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.259136 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.258875    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.261117 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.261037    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.261256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.261229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-serving-cert\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.261317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.261258    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-oauth-config\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.261377 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.261359    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-grpc-tls\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.262868 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.262731    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.263760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.263737    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/2899abfb-a708-4049-b324-23c18bf0e65f-secret-thanos-querier-tls\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.264033 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.264011    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlllx\" (UniqueName: \"kubernetes.io/projected/2899abfb-a708-4049-b324-23c18bf0e65f-kube-api-access-nlllx\") pod \"thanos-querier-f47d7dc8d-9487d\" (UID: \"2899abfb-a708-4049-b324-23c18bf0e65f\") " pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.264077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.264044    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sptgr\" (UniqueName: \"kubernetes.io/projected/2a346583-b512-4dc9-95ba-e64d89014a8c-kube-api-access-sptgr\") pod \"console-85c7f68df9-95fxq\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") " pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.387653 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.387620    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:31.434517 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.433915    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:31.682486 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.682447    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85c7f68df9-95fxq"]
Sep 08 16:31:31.686121 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:31.686095    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a346583_b512_4dc9_95ba_e64d89014a8c.slice/crio-3cf2a8b33454df61c92762b888101e06b8f866c7f7fd53067e0908329e83e28a WatchSource:0}: Error finding container 3cf2a8b33454df61c92762b888101e06b8f866c7f7fd53067e0908329e83e28a: Status 404 returned error can't find the container with id 3cf2a8b33454df61c92762b888101e06b8f866c7f7fd53067e0908329e83e28a
Sep 08 16:31:31.725254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.725229    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v4llq"
Sep 08 16:31:31.752367 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.752342    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-f47d7dc8d-9487d"]
Sep 08 16:31:31.755934 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:31.755891    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2899abfb_a708_4049_b324_23c18bf0e65f.slice/crio-686f702aa4cc88c0f5849163cf0f4e6cdcce1b89025d4cb06ec599a0ced432a8 WatchSource:0}: Error finding container 686f702aa4cc88c0f5849163cf0f4e6cdcce1b89025d4cb06ec599a0ced432a8: Status 404 returned error can't find the container with id 686f702aa4cc88c0f5849163cf0f4e6cdcce1b89025d4cb06ec599a0ced432a8
Sep 08 16:31:31.842130 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.842094    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcn4x" event={"ID":"12015c5f-400c-4736-a670-8faf8cd6f0a8","Type":"ContainerStarted","Data":"5fb31aaf8eccc9ac58748d8282b455667993f2c242a71d0062ae99c8fcc6cebd"}
Sep 08 16:31:31.842640 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.842155    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dcn4x" event={"ID":"12015c5f-400c-4736-a670-8faf8cd6f0a8","Type":"ContainerStarted","Data":"b7106d43297fe4839b0042d1abcbbddca43099c689035aaaea60d870c2556bc4"}
Sep 08 16:31:31.844459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.844431    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr" event={"ID":"adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb","Type":"ContainerStarted","Data":"cd6215d2ea6a9a53fec5ec7d52c48eb099ff5925da093ff62afdf9f04d246def"}
Sep 08 16:31:31.845614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.845591    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"686f702aa4cc88c0f5849163cf0f4e6cdcce1b89025d4cb06ec599a0ced432a8"}
Sep 08 16:31:31.848025 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.848002    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw" event={"ID":"06195537-483b-4474-8aae-29ec273796cb","Type":"ContainerStarted","Data":"4d5d93425745acd236cf2c047074c883e932ada31d2dbcbd78c94999cc5d3cd1"}
Sep 08 16:31:31.848137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.848059    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw" event={"ID":"06195537-483b-4474-8aae-29ec273796cb","Type":"ContainerStarted","Data":"7a928dc8e1c7c0ebb9dfa1ce84fa06c5c34f90d169181a15d1a3860835eb65d7"}
Sep 08 16:31:31.848137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.848091    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw" event={"ID":"06195537-483b-4474-8aae-29ec273796cb","Type":"ContainerStarted","Data":"2e800d6db33faf4e80c30279e2c86708a21dc60eadc4d98ca09bb4ebedab6b8f"}
Sep 08 16:31:31.849768 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.849744    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12" exitCode=0
Sep 08 16:31:31.849881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.849856    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"}
Sep 08 16:31:31.851584 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.851562    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85c7f68df9-95fxq" event={"ID":"2a346583-b512-4dc9-95ba-e64d89014a8c","Type":"ContainerStarted","Data":"594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6"}
Sep 08 16:31:31.851653 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.851599    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85c7f68df9-95fxq" event={"ID":"2a346583-b512-4dc9-95ba-e64d89014a8c","Type":"ContainerStarted","Data":"3cf2a8b33454df61c92762b888101e06b8f866c7f7fd53067e0908329e83e28a"}
Sep 08 16:31:31.871006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.870948    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dcn4x" podStartSLOduration=3.243694696 podStartE2EDuration="4.870930369s" totalImagesPullingTime="1.5522568s" totalInitContainerRuntime="74.978873ms" isStatefulPod=true podCreationTimestamp="2026-09-08 16:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:31.870412222 +0000 UTC m=+59.858848189" watchObservedRunningTime="2026-09-08 16:31:31.870930369 +0000 UTC m=+59.859366320"
Sep 08 16:31:31.879010 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.878971    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:31.924501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.924383    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-7x4cr" podStartSLOduration=2.986977523 podStartE2EDuration="4.924365395s" totalImagesPullingTime="1.937387872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:31.923968371 +0000 UTC m=+59.912404325" watchObservedRunningTime="2026-09-08 16:31:31.924365395 +0000 UTC m=+59.912801351"
Sep 08 16:31:31.943087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.943036    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85c7f68df9-95fxq" podStartSLOduration=0.943018989 podStartE2EDuration="943.018989ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:31.942167053 +0000 UTC m=+59.930603001" watchObservedRunningTime="2026-09-08 16:31:31.943018989 +0000 UTC m=+59.931454933"
Sep 08 16:31:31.961513 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.961459    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-b5gzw" podStartSLOduration=2.975867278 podStartE2EDuration="4.961441267s" totalImagesPullingTime="1.985573989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:31.960404022 +0000 UTC m=+59.948839976" watchObservedRunningTime="2026-09-08 16:31:31.961441267 +0000 UTC m=+59.949877217"
Sep 08 16:31:31.965065 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:31.965035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:32.326875 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.326826    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5494ddd995-4bsd7"]
Sep 08 16:31:32.329345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.329322    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.332389 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.332367    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 16:31:32.332786 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.332760    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ukhrjo2u03or\""
Sep 08 16:31:32.333001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.332816    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 16:31:32.333001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.332888    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 16:31:32.333158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.333116    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dn5lf\""
Sep 08 16:31:32.333340 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.333324    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 16:31:32.346128 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.346097    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5494ddd995-4bsd7"]
Sep 08 16:31:32.363019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.362989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-audit-log\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.363019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.363024    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-secret-metrics-server-tls\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.363217 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.363082    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-secret-metrics-server-client-certs\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.363217 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.363101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vfc\" (UniqueName: \"kubernetes.io/projected/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-kube-api-access-44vfc\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.363217 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.363121    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-client-ca-bundle\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.363217 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.363171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-metrics-server-audit-profiles\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.363217 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.363200    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.463810 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.463782    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-audit-log\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.463810 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.463816    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-secret-metrics-server-tls\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.464072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.463884    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-secret-metrics-server-client-certs\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.464072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.463901    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vfc\" (UniqueName: \"kubernetes.io/projected/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-kube-api-access-44vfc\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.464072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.463940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-client-ca-bundle\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.464072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.463974    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-metrics-server-audit-profiles\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.464072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.464009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.464317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.464176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-audit-log\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.467447 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.467423    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 16:31:32.467591 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.467422    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-ukhrjo2u03or\""
Sep 08 16:31:32.467871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.467855    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 16:31:32.467967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.467878    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 16:31:32.467967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.467905    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 16:31:32.475332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.475290    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vfc\" (UniqueName: \"kubernetes.io/projected/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-kube-api-access-44vfc\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.475660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.475627    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.475660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.475642    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-metrics-server-audit-profiles\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.477582 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.477561    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-secret-metrics-server-tls\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.477813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.477794    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-client-ca-bundle\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.478264 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.478241    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c-secret-metrics-server-client-certs\") pod \"metrics-server-5494ddd995-4bsd7\" (UID: \"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c\") " pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.625177 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.625070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:32.644100 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.644072    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dn5lf\""
Sep 08 16:31:32.652743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.652683    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:32.653223 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.653202    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"]
Sep 08 16:31:32.655159 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.655129    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.657455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.657416    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 16:31:32.657668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.657647    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-sznmq\""
Sep 08 16:31:32.667336 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.667305    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"]
Sep 08 16:31:32.700858 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.700748    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:32.766039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.766004    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-sjxmx\" (UID: \"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.766039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.766040    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq8ns\" (UniqueName: \"kubernetes.io/projected/0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26-kube-api-access-fq8ns\") pod \"monitoring-plugin-85bbbbbf4-sjxmx\" (UID: \"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.837598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.837560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:32.866979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.866943    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-sjxmx\" (UID: \"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.866979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.866982    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq8ns\" (UniqueName: \"kubernetes.io/projected/0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26-kube-api-access-fq8ns\") pod \"monitoring-plugin-85bbbbbf4-sjxmx\" (UID: \"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.869713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.869687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-sjxmx\" (UID: \"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.880712 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.880621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq8ns\" (UniqueName: \"kubernetes.io/projected/0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26-kube-api-access-fq8ns\") pod \"monitoring-plugin-85bbbbbf4-sjxmx\" (UID: \"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:32.969517 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.968641    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5494ddd995-4bsd7"]
Sep 08 16:31:32.974336 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:32.974260    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dc1a8b6_e237_46e3_8cd5_5cf11c69ad8c.slice/crio-16f1e31de924eb193d84a1ec97ccf3ac5252c08f82f6bd6a57d16790491635f1 WatchSource:0}: Error finding container 16f1e31de924eb193d84a1ec97ccf3ac5252c08f82f6bd6a57d16790491635f1: Status 404 returned error can't find the container with id 16f1e31de924eb193d84a1ec97ccf3ac5252c08f82f6bd6a57d16790491635f1
Sep 08 16:31:32.977040 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:32.977017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:33.264962 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.264921    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"]
Sep 08 16:31:33.271801 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:33.271768    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e5fb49c_d114_4e77_b4c4_d2b67b7f1c26.slice/crio-ff0791adf91e091dc9ad202327bd6196aaaca3e2c1ef918ed2ec138b47e1811a WatchSource:0}: Error finding container ff0791adf91e091dc9ad202327bd6196aaaca3e2c1ef918ed2ec138b47e1811a: Status 404 returned error can't find the container with id ff0791adf91e091dc9ad202327bd6196aaaca3e2c1ef918ed2ec138b47e1811a
Sep 08 16:31:33.688573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.688533    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:33.761246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.761209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:33.793424 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.793386    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:33.793614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.793459    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:33.799433 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.799401    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:33.865728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.865670    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx" event={"ID":"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26","Type":"ContainerStarted","Data":"ff0791adf91e091dc9ad202327bd6196aaaca3e2c1ef918ed2ec138b47e1811a"}
Sep 08 16:31:33.867311 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.867233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7" event={"ID":"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c","Type":"ContainerStarted","Data":"16f1e31de924eb193d84a1ec97ccf3ac5252c08f82f6bd6a57d16790491635f1"}
Sep 08 16:31:33.873004 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:33.872972    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:31:34.182285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.182095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:34.191960 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.191779    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:31:34.199103 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.195879    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.202453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.201767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 16:31:34.202453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.202031    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 16:31:34.202453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.202077    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 16:31:34.202453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.201767    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 16:31:34.202453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.202304    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-adkj3dvt8a46f\""
Sep 08 16:31:34.202827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.202479    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 16:31:34.202827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.202617    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 16:31:34.203045 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.203019    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 16:31:34.203206 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.203193    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 16:31:34.203592 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.203372    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 16:31:34.203592 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.203542    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 16:31:34.206306 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.206265    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z26x8\""
Sep 08 16:31:34.207531 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.207509    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 16:31:34.207661 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.207636    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 16:31:34.210090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.210064    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 16:31:34.212921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.212900    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 16:31:34.241003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.240949    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:31:34.281933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.281890    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.281952    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.281978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.281994    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282008    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282047    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282128    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282142    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msghf\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-kube-api-access-msghf\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282188    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282218    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282381    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-config\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.282740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.282449    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383684 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383746    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msghf\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-kube-api-access-msghf\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383775    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383801    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383856    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.383911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383928    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-config\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.383995    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384026    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384074    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384090    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384104    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384121    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384138    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384157    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384186    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.384713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.384201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.385886 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.385651    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.394974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.388554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.394974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.388742    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.394974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.394287    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.394974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.394645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.395338 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.395316    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.396059 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.396035    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.396766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.396723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.398352 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.398321    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.399030 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.398992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-web-config\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.399893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.399851    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.400775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.400559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.400775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.400741    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.402251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.402210    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-config\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.404944 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.404138    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.404944 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.404568    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.407574 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.405263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.407574 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.406099    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.420464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.416529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-config-out\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.422873 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.422758    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msghf\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-kube-api-access-msghf\") pod \"prometheus-k8s-0\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.517891 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.516944    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:34.530160 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.529712    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:34.634131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.633360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:34.864244 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.864214    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:31:34.876417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.876244    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"0530d0b23d2d5a8eb0c6ca1eeb4fd53ac3d884b22ccde1c969b25c1a1ece7dc3"}
Sep 08 16:31:34.876417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.876330    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"0ef40e757b125d4e1fff58dfe51cec61ff31113d1489b0d31bf8e2c97d9470b0"}
Sep 08 16:31:34.876417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.876368    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"a961a08c1c268827085b1c5b8bdd17d2b13cace2c7d5bb53a8570d388edad06f"}
Sep 08 16:31:34.880885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.880823    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"}
Sep 08 16:31:34.880979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.880957    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"}
Sep 08 16:31:34.881044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.881016    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"}
Sep 08 16:31:34.881101 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.881055    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"}
Sep 08 16:31:34.881101 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:34.881089    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"}
Sep 08 16:31:35.580901 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:35.580867    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c093279_ad2e_41e3_bbc8_6959c1cee263.slice/crio-7b1646bf130173b259e3bee83757b95a01d1af2f9ae4d8f0046b345ca896cbf5 WatchSource:0}: Error finding container 7b1646bf130173b259e3bee83757b95a01d1af2f9ae4d8f0046b345ca896cbf5: Status 404 returned error can't find the container with id 7b1646bf130173b259e3bee83757b95a01d1af2f9ae4d8f0046b345ca896cbf5
Sep 08 16:31:35.806968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.806928    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-86f9f"
Sep 08 16:31:35.889225 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.889130    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7" event={"ID":"1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c","Type":"ContainerStarted","Data":"04852977e781a5c74397daad94b081ddb5a0d63927674bc72946ff56532bbcce"}
Sep 08 16:31:35.895709 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.894974    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f" exitCode=0
Sep 08 16:31:35.895709 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.895133    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"}
Sep 08 16:31:35.895709 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.895201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"7b1646bf130173b259e3bee83757b95a01d1af2f9ae4d8f0046b345ca896cbf5"}
Sep 08 16:31:35.899982 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.899894    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx" event={"ID":"0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26","Type":"ContainerStarted","Data":"f0e79391ff80ea33f259b498c6e889f81fa4e55d9c651018a319ccb0d64a99e0"}
Sep 08 16:31:35.902032 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.900409    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:35.907743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.907721    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx"
Sep 08 16:31:35.932350 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.932291    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-sjxmx" podStartSLOduration=1.597914311 podStartE2EDuration="3.932275962s" totalImagesPullingTime="2.334361651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:35.932087468 +0000 UTC m=+63.920523419" watchObservedRunningTime="2026-09-08 16:31:35.932275962 +0000 UTC m=+63.920711957"
Sep 08 16:31:35.933297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:35.933258    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7" podStartSLOduration=1.3035576899999999 podStartE2EDuration="3.933249339s" totalImagesPullingTime="2.629691649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:35.913236213 +0000 UTC m=+63.901672176" watchObservedRunningTime="2026-09-08 16:31:35.933249339 +0000 UTC m=+63.921685293"
Sep 08 16:31:36.700649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.700613    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85c7f68df9-95fxq"]
Sep 08 16:31:36.733728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.733692    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f7b95f67d-4bt5x"]
Sep 08 16:31:36.735926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.735897    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.749077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.749007    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7b95f67d-4bt5x"]
Sep 08 16:31:36.801614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.801573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:36.810044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810005    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-config\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.810189 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-oauth-config\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.810247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810232    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-serving-cert\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.810312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-service-ca\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.810312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-trusted-ca-bundle\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.810424 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-oauth-serving-cert\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.810476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.810431    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mzfw\" (UniqueName: \"kubernetes.io/projected/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-kube-api-access-6mzfw\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.901725 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.901689    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:36.908789 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.908752    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"026701607c8231e8a83550743e119108c07306e19e5d60be03e5d2bd75231757"}
Sep 08 16:31:36.908992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.908827    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"a678588e14355a6592b28a8e78a8f1fdd42a37bd88c404303b40ec3604d10036"}
Sep 08 16:31:36.908992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.908901    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:36.908992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.908937    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" event={"ID":"2899abfb-a708-4049-b324-23c18bf0e65f","Type":"ContainerStarted","Data":"4d5aaa055439c40d4a17c18b63d2df046d787b4bf825540bde96e2b86083a748"}
Sep 08 16:31:36.910912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.910885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-config\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.910955    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-oauth-config\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911024    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-serving-cert\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911049    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-service-ca\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911282 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-trusted-ca-bundle\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911282 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-oauth-serving-cert\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911282 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911120    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mzfw\" (UniqueName: \"kubernetes.io/projected/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-kube-api-access-6mzfw\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911745    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-service-ca\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.911918 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.911810    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-config\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.912232 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.912185    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-trusted-ca-bundle\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.912571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.912542    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-oauth-serving-cert\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.914168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.914146    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-oauth-config\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.914509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.914484    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerStarted","Data":"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"}
Sep 08 16:31:36.914651 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.914629    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-serving-cert\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.919577 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.919555    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mzfw\" (UniqueName: \"kubernetes.io/projected/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-kube-api-access-6mzfw\") pod \"console-6f7b95f67d-4bt5x\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") " pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:36.934915 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.934863    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d" podStartSLOduration=1.920914765 podStartE2EDuration="5.93484424s" totalImagesPullingTime="4.013929475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:36.933022327 +0000 UTC m=+64.921458281" watchObservedRunningTime="2026-09-08 16:31:36.93484424 +0000 UTC m=+64.923280189"
Sep 08 16:31:36.960697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:36.960587    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.83818974 podStartE2EDuration="7.960558122s" totalImagesPullingTime="5.09868074s" totalInitContainerRuntime="23.687642ms" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:36.95876772 +0000 UTC m=+64.947203693" watchObservedRunningTime="2026-09-08 16:31:36.960558122 +0000 UTC m=+64.948994089"
Sep 08 16:31:37.047764 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.047723    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:37.329657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.329566    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f7b95f67d-4bt5x"]
Sep 08 16:31:37.332714 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:37.332682    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f0e4637_7ea8_43ca_8fdc_6ad5a01fe373.slice/crio-30b8658448bc8d3c5eef43d218a920754a569337b7bfdcf55c5f9b8b732e3971 WatchSource:0}: Error finding container 30b8658448bc8d3c5eef43d218a920754a569337b7bfdcf55c5f9b8b732e3971: Status 404 returned error can't find the container with id 30b8658448bc8d3c5eef43d218a920754a569337b7bfdcf55c5f9b8b732e3971
Sep 08 16:31:37.494321 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.494286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:37.596700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.596573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:37.921361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.921258    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7b95f67d-4bt5x" event={"ID":"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373","Type":"ContainerStarted","Data":"68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163"}
Sep 08 16:31:37.921361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.921352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7b95f67d-4bt5x" event={"ID":"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373","Type":"ContainerStarted","Data":"30b8658448bc8d3c5eef43d218a920754a569337b7bfdcf55c5f9b8b732e3971"}
Sep 08 16:31:37.941911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:37.941825    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f7b95f67d-4bt5x" podStartSLOduration=1.9418046119999999 podStartE2EDuration="1.941804612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:37.941501085 +0000 UTC m=+65.929937060" watchObservedRunningTime="2026-09-08 16:31:37.941804612 +0000 UTC m=+65.930240648"
Sep 08 16:31:38.224813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.224762    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:38.225038 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.224883    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:38.227906 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.227874    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 16:31:38.228192 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.228168    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 16:31:38.237922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.237889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/640c101e-4720-47c2-97a7-742527783b4a-original-pull-secret\") pod \"global-pull-secret-syncer-qhq59\" (UID: \"640c101e-4720-47c2-97a7-742527783b4a\") " pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:38.238070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.237966    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e02a6337-79f6-47aa-8f2f-aaec08c9d13b-metrics-certs\") pod \"network-metrics-daemon-2xzdt\" (UID: \"e02a6337-79f6-47aa-8f2f-aaec08c9d13b\") " pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:38.280310 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.280274    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s6b8s\""
Sep 08 16:31:38.283588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.283558    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qhq59"
Sep 08 16:31:38.288411 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.288385    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2xzdt"
Sep 08 16:31:38.400101 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.400065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:38.426247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.426208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:38.430062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.430035    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 16:31:38.439179 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.439147    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 16:31:38.450277 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.450242    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7985\" (UniqueName: \"kubernetes.io/projected/97942e10-27a9-4363-ae81-c160c6704611-kube-api-access-j7985\") pod \"network-check-target-jcwk9\" (UID: \"97942e10-27a9-4363-ae81-c160c6704611\") " pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:38.499633 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.499546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:38.574154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.574115    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-86r89\""
Sep 08 16:31:38.582266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:38.582233    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:39.194081 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.193636    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qhq59"]
Sep 08 16:31:39.199625 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.198090    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2xzdt"]
Sep 08 16:31:39.199625 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.199472    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jcwk9"]
Sep 08 16:31:39.202367 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:39.202333    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod640c101e_4720_47c2_97a7_742527783b4a.slice/crio-d02783eb2333fe621e5b924bdd30f13c8877df6b1d7fdba3484877443ee1a794 WatchSource:0}: Error finding container d02783eb2333fe621e5b924bdd30f13c8877df6b1d7fdba3484877443ee1a794: Status 404 returned error can't find the container with id d02783eb2333fe621e5b924bdd30f13c8877df6b1d7fdba3484877443ee1a794
Sep 08 16:31:39.206511 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:39.206222    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02a6337_79f6_47aa_8f2f_aaec08c9d13b.slice/crio-b0acb5cf713b9fa350d4f61dce6ff9632e9e8a158dbab3a6ba75f8e7b716160a WatchSource:0}: Error finding container b0acb5cf713b9fa350d4f61dce6ff9632e9e8a158dbab3a6ba75f8e7b716160a: Status 404 returned error can't find the container with id b0acb5cf713b9fa350d4f61dce6ff9632e9e8a158dbab3a6ba75f8e7b716160a
Sep 08 16:31:39.207206 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:31:39.207174    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97942e10_27a9_4363_ae81_c160c6704611.slice/crio-2d0fb91d51515fc93440c994f33fc4551194f289d67d7b0227e6cd3e0ce67e5b WatchSource:0}: Error finding container 2d0fb91d51515fc93440c994f33fc4551194f289d67d7b0227e6cd3e0ce67e5b: Status 404 returned error can't find the container with id 2d0fb91d51515fc93440c994f33fc4551194f289d67d7b0227e6cd3e0ce67e5b
Sep 08 16:31:39.376254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.376142    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:39.476216 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.476123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:39.723931 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.723895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:39.801112 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.801086    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:39.936503 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.936430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"}
Sep 08 16:31:39.936703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.936584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"}
Sep 08 16:31:39.936703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.936626    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"}
Sep 08 16:31:39.936822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.936672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"}
Sep 08 16:31:39.936822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.936802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"}
Sep 08 16:31:39.936957 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.936871    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerStarted","Data":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"}
Sep 08 16:31:39.939320 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.939282    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhq59" event={"ID":"640c101e-4720-47c2-97a7-742527783b4a","Type":"ContainerStarted","Data":"d02783eb2333fe621e5b924bdd30f13c8877df6b1d7fdba3484877443ee1a794"}
Sep 08 16:31:39.940732 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.940709    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jcwk9" event={"ID":"97942e10-27a9-4363-ae81-c160c6704611","Type":"ContainerStarted","Data":"2d0fb91d51515fc93440c994f33fc4551194f289d67d7b0227e6cd3e0ce67e5b"}
Sep 08 16:31:39.942419 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.942394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2xzdt" event={"ID":"e02a6337-79f6-47aa-8f2f-aaec08c9d13b","Type":"ContainerStarted","Data":"b0acb5cf713b9fa350d4f61dce6ff9632e9e8a158dbab3a6ba75f8e7b716160a"}
Sep 08 16:31:39.971475 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:39.971399    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.867318789 podStartE2EDuration="5.971377099s" totalImagesPullingTime="3.080746704s" totalInitContainerRuntime="23.311606ms" isStatefulPod=false podCreationTimestamp="2026-09-08 16:31:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:39.969981817 +0000 UTC m=+67.958417798" watchObservedRunningTime="2026-09-08 16:31:39.971377099 +0000 UTC m=+67.959813053"
Sep 08 16:31:40.950602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:40.950561    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2xzdt" event={"ID":"e02a6337-79f6-47aa-8f2f-aaec08c9d13b","Type":"ContainerStarted","Data":"f52cdccf7984269f8cf61b1a037362d5cf79c038174ae850f9a414c834fb998b"}
Sep 08 16:31:40.951088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:40.950625    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2xzdt" event={"ID":"e02a6337-79f6-47aa-8f2f-aaec08c9d13b","Type":"ContainerStarted","Data":"64d7c9b73df51f1fe52df088118c2114a3fe59a4f9f0df5d742831b4251d0142"}
Sep 08 16:31:40.971116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:40.971045    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2xzdt" podStartSLOduration=67.808356339 podStartE2EDuration="1m8.971023112s" totalImagesPullingTime="1.162666773s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:40.969206643 +0000 UTC m=+68.957642623" watchObservedRunningTime="2026-09-08 16:31:40.971023112 +0000 UTC m=+68.959459067"
Sep 08 16:31:41.118302 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:41.118254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:41.225507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:41.225376    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:41.388689 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:41.388646    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:31:41.891132 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:41.891095    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:42.081107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:42.081016    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:42.928424 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:42.928394    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-f47d7dc8d-9487d"
Sep 08 16:31:44.334671 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:44.334627    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:44.435987 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:44.435952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:44.518163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:44.518119    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:31:44.972716 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:44.972675    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qhq59" event={"ID":"640c101e-4720-47c2-97a7-742527783b4a","Type":"ContainerStarted","Data":"eca3d74a4e21b7c2ab12bff660a59a4790aa38123af4f2098b29bb6d38ccbe83"}
Sep 08 16:31:44.974519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:44.974486    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jcwk9" event={"ID":"97942e10-27a9-4363-ae81-c160c6704611","Type":"ContainerStarted","Data":"c5df24684f5bbc0514302b61124b6cfcd8cd66875c6110010e3d6328239b6660"}
Sep 08 16:31:44.974665 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:44.974574    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:31:45.020870 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:45.020797    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qhq59" podStartSLOduration=67.574630983 podStartE2EDuration="1m13.020775712s" totalImagesPullingTime="5.446144729s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:44.995653941 +0000 UTC m=+72.984089895" watchObservedRunningTime="2026-09-08 16:31:45.020775712 +0000 UTC m=+73.009211667"
Sep 08 16:31:45.021473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:45.021446    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jcwk9" podStartSLOduration=67.59103449 podStartE2EDuration="1m13.021438293s" totalImagesPullingTime="5.430403803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:30:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:31:45.020329429 +0000 UTC m=+73.008765385" watchObservedRunningTime="2026-09-08 16:31:45.021438293 +0000 UTC m=+73.009874247"
Sep 08 16:31:47.048230 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:47.048192    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:47.048601 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:47.048259    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:47.052960 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:47.052931    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:47.417085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:47.416991    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:47.521191 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:47.521153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:47.991345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:47.991315    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:31:48.051943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:48.051901    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d4df67c6-s2lzc"]
Sep 08 16:31:48.242342 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:48.242254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:48.366031 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:48.365997    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:48.519223 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:48.519138    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:52.653258 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:52.653220    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:52.653712 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:52.653291    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:31:56.843452 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:56.843330    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:56.963682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:56.963641    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:57.294303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:57.294270    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:57.388435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:57.388406    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:31:57.450044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:31:57.450013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:01.724913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:01.724871    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-85c7f68df9-95fxq" podUID="2a346583-b512-4dc9-95ba-e64d89014a8c" containerName="console" containerID="cri-o://594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6" gracePeriod=15
Sep 08 16:32:01.978285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:01.978219    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:32:02.045536 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.045506    2581 generic.go:356] "Generic (PLEG): container finished" podID="2a346583-b512-4dc9-95ba-e64d89014a8c" containerID="594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6" exitCode=0
Sep 08 16:32:02.045701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.045552    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85c7f68df9-95fxq"
Sep 08 16:32:02.045701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.045600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85c7f68df9-95fxq" event={"ID":"2a346583-b512-4dc9-95ba-e64d89014a8c","Type":"ContainerDied","Data":"594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6"}
Sep 08 16:32:02.045701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.045649    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85c7f68df9-95fxq" event={"ID":"2a346583-b512-4dc9-95ba-e64d89014a8c","Type":"ContainerDied","Data":"3cf2a8b33454df61c92762b888101e06b8f866c7f7fd53067e0908329e83e28a"}
Sep 08 16:32:02.045701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.045684    2581 scope.go:117] "RemoveContainer" containerID="594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6"
Sep 08 16:32:02.055379 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.055361    2581 scope.go:117] "RemoveContainer" containerID="594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6"
Sep 08 16:32:02.055772 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:02.055735    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6\": container with ID starting with 594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6 not found: ID does not exist" containerID="594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6"
Sep 08 16:32:02.055816 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.055783    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6"} err="failed to get container status \"594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6\": rpc error: code = NotFound desc = could not find container \"594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6\": container with ID starting with 594443b2b6ec8ec989833224a8dcd7a9f05f60bc7d4456d039975b8be89ce9d6 not found: ID does not exist"
Sep 08 16:32:02.169424 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-service-ca\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.169600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169435    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sptgr\" (UniqueName: \"kubernetes.io/projected/2a346583-b512-4dc9-95ba-e64d89014a8c-kube-api-access-sptgr\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.169600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169461    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-console-config\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.169600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169512    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-oauth-serving-cert\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.169600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169560    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-serving-cert\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.169600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169592    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-trusted-ca-bundle\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.169940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169646    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-oauth-config\") pod \"2a346583-b512-4dc9-95ba-e64d89014a8c\" (UID: \"2a346583-b512-4dc9-95ba-e64d89014a8c\") "
Sep 08 16:32:02.170009 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.169983    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:02.170173 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.170104    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-console-config" (OuterVolumeSpecName: "console-config") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:02.170173 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.170109    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:02.170508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.170453    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:02.172144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.172121    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a346583-b512-4dc9-95ba-e64d89014a8c-kube-api-access-sptgr" (OuterVolumeSpecName: "kube-api-access-sptgr") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "kube-api-access-sptgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:02.172144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.172131    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:02.172287 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.172201    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a346583-b512-4dc9-95ba-e64d89014a8c" (UID: "2a346583-b512-4dc9-95ba-e64d89014a8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270677    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-oauth-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270722    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270731    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270741    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a346583-b512-4dc9-95ba-e64d89014a8c-console-oauth-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270751    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270759    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sptgr\" (UniqueName: \"kubernetes.io/projected/2a346583-b512-4dc9-95ba-e64d89014a8c-kube-api-access-sptgr\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.270787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.270768    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a346583-b512-4dc9-95ba-e64d89014a8c-console-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:02.373400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.373329    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85c7f68df9-95fxq"]
Sep 08 16:32:02.375460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.375435    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85c7f68df9-95fxq"]
Sep 08 16:32:02.468299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:02.468264    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a346583-b512-4dc9-95ba-e64d89014a8c" path="/var/lib/kubelet/pods/2a346583-b512-4dc9-95ba-e64d89014a8c/volumes"
Sep 08 16:32:11.775910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:11.775855    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:11.859683 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:11.859639    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:12.658369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:12.658338    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:32:12.662527 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:12.662496    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5494ddd995-4bsd7"
Sep 08 16:32:13.072508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.072470    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59d4df67c6-s2lzc" podUID="5729a780-3e82-4a0e-91a6-baae7f5f88c5" containerName="console" containerID="cri-o://b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4" gracePeriod=15
Sep 08 16:32:13.355662 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.355581    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:32:13.460934 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.460897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-service-ca\") pod \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") "
Sep 08 16:32:13.460934 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.460933    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-config\") pod \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") "
Sep 08 16:32:13.461167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.460993    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-oauth-serving-cert\") pod \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") "
Sep 08 16:32:13.461167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.461011    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-serving-cert\") pod \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") "
Sep 08 16:32:13.461167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.461049    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mbbz\" (UniqueName: \"kubernetes.io/projected/5729a780-3e82-4a0e-91a6-baae7f5f88c5-kube-api-access-5mbbz\") pod \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") "
Sep 08 16:32:13.461167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.461076    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-oauth-config\") pod \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\" (UID: \"5729a780-3e82-4a0e-91a6-baae7f5f88c5\") "
Sep 08 16:32:13.461396 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.461307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "5729a780-3e82-4a0e-91a6-baae7f5f88c5" (UID: "5729a780-3e82-4a0e-91a6-baae7f5f88c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:13.461396 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.461357    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5729a780-3e82-4a0e-91a6-baae7f5f88c5" (UID: "5729a780-3e82-4a0e-91a6-baae7f5f88c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:13.461396 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.461368    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-config" (OuterVolumeSpecName: "console-config") pod "5729a780-3e82-4a0e-91a6-baae7f5f88c5" (UID: "5729a780-3e82-4a0e-91a6-baae7f5f88c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:13.463481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.463456    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5729a780-3e82-4a0e-91a6-baae7f5f88c5" (UID: "5729a780-3e82-4a0e-91a6-baae7f5f88c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:13.463619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.463552    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5729a780-3e82-4a0e-91a6-baae7f5f88c5" (UID: "5729a780-3e82-4a0e-91a6-baae7f5f88c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:13.463619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.463588    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5729a780-3e82-4a0e-91a6-baae7f5f88c5-kube-api-access-5mbbz" (OuterVolumeSpecName: "kube-api-access-5mbbz") pod "5729a780-3e82-4a0e-91a6-baae7f5f88c5" (UID: "5729a780-3e82-4a0e-91a6-baae7f5f88c5"). InnerVolumeSpecName "kube-api-access-5mbbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:13.562399 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.562360    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-oauth-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:13.562399 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.562396    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:13.562598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.562411    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mbbz\" (UniqueName: \"kubernetes.io/projected/5729a780-3e82-4a0e-91a6-baae7f5f88c5-kube-api-access-5mbbz\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:13.562598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.562424    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-oauth-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:13.562598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.562436    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:13.562598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:13.562447    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5729a780-3e82-4a0e-91a6-baae7f5f88c5-console-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:14.096781 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.096742    2581 generic.go:356] "Generic (PLEG): container finished" podID="5729a780-3e82-4a0e-91a6-baae7f5f88c5" containerID="b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4" exitCode=0
Sep 08 16:32:14.097196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.096792    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59d4df67c6-s2lzc"
Sep 08 16:32:14.097196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.096807    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d4df67c6-s2lzc" event={"ID":"5729a780-3e82-4a0e-91a6-baae7f5f88c5","Type":"ContainerDied","Data":"b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4"}
Sep 08 16:32:14.097196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.096882    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59d4df67c6-s2lzc" event={"ID":"5729a780-3e82-4a0e-91a6-baae7f5f88c5","Type":"ContainerDied","Data":"61375ba803d341929eb971add6d0ecd307af94456d61940677fcf7c58b2f8d78"}
Sep 08 16:32:14.097196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.096904    2581 scope.go:117] "RemoveContainer" containerID="b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4"
Sep 08 16:32:14.106057 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.106035    2581 scope.go:117] "RemoveContainer" containerID="b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4"
Sep 08 16:32:14.106408 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:14.106385    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4\": container with ID starting with b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4 not found: ID does not exist" containerID="b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4"
Sep 08 16:32:14.106460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.106418    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4"} err="failed to get container status \"b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4\": rpc error: code = NotFound desc = could not find container \"b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4\": container with ID starting with b8ff550dd3e75a2b14d4b741b33032a60cd42b68016d0625e445bba477c2fea4 not found: ID does not exist"
Sep 08 16:32:14.118058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.118028    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59d4df67c6-s2lzc"]
Sep 08 16:32:14.119422 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.119399    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59d4df67c6-s2lzc"]
Sep 08 16:32:14.466558 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:14.466524    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5729a780-3e82-4a0e-91a6-baae7f5f88c5" path="/var/lib/kubelet/pods/5729a780-3e82-4a0e-91a6-baae7f5f88c5/volumes"
Sep 08 16:32:15.981497 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:15.981466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jcwk9"
Sep 08 16:32:34.517629 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:34.517584    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:34.537824 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:34.537791    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:35.206349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:35.206321    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:37.838380 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:37.838345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:47.252225 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:47.252187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:47.715175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:47.715139    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:48.303339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303302    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:32:48.303793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303605    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="alertmanager" containerID="cri-o://bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030" gracePeriod=120
Sep 08 16:32:48.303793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303687    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-metric" containerID="cri-o://173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f" gracePeriod=120
Sep 08 16:32:48.303793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303715    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="config-reloader" containerID="cri-o://ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1" gracePeriod=120
Sep 08 16:32:48.304028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303793    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="prom-label-proxy" containerID="cri-o://6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa" gracePeriod=120
Sep 08 16:32:48.304028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303776    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy" containerID="cri-o://f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf" gracePeriod=120
Sep 08 16:32:48.304028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:48.303693    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-web" containerID="cri-o://9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee" gracePeriod=120
Sep 08 16:32:49.250616 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250579    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa" exitCode=0
Sep 08 16:32:49.250616 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250606    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf" exitCode=0
Sep 08 16:32:49.250616 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250615    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1" exitCode=0
Sep 08 16:32:49.250616 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250624    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030" exitCode=0
Sep 08 16:32:49.250910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250647    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"}
Sep 08 16:32:49.250910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250710    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"}
Sep 08 16:32:49.250910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250738    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"}
Sep 08 16:32:49.250910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.250761    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"}
Sep 08 16:32:49.556247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.556216    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:49.685525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685484    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-cluster-tls-config\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.685700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685542    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.685700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685571    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-out\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.685700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685591    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-trusted-ca-bundle\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.685700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-main-tls\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.685700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685648    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-web-config\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.685700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685697    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-tls-assets\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685735    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-volume\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685762    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-web\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685788    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-metrics-client-ca\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685811    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685866    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-main-db\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.685920    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qml4n\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-kube-api-access-qml4n\") pod \"fcedd289-d9ef-496d-bf17-027e139f5fa9\" (UID: \"fcedd289-d9ef-496d-bf17-027e139f5fa9\") "
Sep 08 16:32:49.686523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.686386    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:49.688883 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.688555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:32:49.688883 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.688783    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:49.689639 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.689532    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-out" (OuterVolumeSpecName: "config-out") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:32:49.689993 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.689877    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.690085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.690042    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-kube-api-access-qml4n" (OuterVolumeSpecName: "kube-api-access-qml4n") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "kube-api-access-qml4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:49.690141 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.690116    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.690269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.690239    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:49.690327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.690266    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.690945 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.690923    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.691203 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.691186    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-volume" (OuterVolumeSpecName: "config-volume") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.694785 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.694758    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.701094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.701064    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-web-config" (OuterVolumeSpecName: "web-config") pod "fcedd289-d9ef-496d-bf17-027e139f5fa9" (UID: "fcedd289-d9ef-496d-bf17-027e139f5fa9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:49.787110 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787075    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qml4n\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-kube-api-access-qml4n\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787110 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787107    2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-cluster-tls-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787121    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787133    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-out\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787144    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787157    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-main-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787172    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-web-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787182    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fcedd289-d9ef-496d-bf17-027e139f5fa9-tls-assets\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787192    2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-config-volume\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787204    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787215    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fcedd289-d9ef-496d-bf17-027e139f5fa9-metrics-client-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787226    2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fcedd289-d9ef-496d-bf17-027e139f5fa9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:49.787339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:49.787238    2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fcedd289-d9ef-496d-bf17-027e139f5fa9-alertmanager-main-db\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:50.258083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258046    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f" exitCode=0
Sep 08 16:32:50.258083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258071    2581 generic.go:356] "Generic (PLEG): container finished" podID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerID="9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee" exitCode=0
Sep 08 16:32:50.258300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258123    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.258300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258119    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"}
Sep 08 16:32:50.258300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"}
Sep 08 16:32:50.258300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258287    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fcedd289-d9ef-496d-bf17-027e139f5fa9","Type":"ContainerDied","Data":"9e01abe779dd251007d1a9f78a0ea38fa2f1c6a3574943e0ca0a04f41275360a"}
Sep 08 16:32:50.258439 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.258316    2581 scope.go:117] "RemoveContainer" containerID="6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"
Sep 08 16:32:50.266754 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.266732    2581 scope.go:117] "RemoveContainer" containerID="173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"
Sep 08 16:32:50.274781 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.274761    2581 scope.go:117] "RemoveContainer" containerID="f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"
Sep 08 16:32:50.282578 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.282552    2581 scope.go:117] "RemoveContainer" containerID="9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"
Sep 08 16:32:50.285073 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.285051    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:32:50.289335 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.289306    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:32:50.292624 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.292604    2581 scope.go:117] "RemoveContainer" containerID="ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"
Sep 08 16:32:50.301654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.301632    2581 scope.go:117] "RemoveContainer" containerID="bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"
Sep 08 16:32:50.309908 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.309885    2581 scope.go:117] "RemoveContainer" containerID="9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"
Sep 08 16:32:50.316476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316447    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:32:50.316949 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316931    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-metric"
Sep 08 16:32:50.317002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316953    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-metric"
Sep 08 16:32:50.317002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316967    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5729a780-3e82-4a0e-91a6-baae7f5f88c5" containerName="console"
Sep 08 16:32:50.317002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316975    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5729a780-3e82-4a0e-91a6-baae7f5f88c5" containerName="console"
Sep 08 16:32:50.317002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316987    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="init-config-reloader"
Sep 08 16:32:50.317002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.316996    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="init-config-reloader"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317004    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="prom-label-proxy"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317012    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="prom-label-proxy"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317027    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a346583-b512-4dc9-95ba-e64d89014a8c" containerName="console"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317036    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a346583-b512-4dc9-95ba-e64d89014a8c" containerName="console"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317059    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-web"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317068    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-web"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317083    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="alertmanager"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317091    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="alertmanager"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317107    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317114    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317130    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="config-reloader"
Sep 08 16:32:50.317154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317138    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="config-reloader"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317229    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317243    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5729a780-3e82-4a0e-91a6-baae7f5f88c5" containerName="console"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317253    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="prom-label-proxy"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317261    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="alertmanager"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317269    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a346583-b512-4dc9-95ba-e64d89014a8c" containerName="console"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317278    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="config-reloader"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317285    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-web"
Sep 08 16:32:50.317476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.317296    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" containerName="kube-rbac-proxy-metric"
Sep 08 16:32:50.319970 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.319952    2581 scope.go:117] "RemoveContainer" containerID="6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"
Sep 08 16:32:50.320342 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.320316    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa\": container with ID starting with 6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa not found: ID does not exist" containerID="6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"
Sep 08 16:32:50.320491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.320353    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"} err="failed to get container status \"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa\": rpc error: code = NotFound desc = could not find container \"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa\": container with ID starting with 6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa not found: ID does not exist"
Sep 08 16:32:50.320491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.320379    2581 scope.go:117] "RemoveContainer" containerID="173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"
Sep 08 16:32:50.320715 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.320695    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f\": container with ID starting with 173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f not found: ID does not exist" containerID="173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"
Sep 08 16:32:50.320753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.320723    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"} err="failed to get container status \"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f\": rpc error: code = NotFound desc = could not find container \"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f\": container with ID starting with 173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f not found: ID does not exist"
Sep 08 16:32:50.320753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.320739    2581 scope.go:117] "RemoveContainer" containerID="f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"
Sep 08 16:32:50.321426 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.321408    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf\": container with ID starting with f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf not found: ID does not exist" containerID="f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"
Sep 08 16:32:50.321479 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.321434    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"} err="failed to get container status \"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf\": rpc error: code = NotFound desc = could not find container \"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf\": container with ID starting with f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf not found: ID does not exist"
Sep 08 16:32:50.321479 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.321449    2581 scope.go:117] "RemoveContainer" containerID="9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"
Sep 08 16:32:50.321546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.321492    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.321749 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.321716    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee\": container with ID starting with 9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee not found: ID does not exist" containerID="9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"
Sep 08 16:32:50.321888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.321749    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"} err="failed to get container status \"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee\": rpc error: code = NotFound desc = could not find container \"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee\": container with ID starting with 9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee not found: ID does not exist"
Sep 08 16:32:50.321888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.321768    2581 scope.go:117] "RemoveContainer" containerID="ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"
Sep 08 16:32:50.322169 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.322139    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1\": container with ID starting with ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1 not found: ID does not exist" containerID="ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"
Sep 08 16:32:50.322263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.322235    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"} err="failed to get container status \"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1\": rpc error: code = NotFound desc = could not find container \"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1\": container with ID starting with ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1 not found: ID does not exist"
Sep 08 16:32:50.322263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.322260    2581 scope.go:117] "RemoveContainer" containerID="bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"
Sep 08 16:32:50.322610 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.322590    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030\": container with ID starting with bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030 not found: ID does not exist" containerID="bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"
Sep 08 16:32:50.322685 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.322614    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"} err="failed to get container status \"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030\": rpc error: code = NotFound desc = could not find container \"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030\": container with ID starting with bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030 not found: ID does not exist"
Sep 08 16:32:50.322685 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.322628    2581 scope.go:117] "RemoveContainer" containerID="9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"
Sep 08 16:32:50.322978 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:50.322958    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12\": container with ID starting with 9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12 not found: ID does not exist" containerID="9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"
Sep 08 16:32:50.323064 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.322980    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"} err="failed to get container status \"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12\": rpc error: code = NotFound desc = could not find container \"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12\": container with ID starting with 9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12 not found: ID does not exist"
Sep 08 16:32:50.323064 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.322997    2581 scope.go:117] "RemoveContainer" containerID="6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"
Sep 08 16:32:50.323274 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323256    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa"} err="failed to get container status \"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa\": rpc error: code = NotFound desc = could not find container \"6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa\": container with ID starting with 6a8e498a287669ad84348470361d49583cae9ef280de4674b6dc236e976b72fa not found: ID does not exist"
Sep 08 16:32:50.323345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323276    2581 scope.go:117] "RemoveContainer" containerID="173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"
Sep 08 16:32:50.323564 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323542    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f"} err="failed to get container status \"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f\": rpc error: code = NotFound desc = could not find container \"173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f\": container with ID starting with 173201a5f486400752bee2fc9700231e16d8aae99cc3c7f04a989c0bdb2ef38f not found: ID does not exist"
Sep 08 16:32:50.323633 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323565    2581 scope.go:117] "RemoveContainer" containerID="f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"
Sep 08 16:32:50.323941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323731    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 16:32:50.323941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323742    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-w57xr\""
Sep 08 16:32:50.323941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323790    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 16:32:50.323941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323822    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf"} err="failed to get container status \"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf\": rpc error: code = NotFound desc = could not find container \"f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf\": container with ID starting with f344aff1eae39bfca8e698f90cc1957f5dfe78322414a05c780969938fe8dcbf not found: ID does not exist"
Sep 08 16:32:50.323941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323873    2581 scope.go:117] "RemoveContainer" containerID="9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"
Sep 08 16:32:50.323941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.323900    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 16:32:50.324290 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324081    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 16:32:50.324290 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324088    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 16:32:50.324290 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324092    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 16:32:50.324290 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324181    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee"} err="failed to get container status \"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee\": rpc error: code = NotFound desc = could not find container \"9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee\": container with ID starting with 9a566384b76c8b5fb8f0b90ec6a063d825d551f50442117ac0bc352dcd0c5bee not found: ID does not exist"
Sep 08 16:32:50.324290 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324202    2581 scope.go:117] "RemoveContainer" containerID="ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"
Sep 08 16:32:50.324491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324291    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 16:32:50.324672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324657    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 16:32:50.324747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324682    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1"} err="failed to get container status \"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1\": rpc error: code = NotFound desc = could not find container \"ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1\": container with ID starting with ef4d63fd49bb373fd925009759e06fdb5caefa7e7ab4e0f0823e5001f24955e1 not found: ID does not exist"
Sep 08 16:32:50.324747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.324706    2581 scope.go:117] "RemoveContainer" containerID="bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"
Sep 08 16:32:50.325085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.325065    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030"} err="failed to get container status \"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030\": rpc error: code = NotFound desc = could not find container \"bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030\": container with ID starting with bb29d201c69ce91bdc262bf1af4d36192422f8bfae204756354cc6951249d030 not found: ID does not exist"
Sep 08 16:32:50.325165 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.325085    2581 scope.go:117] "RemoveContainer" containerID="9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"
Sep 08 16:32:50.325383 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.325363    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12"} err="failed to get container status \"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12\": rpc error: code = NotFound desc = could not find container \"9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12\": container with ID starting with 9b5ca30407b159e9eba00fe848c66f1db2814f547a0d5d6990db4eb8b7f85e12 not found: ID does not exist"
Sep 08 16:32:50.330295 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.330271    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 16:32:50.337741 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.337706    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:32:50.393976 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.393942    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.393993    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-config-volume\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394044    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06d1eceb-c358-4119-8f62-5b0487f54774-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d1eceb-c358-4119-8f62-5b0487f54774-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394114    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394144    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394257    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6j42d\" (UniqueName: \"kubernetes.io/projected/06d1eceb-c358-4119-8f62-5b0487f54774-kube-api-access-6j42d\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06d1eceb-c358-4119-8f62-5b0487f54774-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06d1eceb-c358-4119-8f62-5b0487f54774-config-out\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394346    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-web-config\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.394440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.394401    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06d1eceb-c358-4119-8f62-5b0487f54774-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.471574 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.471541    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcedd289-d9ef-496d-bf17-027e139f5fa9" path="/var/lib/kubelet/pods/fcedd289-d9ef-496d-bf17-027e139f5fa9/volumes"
Sep 08 16:32:50.495160 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-config-volume\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495160 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495163    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06d1eceb-c358-4119-8f62-5b0487f54774-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495184    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d1eceb-c358-4119-8f62-5b0487f54774-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495201    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495330    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495549 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495549 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495475    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6j42d\" (UniqueName: \"kubernetes.io/projected/06d1eceb-c358-4119-8f62-5b0487f54774-kube-api-access-6j42d\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495651 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495593    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/06d1eceb-c358-4119-8f62-5b0487f54774-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495651 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495641    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06d1eceb-c358-4119-8f62-5b0487f54774-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495667    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06d1eceb-c358-4119-8f62-5b0487f54774-config-out\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495688    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-web-config\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495711    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495732    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06d1eceb-c358-4119-8f62-5b0487f54774-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.495976 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.495772    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.497367 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.496354    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06d1eceb-c358-4119-8f62-5b0487f54774-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.497367 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.497001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06d1eceb-c358-4119-8f62-5b0487f54774-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.498410 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.498385    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/06d1eceb-c358-4119-8f62-5b0487f54774-config-out\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.498715 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.498687    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.498798 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.498725    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.498892 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.498871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-config-volume\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.499089 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.499068    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.499543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.499503    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.499753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.499736    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/06d1eceb-c358-4119-8f62-5b0487f54774-tls-assets\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.499863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.499821    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.500631 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.500614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/06d1eceb-c358-4119-8f62-5b0487f54774-web-config\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.505039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.505016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6j42d\" (UniqueName: \"kubernetes.io/projected/06d1eceb-c358-4119-8f62-5b0487f54774-kube-api-access-6j42d\") pod \"alertmanager-main-0\" (UID: \"06d1eceb-c358-4119-8f62-5b0487f54774\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.632104 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.631984    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 16:32:50.923175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:50.923093    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 16:32:50.926073 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:32:50.926049    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06d1eceb_c358_4119_8f62_5b0487f54774.slice/crio-e5bfe208400030a390e3742cfd8208799ca6c5a528b3ba02239625e6c03b59a6 WatchSource:0}: Error finding container e5bfe208400030a390e3742cfd8208799ca6c5a528b3ba02239625e6c03b59a6: Status 404 returned error can't find the container with id e5bfe208400030a390e3742cfd8208799ca6c5a528b3ba02239625e6c03b59a6
Sep 08 16:32:51.264266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:51.264227    2581 generic.go:356] "Generic (PLEG): container finished" podID="06d1eceb-c358-4119-8f62-5b0487f54774" containerID="7e7389c130bb489463e41ee4a41a0f868942d878c7c6971f8165b4e64953f47f" exitCode=0
Sep 08 16:32:51.264467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:51.264315    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerDied","Data":"7e7389c130bb489463e41ee4a41a0f868942d878c7c6971f8165b4e64953f47f"}
Sep 08 16:32:51.264467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:51.264391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"e5bfe208400030a390e3742cfd8208799ca6c5a528b3ba02239625e6c03b59a6"}
Sep 08 16:32:52.273992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.273941    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"76e66b79483bf74ced69c686b742265d9374e1eb8c7df9f146fcee9913d4c736"}
Sep 08 16:32:52.274470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.274036    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"bcf415d0ff992ec5bb828dbdb39bdae2386293e625bb87993809c1d73027dd11"}
Sep 08 16:32:52.274470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.274068    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"fb01f215ece3e53b14e7e6a63d958573fce9fded3d7fed970a914469df237d2a"}
Sep 08 16:32:52.274470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.274100    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"69e5b2e2666df38562a7b2fb8a9f83e69786fc15cf7d591c753bc9e7062bf184"}
Sep 08 16:32:52.274470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.274124    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"a5c0b3afcd05319ac74814221d2a5b61ce79238cd250bb7da14332cf771ad538"}
Sep 08 16:32:52.274470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.274146    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"06d1eceb-c358-4119-8f62-5b0487f54774","Type":"ContainerStarted","Data":"81f08724fbc0ca1eb02a50197df5d1b1424103a5e2cf6f18afa7522b200e323c"}
Sep 08 16:32:52.311813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.311748    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.295130811 podStartE2EDuration="2.311725009s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.594198ms" isStatefulPod=false podCreationTimestamp="2026-09-08 16:32:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:32:52.310166687 +0000 UTC m=+140.298602641" watchObservedRunningTime="2026-09-08 16:32:52.311725009 +0000 UTC m=+140.300160978"
Sep 08 16:32:52.695197 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695159    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:32:52.695495 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695462    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="prometheus" containerID="cri-o://cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde" gracePeriod=600
Sep 08 16:32:52.695495 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695477    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy" containerID="cri-o://97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2" gracePeriod=600
Sep 08 16:32:52.695711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695507    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="thanos-sidecar" containerID="cri-o://e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f" gracePeriod=600
Sep 08 16:32:52.695711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695532    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-web" containerID="cri-o://061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e" gracePeriod=600
Sep 08 16:32:52.695711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695562    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="config-reloader" containerID="cri-o://aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742" gracePeriod=600
Sep 08 16:32:52.695711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.695636    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-thanos" containerID="cri-o://897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47" gracePeriod=600
Sep 08 16:32:52.950919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:52.950660    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.020356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020316    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-tls-assets\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020369    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-web-config\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020423    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-1\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020453    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msghf\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-kube-api-access-msghf\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020482    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-grpc-tls\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020512    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-2\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020550    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-metrics-client-certs\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020575    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-kube-rbac-proxy\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020599    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-tls\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020627    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020662    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-thanos-prometheus-http-client-file\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020704    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-db\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020729    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.020766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020767    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-config-out\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020802    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-trusted-ca-bundle\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020855    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-serving-certs-ca-bundle\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020905    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-kubelet-serving-ca-bundle\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020940    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-config\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020951    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.020981    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-metrics-client-ca\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.021018    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-0\") pod \"3c093279-ad2e-41e3-bbc8-6959c1cee263\" (UID: \"3c093279-ad2e-41e3-bbc8-6959c1cee263\") "
Sep 08 16:32:53.021480 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.021259    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.021480 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.021273    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.022385 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.022350    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:32:53.022542 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.022510    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.022980 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.022944    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.023065 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.022986    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.023065 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.023058    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.023470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.023447    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:32:53.029194 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.029151    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.029635 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.029599    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.030420 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.030387    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.030523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.030478    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-config-out" (OuterVolumeSpecName: "config-out") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:32:53.030744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.030717    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.031296 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.031261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-config" (OuterVolumeSpecName: "config") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.031296 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.031265    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:53.031459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.031380    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.031520 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.031481    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-kube-api-access-msghf" (OuterVolumeSpecName: "kube-api-access-msghf") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "kube-api-access-msghf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:32:53.031580 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.031562    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.032010 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.031987    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.041939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.041881    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-web-config" (OuterVolumeSpecName: "web-config") pod "3c093279-ad2e-41e3-bbc8-6959c1cee263" (UID: "3c093279-ad2e-41e3-bbc8-6959c1cee263"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:32:53.122364 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122325    2581 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122364 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122359    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-metrics-client-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122364 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122369    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122378    2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-tls-assets\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122388    2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-web-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122398    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msghf\" (UniqueName: \"kubernetes.io/projected/3c093279-ad2e-41e3-bbc8-6959c1cee263-kube-api-access-msghf\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122406    2581 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-grpc-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122414    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122422    2581 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-metrics-client-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122430    2581 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-kube-rbac-proxy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122438    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122447    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122456    2581 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-thanos-prometheus-http-client-file\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122464    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-k8s-db\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122473    2581 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3c093279-ad2e-41e3-bbc8-6959c1cee263-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122480    2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3c093279-ad2e-41e3-bbc8-6959c1cee263-config-out\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122488    2581 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-prometheus-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122495    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.122605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.122505    2581 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3c093279-ad2e-41e3-bbc8-6959c1cee263-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281717    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47" exitCode=0
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281747    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2" exitCode=0
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281753    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e" exitCode=0
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281758    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f" exitCode=0
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281765    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742" exitCode=0
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281770    2581 generic.go:356] "Generic (PLEG): container finished" podID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde" exitCode=0
Sep 08 16:32:53.281815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281795    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281790    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"}
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281932    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"}
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281962    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"}
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.281989    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"}
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.282015    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"}
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.282015    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.282040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"}
Sep 08 16:32:53.282485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.282063    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3c093279-ad2e-41e3-bbc8-6959c1cee263","Type":"ContainerDied","Data":"7b1646bf130173b259e3bee83757b95a01d1af2f9ae4d8f0046b345ca896cbf5"}
Sep 08 16:32:53.292193 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.292165    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.300325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.300303    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.308079 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.308057    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.314228 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.314200    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:32:53.316463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.316439    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.321853 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.321800    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:32:53.325312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.325294    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.333395 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.333374    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.340946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.340927    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.341306 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.341284    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.341354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.341317    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"} err="failed to get container status \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist"
Sep 08 16:32:53.341354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.341337    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.341606 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.341589    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.341657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.341612    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"} err="failed to get container status \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist"
Sep 08 16:32:53.341657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.341628    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.341912 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.341892    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.341961 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.341916    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"} err="failed to get container status \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist"
Sep 08 16:32:53.341961 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.341933    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.342183 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.342167    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.342222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342187    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"} err="failed to get container status \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist"
Sep 08 16:32:53.342222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342200    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.342445 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.342430    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.342489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342449    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"} err="failed to get container status \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist"
Sep 08 16:32:53.342489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342461    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.342673 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.342652    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.342723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342678    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"} err="failed to get container status \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist"
Sep 08 16:32:53.342723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342691    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.342991 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:32:53.342963    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.343069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.342998    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"} err="failed to get container status \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist"
Sep 08 16:32:53.343069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343018    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.343242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343225    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"} err="failed to get container status \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist"
Sep 08 16:32:53.343286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343243    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.343422 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343401    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"} err="failed to get container status \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist"
Sep 08 16:32:53.343473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343422    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.343656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343636    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"} err="failed to get container status \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist"
Sep 08 16:32:53.343702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343657    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.343959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343929    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"} err="failed to get container status \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist"
Sep 08 16:32:53.343959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.343959    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.344211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344188    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"} err="failed to get container status \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist"
Sep 08 16:32:53.344211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344208    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.344440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344423    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"} err="failed to get container status \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist"
Sep 08 16:32:53.344440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344440    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.344654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344637    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"} err="failed to get container status \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist"
Sep 08 16:32:53.344707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344654    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.344931 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344910    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"} err="failed to get container status \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist"
Sep 08 16:32:53.344931 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.344930    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.345332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.345179    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"} err="failed to get container status \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist"
Sep 08 16:32:53.345332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.345217    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.345528 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.345509    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"} err="failed to get container status \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist"
Sep 08 16:32:53.345575 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.345529    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.345801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.345780    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"} err="failed to get container status \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist"
Sep 08 16:32:53.345801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.345801    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.346085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346068    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"} err="failed to get container status \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist"
Sep 08 16:32:53.346124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346085    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.346303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346288    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"} err="failed to get container status \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist"
Sep 08 16:32:53.346352 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346304    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.346548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346528    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"} err="failed to get container status \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist"
Sep 08 16:32:53.346623 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346550    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.346756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346741    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"} err="failed to get container status \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist"
Sep 08 16:32:53.346794 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346756    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.346979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346964    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"} err="failed to get container status \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist"
Sep 08 16:32:53.347034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.346979    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.347168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347154    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"} err="failed to get container status \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist"
Sep 08 16:32:53.347214 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347168    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.347371 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347352    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"} err="failed to get container status \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist"
Sep 08 16:32:53.347371 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347371    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.347586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347570    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"} err="failed to get container status \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist"
Sep 08 16:32:53.347656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347587    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.347792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347775    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"} err="failed to get container status \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist"
Sep 08 16:32:53.347878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.347792    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.348031 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348014    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"} err="failed to get container status \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist"
Sep 08 16:32:53.348087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348031    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.348240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348225    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"} err="failed to get container status \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist"
Sep 08 16:32:53.348287 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348241    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.348467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348444    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"} err="failed to get container status \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist"
Sep 08 16:32:53.348467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348464    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.348658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348637    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"} err="failed to get container status \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist"
Sep 08 16:32:53.348658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348658    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.348881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348863    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"} err="failed to get container status \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist"
Sep 08 16:32:53.348920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.348881    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.349100 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349084    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"} err="failed to get container status \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist"
Sep 08 16:32:53.349100 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349098    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.349301 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349277    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"} err="failed to get container status \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist"
Sep 08 16:32:53.349301 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349291    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.349509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349495    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"} err="failed to get container status \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist"
Sep 08 16:32:53.349548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349509    2581 scope.go:117] "RemoveContainer" containerID="897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"
Sep 08 16:32:53.349704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349685    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47"} err="failed to get container status \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": rpc error: code = NotFound desc = could not find container \"897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47\": container with ID starting with 897758cdcbce46b87e1c644c959967f1efcbec87b8fdf6012951e3ececd65a47 not found: ID does not exist"
Sep 08 16:32:53.349762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349705    2581 scope.go:117] "RemoveContainer" containerID="97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"
Sep 08 16:32:53.349953 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349931    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2"} err="failed to get container status \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": rpc error: code = NotFound desc = could not find container \"97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2\": container with ID starting with 97733e7592e8c0a927c3168c2406c971b8ad3b20e01e59cac3cbe480fb4c9cf2 not found: ID does not exist"
Sep 08 16:32:53.350093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.349956    2581 scope.go:117] "RemoveContainer" containerID="061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"
Sep 08 16:32:53.350171 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350148    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e"} err="failed to get container status \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": rpc error: code = NotFound desc = could not find container \"061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e\": container with ID starting with 061d35d2f253a731985ad63161e8ccdbc5e83040d28eeab9b19416c89b16105e not found: ID does not exist"
Sep 08 16:32:53.350229 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350174    2581 scope.go:117] "RemoveContainer" containerID="e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"
Sep 08 16:32:53.350419 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350400    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f"} err="failed to get container status \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": rpc error: code = NotFound desc = could not find container \"e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f\": container with ID starting with e2f5ca700e9199ff9c1421ea9e65336cf3524ee86754e12bb87721296fa2769f not found: ID does not exist"
Sep 08 16:32:53.350467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350421    2581 scope.go:117] "RemoveContainer" containerID="aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"
Sep 08 16:32:53.350649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350629    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742"} err="failed to get container status \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": rpc error: code = NotFound desc = could not find container \"aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742\": container with ID starting with aa19ac3a97c88750d9f4a9968930d09baa0128bd395a6f77e42d9fd13ec19742 not found: ID does not exist"
Sep 08 16:32:53.350695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350652    2581 scope.go:117] "RemoveContainer" containerID="cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"
Sep 08 16:32:53.350881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350864    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde"} err="failed to get container status \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": rpc error: code = NotFound desc = could not find container \"cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde\": container with ID starting with cdb061075f425752be2e0491a1862cd2d0fd32487e5bad0b5538add6f22e8cde not found: ID does not exist"
Sep 08 16:32:53.350935 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.350881    2581 scope.go:117] "RemoveContainer" containerID="89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"
Sep 08 16:32:53.351083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.351068    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f"} err="failed to get container status \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": rpc error: code = NotFound desc = could not find container \"89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f\": container with ID starting with 89e5816227672ac2d1e37137a1f5f178ef9093ce71c33bf66627e654a6f1fd7f not found: ID does not exist"
Sep 08 16:32:53.357044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357019    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:32:53.357323 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357311    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="prometheus"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357325    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="prometheus"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357332    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-web"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357338    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-web"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357347    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="init-config-reloader"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357353    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="init-config-reloader"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357361    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="config-reloader"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357366    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="config-reloader"
Sep 08 16:32:53.357372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357373    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357378    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357388    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="thanos-sidecar"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357393    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="thanos-sidecar"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357398    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-thanos"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357403    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-thanos"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357450    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="thanos-sidecar"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357459    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-thanos"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357466    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="config-reloader"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357472    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357477    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="prometheus"
Sep 08 16:32:53.357588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.357484    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" containerName="kube-rbac-proxy-web"
Sep 08 16:32:53.366937 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.366891    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.369655 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.369628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z26x8\""
Sep 08 16:32:53.369786 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.369721    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 16:32:53.370055 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370034    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 16:32:53.370055 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370048    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 16:32:53.370201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370076    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 16:32:53.370201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370094    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 16:32:53.370316 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370302    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 16:32:53.370586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370568    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 16:32:53.370798 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370780    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 16:32:53.370906 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370891    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 16:32:53.371007 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370978    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 16:32:53.371088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.370978    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 16:32:53.372345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.372320    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-adkj3dvt8a46f\""
Sep 08 16:32:53.373470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.373451    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 16:32:53.374737 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.374718    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 16:32:53.378119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.378099    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 16:32:53.382036 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.382009    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:32:53.425632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425597    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.425632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425639    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/684b8e3b-4c15-467e-923a-72cf61109126-config-out\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.425861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425657    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.425861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425740    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.425861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.425861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.425861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425874    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425897    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.425991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426009    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-web-config\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q9wx\" (UniqueName: \"kubernetes.io/projected/684b8e3b-4c15-467e-923a-72cf61109126-kube-api-access-8q9wx\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426067    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426101    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-config\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426127    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.426263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.426191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/684b8e3b-4c15-467e-923a-72cf61109126-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527151 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527102    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527173    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527208    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527230    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-web-config\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527515 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q9wx\" (UniqueName: \"kubernetes.io/projected/684b8e3b-4c15-467e-923a-72cf61109126-kube-api-access-8q9wx\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527570 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527534    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527620 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527575    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-config\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527630    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527704    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527758    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/684b8e3b-4c15-467e-923a-72cf61109126-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527917 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.527917 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527880    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/684b8e3b-4c15-467e-923a-72cf61109126-config-out\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527924    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527952    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.527986    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.528017    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.528065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.528096    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.528135    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.528091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.528162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.530242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.528750    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.530242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.529356    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.530242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.529761    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.530775    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.530927    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-web-config\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.531076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.531257    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.531263    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.531816    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.531968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.531857    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.532407 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.532176    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/684b8e3b-4c15-467e-923a-72cf61109126-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.532407 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.532182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/684b8e3b-4c15-467e-923a-72cf61109126-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.532686 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.532670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/684b8e3b-4c15-467e-923a-72cf61109126-config-out\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.533324 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.533300    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.533607 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.533590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.533662 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.533597    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.533781 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.533765    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/684b8e3b-4c15-467e-923a-72cf61109126-config\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.539598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.539572    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q9wx\" (UniqueName: \"kubernetes.io/projected/684b8e3b-4c15-467e-923a-72cf61109126-kube-api-access-8q9wx\") pod \"prometheus-k8s-0\" (UID: \"684b8e3b-4c15-467e-923a-72cf61109126\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.679056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.679021    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:32:53.965672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:53.965644    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 16:32:53.968215 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:32:53.968182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684b8e3b_4c15_467e_923a_72cf61109126.slice/crio-9da836c9066d753a9be1bb3c4177cef9b597c613e2cae859e16f11e8abee995e WatchSource:0}: Error finding container 9da836c9066d753a9be1bb3c4177cef9b597c613e2cae859e16f11e8abee995e: Status 404 returned error can't find the container with id 9da836c9066d753a9be1bb3c4177cef9b597c613e2cae859e16f11e8abee995e
Sep 08 16:32:54.289502 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:54.289406    2581 generic.go:356] "Generic (PLEG): container finished" podID="684b8e3b-4c15-467e-923a-72cf61109126" containerID="0e45b01adffa320636d422589f174011ec49595f50b080042c5804c8501db12d" exitCode=0
Sep 08 16:32:54.289502 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:54.289452    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerDied","Data":"0e45b01adffa320636d422589f174011ec49595f50b080042c5804c8501db12d"}
Sep 08 16:32:54.289912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:54.289519    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"9da836c9066d753a9be1bb3c4177cef9b597c613e2cae859e16f11e8abee995e"}
Sep 08 16:32:54.467617 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:54.467587    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c093279-ad2e-41e3-bbc8-6959c1cee263" path="/var/lib/kubelet/pods/3c093279-ad2e-41e3-bbc8-6959c1cee263/volumes"
Sep 08 16:32:55.297126 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.297084    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"3d3c9fa5112d3608ce2dceac6d5dfd25d874ca44a1678f9f2045c144b07d5b63"}
Sep 08 16:32:55.297489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.297177    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"8af77fef44c499128c9de7eb9fe389125bf6836e46f094fe58b4229f1bd2e1dd"}
Sep 08 16:32:55.297489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.297201    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"7d800bbc7ca8ae9d1535f57d3e1c08f41a5db1a6a1c71d7b1a3c8e6280738b67"}
Sep 08 16:32:55.297489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.297226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"ea068c895d37fe1205e7916ea14fe5962f27ddc6f3dee2fd2eee5c26c7e839dc"}
Sep 08 16:32:55.297489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.297252    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"b84c7ae4fe82ac1188fdea993bb542d8923703a54529676dc884deda9b35f75e"}
Sep 08 16:32:55.297489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.297286    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"684b8e3b-4c15-467e-923a-72cf61109126","Type":"ContainerStarted","Data":"49977e151bb533252a9155182ca0494d1484fcf611bee0c5d3aa44663c80ab09"}
Sep 08 16:32:55.331819 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:55.331754    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.312462064 podStartE2EDuration="2.331733466s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.271402ms" isStatefulPod=false podCreationTimestamp="2026-09-08 16:32:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:32:55.330440988 +0000 UTC m=+143.318876942" watchObservedRunningTime="2026-09-08 16:32:55.331733466 +0000 UTC m=+143.320169421"
Sep 08 16:32:56.772713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.772669    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-556ff8446b-8xcjv"]
Sep 08 16:32:56.777135 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.777111    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.791211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.791177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556ff8446b-8xcjv"]
Sep 08 16:32:56.836607 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.836570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:56.862400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-trusted-ca-bundle\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.862504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862412    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-oauth-serving-cert\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.862504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-serving-cert\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.862504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862455    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-config\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.862647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862546    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-service-ca\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.862647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862583    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-oauth-config\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.862722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.862651    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b485c\" (UniqueName: \"kubernetes.io/projected/18f40bf6-f0e0-42be-86c8-5a032364d6ac-kube-api-access-b485c\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.910091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.910059    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:32:56.963477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963444    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b485c\" (UniqueName: \"kubernetes.io/projected/18f40bf6-f0e0-42be-86c8-5a032364d6ac-kube-api-access-b485c\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.963604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963488    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-trusted-ca-bundle\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.963604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963514    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-oauth-serving-cert\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.963604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963541    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-serving-cert\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.963604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-config\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.963604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963602    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-service-ca\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.963812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.963636    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-oauth-config\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.964309 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.964284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-oauth-serving-cert\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.964460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.964439    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-trusted-ca-bundle\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.964594 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.964573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-config\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.964691 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.964670    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-service-ca\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.966227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.966199    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-oauth-config\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.966390 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.966372    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-serving-cert\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:56.972535 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:56.972511    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b485c\" (UniqueName: \"kubernetes.io/projected/18f40bf6-f0e0-42be-86c8-5a032364d6ac-kube-api-access-b485c\") pod \"console-556ff8446b-8xcjv\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") " pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:57.086772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:57.086674    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:32:57.367112 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:57.367009    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-556ff8446b-8xcjv"]
Sep 08 16:32:57.370659 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:32:57.370630    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f40bf6_f0e0_42be_86c8_5a032364d6ac.slice/crio-baeb13b116e909b8d2fc787cb4e036e365b5ec3f73949722c523edbe946ab671 WatchSource:0}: Error finding container baeb13b116e909b8d2fc787cb4e036e365b5ec3f73949722c523edbe946ab671: Status 404 returned error can't find the container with id baeb13b116e909b8d2fc787cb4e036e365b5ec3f73949722c523edbe946ab671
Sep 08 16:32:58.313894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:58.313852    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556ff8446b-8xcjv" event={"ID":"18f40bf6-f0e0-42be-86c8-5a032364d6ac","Type":"ContainerStarted","Data":"f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac"}
Sep 08 16:32:58.314277 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:58.313936    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556ff8446b-8xcjv" event={"ID":"18f40bf6-f0e0-42be-86c8-5a032364d6ac","Type":"ContainerStarted","Data":"baeb13b116e909b8d2fc787cb4e036e365b5ec3f73949722c523edbe946ab671"}
Sep 08 16:32:58.339184 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:58.339129    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-556ff8446b-8xcjv" podStartSLOduration=2.33911326 podStartE2EDuration="2.33911326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:32:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:32:58.337956014 +0000 UTC m=+146.326391967" watchObservedRunningTime="2026-09-08 16:32:58.33911326 +0000 UTC m=+146.327549224"
Sep 08 16:32:58.679462 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:32:58.679422    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:33:07.087639 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.087599    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:33:07.088148 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.087657    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:33:07.092516 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.092498    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:33:07.359846 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.359755    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:33:07.411473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.411441    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7b95f67d-4bt5x"]
Sep 08 16:33:07.524092 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.524061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:07.624388 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.624307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:07.724553 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:07.724522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:32.432985 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.432920    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f7b95f67d-4bt5x" podUID="2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" containerName="console" containerID="cri-o://68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163" gracePeriod=15
Sep 08 16:33:32.681075 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.681035    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:33:32.779099 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779058    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-serving-cert\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779099 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779109    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-service-ca\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779140    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-oauth-config\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779159    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-trusted-ca-bundle\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-oauth-serving-cert\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779220    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mzfw\" (UniqueName: \"kubernetes.io/projected/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-kube-api-access-6mzfw\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779246    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-config\") pod \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\" (UID: \"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373\") "
Sep 08 16:33:32.779730 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779682    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:33:32.779820 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779733    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-service-ca" (OuterVolumeSpecName: "service-ca") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:33:32.779820 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779732    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:33:32.779936 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.779812    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-config" (OuterVolumeSpecName: "console-config") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:33:32.781654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.781622    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-kube-api-access-6mzfw" (OuterVolumeSpecName: "kube-api-access-6mzfw") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "kube-api-access-6mzfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:33:32.781738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.781688    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:33:32.781738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.781714    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" (UID: "2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:33:32.879912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879871    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mzfw\" (UniqueName: \"kubernetes.io/projected/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-kube-api-access-6mzfw\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:32.879912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879904    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:32.879912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879914    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:32.880145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879927    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:32.880145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879938    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-console-oauth-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:32.880145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879950    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:32.880145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:32.879963    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373-oauth-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:33:33.463573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.463534    2581 generic.go:356] "Generic (PLEG): container finished" podID="2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" containerID="68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163" exitCode=0
Sep 08 16:33:33.464026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.463598    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f7b95f67d-4bt5x"
Sep 08 16:33:33.464026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.463615    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7b95f67d-4bt5x" event={"ID":"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373","Type":"ContainerDied","Data":"68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163"}
Sep 08 16:33:33.464026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.463658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f7b95f67d-4bt5x" event={"ID":"2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373","Type":"ContainerDied","Data":"30b8658448bc8d3c5eef43d218a920754a569337b7bfdcf55c5f9b8b732e3971"}
Sep 08 16:33:33.464026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.463677    2581 scope.go:117] "RemoveContainer" containerID="68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163"
Sep 08 16:33:33.473124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.473103    2581 scope.go:117] "RemoveContainer" containerID="68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163"
Sep 08 16:33:33.473474 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:33:33.473452    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163\": container with ID starting with 68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163 not found: ID does not exist" containerID="68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163"
Sep 08 16:33:33.473537 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.473485    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163"} err="failed to get container status \"68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163\": rpc error: code = NotFound desc = could not find container \"68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163\": container with ID starting with 68c97934efb226adae527cb26fa67a3129e2f6464dd24f33a43ed95e06984163 not found: ID does not exist"
Sep 08 16:33:33.485678 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.485647    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f7b95f67d-4bt5x"]
Sep 08 16:33:33.491224 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:33.491194    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f7b95f67d-4bt5x"]
Sep 08 16:33:34.468899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:34.468861    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" path="/var/lib/kubelet/pods/2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373/volumes"
Sep 08 16:33:38.504273 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:38.504242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:38.602863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:38.602807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:33:53.680122 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:53.680082    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:33:53.697373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:53.697346    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:33:54.570732 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:33:54.570705    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 16:34:02.530789 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:02.530735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:02.633744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:02.633705    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:14.515629 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:14.515594    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:14.591331 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:14.591295    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:18.202472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.202431    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8778f784-w4xjh"]
Sep 08 16:34:18.202897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.202762    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" containerName="console"
Sep 08 16:34:18.202897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.202774    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" containerName="console"
Sep 08 16:34:18.202897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.202869    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f0e4637-7ea8-43ca-8fdc-6ad5a01fe373" containerName="console"
Sep 08 16:34:18.207516 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.207490    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.230959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.230924    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8778f784-w4xjh"]
Sep 08 16:34:18.292267 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292215    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-serving-cert\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.292267 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-oauth-serving-cert\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.292504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-oauth-config\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.292504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2m2rx\" (UniqueName: \"kubernetes.io/projected/eab27ff1-1ed6-4eb4-a104-d060617a63fe-kube-api-access-2m2rx\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.292504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-service-ca\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.292504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-config\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.292504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.292447    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-trusted-ca-bundle\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.324605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.324561    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:18.393019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.392954    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-trusted-ca-bundle\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.393019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.393034    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-serving-cert\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.393325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.393066    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-oauth-serving-cert\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.393325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.393105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-oauth-config\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.393325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.393170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2m2rx\" (UniqueName: \"kubernetes.io/projected/eab27ff1-1ed6-4eb4-a104-d060617a63fe-kube-api-access-2m2rx\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.393325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.393211    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-service-ca\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.393325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.393238    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-config\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.394069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.394036    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-config\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.394069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.394063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-oauth-serving-cert\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.394305 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.394284    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-trusted-ca-bundle\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.394355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.394327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-service-ca\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.396581 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.396552    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-serving-cert\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.396581 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.396579    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-oauth-config\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.406623 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.406590    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2m2rx\" (UniqueName: \"kubernetes.io/projected/eab27ff1-1ed6-4eb4-a104-d060617a63fe-kube-api-access-2m2rx\") pod \"console-8778f784-w4xjh\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") " pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.406799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.406725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:18.518474 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.518378    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:18.794717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:18.794637    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8778f784-w4xjh"]
Sep 08 16:34:18.800266 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:34:18.800224    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab27ff1_1ed6_4eb4_a104_d060617a63fe.slice/crio-0ec2b801b591f12d91bd814b3b0820291657eed23c7c978b2f398d43d7d62a88 WatchSource:0}: Error finding container 0ec2b801b591f12d91bd814b3b0820291657eed23c7c978b2f398d43d7d62a88: Status 404 returned error can't find the container with id 0ec2b801b591f12d91bd814b3b0820291657eed23c7c978b2f398d43d7d62a88
Sep 08 16:34:19.656383 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:19.656347    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8778f784-w4xjh" event={"ID":"eab27ff1-1ed6-4eb4-a104-d060617a63fe","Type":"ContainerStarted","Data":"2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81"}
Sep 08 16:34:19.656815 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:19.656396    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8778f784-w4xjh" event={"ID":"eab27ff1-1ed6-4eb4-a104-d060617a63fe","Type":"ContainerStarted","Data":"0ec2b801b591f12d91bd814b3b0820291657eed23c7c978b2f398d43d7d62a88"}
Sep 08 16:34:19.679666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:19.679613    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8778f784-w4xjh" podStartSLOduration=1.6795975250000001 podStartE2EDuration="1.679597525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:34:19.677678708 +0000 UTC m=+227.666114661" watchObservedRunningTime="2026-09-08 16:34:19.679597525 +0000 UTC m=+227.668033479"
Sep 08 16:34:26.776618 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:26.776581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:26.875543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:26.875508    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:27.062673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:27.062583    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:27.165352 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:27.165313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:28.519066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.519021    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:28.519578 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.519093    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:28.524598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.524563    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:28.702491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.702461    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:34:28.753492 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.753432    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556ff8446b-8xcjv"]
Sep 08 16:34:28.873712 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.873636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:28.974911 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:28.974878    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:29.416608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:29.416573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:34:53.779439 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:53.779315    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-556ff8446b-8xcjv" podUID="18f40bf6-f0e0-42be-86c8-5a032364d6ac" containerName="console" containerID="cri-o://f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac" gracePeriod=15
Sep 08 16:34:54.022586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.022558    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:34:54.120900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.120759    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-serving-cert\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.120900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.120813    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-config\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.120900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.120879    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b485c\" (UniqueName: \"kubernetes.io/projected/18f40bf6-f0e0-42be-86c8-5a032364d6ac-kube-api-access-b485c\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.121183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121050    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-oauth-config\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.121183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121125    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-oauth-serving-cert\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.121183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121165    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-trusted-ca-bundle\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.121345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121231    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-service-ca\") pod \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\" (UID: \"18f40bf6-f0e0-42be-86c8-5a032364d6ac\") "
Sep 08 16:34:54.121345 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-config" (OuterVolumeSpecName: "console-config") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:34:54.121510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121472    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:34:54.121750 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121510    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.121750 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121722    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-service-ca" (OuterVolumeSpecName: "service-ca") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:34:54.121878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.121757    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:34:54.123297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.123271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:34:54.123297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.123286    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f40bf6-f0e0-42be-86c8-5a032364d6ac-kube-api-access-b485c" (OuterVolumeSpecName: "kube-api-access-b485c") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "kube-api-access-b485c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:34:54.123463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.123320    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18f40bf6-f0e0-42be-86c8-5a032364d6ac" (UID: "18f40bf6-f0e0-42be-86c8-5a032364d6ac"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:34:54.222809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.222748    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.222809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.222796    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b485c\" (UniqueName: \"kubernetes.io/projected/18f40bf6-f0e0-42be-86c8-5a032364d6ac-kube-api-access-b485c\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.222809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.222806    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18f40bf6-f0e0-42be-86c8-5a032364d6ac-console-oauth-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.222809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.222816    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-oauth-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.222809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.222824    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.223146 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.222864    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18f40bf6-f0e0-42be-86c8-5a032364d6ac-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:34:54.806747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.806653    2581 generic.go:356] "Generic (PLEG): container finished" podID="18f40bf6-f0e0-42be-86c8-5a032364d6ac" containerID="f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac" exitCode=0
Sep 08 16:34:54.806747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.806704    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-556ff8446b-8xcjv"
Sep 08 16:34:54.807246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.806747    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556ff8446b-8xcjv" event={"ID":"18f40bf6-f0e0-42be-86c8-5a032364d6ac","Type":"ContainerDied","Data":"f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac"}
Sep 08 16:34:54.807246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.806801    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-556ff8446b-8xcjv" event={"ID":"18f40bf6-f0e0-42be-86c8-5a032364d6ac","Type":"ContainerDied","Data":"baeb13b116e909b8d2fc787cb4e036e365b5ec3f73949722c523edbe946ab671"}
Sep 08 16:34:54.807246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.806829    2581 scope.go:117] "RemoveContainer" containerID="f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac"
Sep 08 16:34:54.815350 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.815331    2581 scope.go:117] "RemoveContainer" containerID="f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac"
Sep 08 16:34:54.815701 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:34:54.815682    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac\": container with ID starting with f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac not found: ID does not exist" containerID="f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac"
Sep 08 16:34:54.815761 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.815714    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac"} err="failed to get container status \"f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac\": rpc error: code = NotFound desc = could not find container \"f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac\": container with ID starting with f501e3f89fe5f992fc7896a234f727705499555db9266917cf8716579b1a30ac not found: ID does not exist"
Sep 08 16:34:54.823412 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.823386    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-556ff8446b-8xcjv"]
Sep 08 16:34:54.829772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:54.829747    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-556ff8446b-8xcjv"]
Sep 08 16:34:56.466555 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:34:56.466519    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f40bf6-f0e0-42be-86c8-5a032364d6ac" path="/var/lib/kubelet/pods/18f40bf6-f0e0-42be-86c8-5a032364d6ac/volumes"
Sep 08 16:35:05.504277 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:05.504237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:27.994170 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:27.994133    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:29.766204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:29.766168    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:32.384423 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:32.384396    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:35:32.385213 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:32.385189    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:35:32.387374 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:32.387355    2581 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 16:35:54.971968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:54.971880    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:55.713859 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:55.713814    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:58.516912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:58.516871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:35:58.618772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:35:58.618733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:00.525100 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:00.525066    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:00.714377 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:00.714344    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:00.813567 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:00.813476    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:02.323051 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.323014    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"]
Sep 08 16:36:02.323415 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.323351    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f40bf6-f0e0-42be-86c8-5a032364d6ac" containerName="console"
Sep 08 16:36:02.323415 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.323364    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f40bf6-f0e0-42be-86c8-5a032364d6ac" containerName="console"
Sep 08 16:36:02.323484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.323431    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="18f40bf6-f0e0-42be-86c8-5a032364d6ac" containerName="console"
Sep 08 16:36:02.326413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.326392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.328967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.328940    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 16:36:02.329097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.328940    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 16:36:02.329097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.328940    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-22rjk\""
Sep 08 16:36:02.336276 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.336250    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"]
Sep 08 16:36:02.380977 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.380935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:02.406284 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.406231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm8t2\" (UniqueName: \"kubernetes.io/projected/d06998ed-fca4-4d4a-ba5d-59f235c8ba37-kube-api-access-fm8t2\") pod \"cert-manager-cainjector-559cdd8c87-nr5xv\" (UID: \"d06998ed-fca4-4d4a-ba5d-59f235c8ba37\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.406284 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.406286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d06998ed-fca4-4d4a-ba5d-59f235c8ba37-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nr5xv\" (UID: \"d06998ed-fca4-4d4a-ba5d-59f235c8ba37\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.507436 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.507393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm8t2\" (UniqueName: \"kubernetes.io/projected/d06998ed-fca4-4d4a-ba5d-59f235c8ba37-kube-api-access-fm8t2\") pod \"cert-manager-cainjector-559cdd8c87-nr5xv\" (UID: \"d06998ed-fca4-4d4a-ba5d-59f235c8ba37\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.507436 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.507439    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d06998ed-fca4-4d4a-ba5d-59f235c8ba37-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nr5xv\" (UID: \"d06998ed-fca4-4d4a-ba5d-59f235c8ba37\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.516353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.516313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d06998ed-fca4-4d4a-ba5d-59f235c8ba37-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nr5xv\" (UID: \"d06998ed-fca4-4d4a-ba5d-59f235c8ba37\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.516526 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.516399    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm8t2\" (UniqueName: \"kubernetes.io/projected/d06998ed-fca4-4d4a-ba5d-59f235c8ba37-kube-api-access-fm8t2\") pod \"cert-manager-cainjector-559cdd8c87-nr5xv\" (UID: \"d06998ed-fca4-4d4a-ba5d-59f235c8ba37\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.648642 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.648546    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"
Sep 08 16:36:02.885278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.885248    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:02.921919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.921891    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv"]
Sep 08 16:36:02.924692 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:36:02.924662    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd06998ed_fca4_4d4a_ba5d_59f235c8ba37.slice/crio-ee6f6334ae552ccd4c56279b5dff5af9ac6e165ff713e713107cac378d17385e WatchSource:0}: Error finding container ee6f6334ae552ccd4c56279b5dff5af9ac6e165ff713e713107cac378d17385e: Status 404 returned error can't find the container with id ee6f6334ae552ccd4c56279b5dff5af9ac6e165ff713e713107cac378d17385e
Sep 08 16:36:02.926828 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:02.926808    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:36:03.093772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:03.093741    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv" event={"ID":"d06998ed-fca4-4d4a-ba5d-59f235c8ba37","Type":"ContainerStarted","Data":"ee6f6334ae552ccd4c56279b5dff5af9ac6e165ff713e713107cac378d17385e"}
Sep 08 16:36:05.487417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:05.487379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:05.553365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:05.553315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:07.113669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:07.113628    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv" event={"ID":"d06998ed-fca4-4d4a-ba5d-59f235c8ba37","Type":"ContainerStarted","Data":"fc83d06b81bbaa328f665cd1f240d87a723871a9eadab605db2d29afc7652e52"}
Sep 08 16:36:07.130539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:07.130473    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nr5xv" podStartSLOduration=1.695475531 podStartE2EDuration="5.13045001s" totalImagesPullingTime="3.434974479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:07.12992074 +0000 UTC m=+335.118356695" watchObservedRunningTime="2026-09-08 16:36:07.13045001 +0000 UTC m=+335.118885986"
Sep 08 16:36:11.693587 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:11.693555    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:16.488266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:16.488232    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:16.589639 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:16.589608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:17.122149 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:17.122112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:17.221422 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:17.221394    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:21.227346 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.227308    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fl4vb"]
Sep 08 16:36:21.230742 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.230720    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.233517 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.233491    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-nvtzg\""
Sep 08 16:36:21.242176 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.242152    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fl4vb"]
Sep 08 16:36:21.268204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.268163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9klwz\" (UniqueName: \"kubernetes.io/projected/61a08864-9f5f-47d9-b694-ac2dae867b8a-kube-api-access-9klwz\") pod \"cert-manager-55b4d954d5-fl4vb\" (UID: \"61a08864-9f5f-47d9-b694-ac2dae867b8a\") " pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.268204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.268205    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61a08864-9f5f-47d9-b694-ac2dae867b8a-bound-sa-token\") pod \"cert-manager-55b4d954d5-fl4vb\" (UID: \"61a08864-9f5f-47d9-b694-ac2dae867b8a\") " pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.368707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.368671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9klwz\" (UniqueName: \"kubernetes.io/projected/61a08864-9f5f-47d9-b694-ac2dae867b8a-kube-api-access-9klwz\") pod \"cert-manager-55b4d954d5-fl4vb\" (UID: \"61a08864-9f5f-47d9-b694-ac2dae867b8a\") " pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.368707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.368707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61a08864-9f5f-47d9-b694-ac2dae867b8a-bound-sa-token\") pod \"cert-manager-55b4d954d5-fl4vb\" (UID: \"61a08864-9f5f-47d9-b694-ac2dae867b8a\") " pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.377321 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.377293    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61a08864-9f5f-47d9-b694-ac2dae867b8a-bound-sa-token\") pod \"cert-manager-55b4d954d5-fl4vb\" (UID: \"61a08864-9f5f-47d9-b694-ac2dae867b8a\") " pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.377476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.377454    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9klwz\" (UniqueName: \"kubernetes.io/projected/61a08864-9f5f-47d9-b694-ac2dae867b8a-kube-api-access-9klwz\") pod \"cert-manager-55b4d954d5-fl4vb\" (UID: \"61a08864-9f5f-47d9-b694-ac2dae867b8a\") " pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.539871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.539748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-fl4vb"
Sep 08 16:36:21.813498 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:21.813465    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-fl4vb"]
Sep 08 16:36:21.816425 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:36:21.816387    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61a08864_9f5f_47d9_b694_ac2dae867b8a.slice/crio-62d0aa7ee354f499369ca9c307f7e8c8f9a2ef12e27d8d5e5f61ccf48bad17fa WatchSource:0}: Error finding container 62d0aa7ee354f499369ca9c307f7e8c8f9a2ef12e27d8d5e5f61ccf48bad17fa: Status 404 returned error can't find the container with id 62d0aa7ee354f499369ca9c307f7e8c8f9a2ef12e27d8d5e5f61ccf48bad17fa
Sep 08 16:36:22.175477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:22.175372    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fl4vb" event={"ID":"61a08864-9f5f-47d9-b694-ac2dae867b8a","Type":"ContainerStarted","Data":"5996b74f130b68a2d60a118c4eaf6ee1a4e59da30d47527c6c7d647de2dba614"}
Sep 08 16:36:22.175477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:22.175423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-fl4vb" event={"ID":"61a08864-9f5f-47d9-b694-ac2dae867b8a","Type":"ContainerStarted","Data":"62d0aa7ee354f499369ca9c307f7e8c8f9a2ef12e27d8d5e5f61ccf48bad17fa"}
Sep 08 16:36:22.193537 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:22.193481    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-fl4vb" podStartSLOduration=1.193462039 podStartE2EDuration="1.193462039s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:22.192229095 +0000 UTC m=+350.180665050" watchObservedRunningTime="2026-09-08 16:36:22.193462039 +0000 UTC m=+350.181897993"
Sep 08 16:36:24.174571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:24.174495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:24.274738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:24.274685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:26.398622 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:26.398584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:32.790424 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:32.790389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:33.991468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:33.991427    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-554d8c779-fmjmz"]
Sep 08 16:36:33.994850 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:33.994817    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.005773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.005734    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554d8c779-fmjmz"]
Sep 08 16:36:34.075523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.075491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:34.082084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082052    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faebcedf-5434-4a0b-8544-c5c33aae146f-console-serving-cert\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.082160 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082112    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-oauth-serving-cert\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.082195 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082160    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faebcedf-5434-4a0b-8544-c5c33aae146f-console-oauth-config\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.082253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082240    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-trusted-ca-bundle\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.082292 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082272    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-console-config\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.082331 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9cbg\" (UniqueName: \"kubernetes.io/projected/faebcedf-5434-4a0b-8544-c5c33aae146f-kube-api-access-f9cbg\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.082364 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.082328    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-service-ca\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.138981 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.138947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:34.183707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183671    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-trusted-ca-bundle\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.183914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183719    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-console-config\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.183914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9cbg\" (UniqueName: \"kubernetes.io/projected/faebcedf-5434-4a0b-8544-c5c33aae146f-kube-api-access-f9cbg\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.183914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183780    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-service-ca\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.183914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183825    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faebcedf-5434-4a0b-8544-c5c33aae146f-console-serving-cert\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.184083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183932    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-oauth-serving-cert\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.184083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.183959    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faebcedf-5434-4a0b-8544-c5c33aae146f-console-oauth-config\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.184661 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.184638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-trusted-ca-bundle\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.184820 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.184790    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-console-config\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.184917 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.184861    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-oauth-serving-cert\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.184917 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.184890    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/faebcedf-5434-4a0b-8544-c5c33aae146f-service-ca\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.186539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.186515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/faebcedf-5434-4a0b-8544-c5c33aae146f-console-serving-cert\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.186697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.186678    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/faebcedf-5434-4a0b-8544-c5c33aae146f-console-oauth-config\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.191999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.191979    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9cbg\" (UniqueName: \"kubernetes.io/projected/faebcedf-5434-4a0b-8544-c5c33aae146f-kube-api-access-f9cbg\") pod \"console-554d8c779-fmjmz\" (UID: \"faebcedf-5434-4a0b-8544-c5c33aae146f\") " pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.195104 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.195077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:34.305165 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.305069    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:34.578216 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.578189    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554d8c779-fmjmz"]
Sep 08 16:36:34.580504 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:36:34.580467    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaebcedf_5434_4a0b_8544_c5c33aae146f.slice/crio-fcd79be89f5d62771acd09235e2d3ad185f5578ee6c482f16dae9a12be56cf4b WatchSource:0}: Error finding container fcd79be89f5d62771acd09235e2d3ad185f5578ee6c482f16dae9a12be56cf4b: Status 404 returned error can't find the container with id fcd79be89f5d62771acd09235e2d3ad185f5578ee6c482f16dae9a12be56cf4b
Sep 08 16:36:34.786307 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:34.786276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:35.230792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:35.230758    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554d8c779-fmjmz" event={"ID":"faebcedf-5434-4a0b-8544-c5c33aae146f","Type":"ContainerStarted","Data":"85c3a72312eb48d7385ccdc46948572ca1668f2126a50dbad240fa94b5577929"}
Sep 08 16:36:35.231243 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:35.230804    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554d8c779-fmjmz" event={"ID":"faebcedf-5434-4a0b-8544-c5c33aae146f","Type":"ContainerStarted","Data":"fcd79be89f5d62771acd09235e2d3ad185f5578ee6c482f16dae9a12be56cf4b"}
Sep 08 16:36:35.248942 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:35.248888    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-554d8c779-fmjmz" podStartSLOduration=2.248869988 podStartE2EDuration="2.248869988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:35.247906144 +0000 UTC m=+363.236342099" watchObservedRunningTime="2026-09-08 16:36:35.248869988 +0000 UTC m=+363.237305941"
Sep 08 16:36:37.979229 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:37.979189    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:38.079523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.079487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:38.432773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.432740    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:38.638919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.638878    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:38.744226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.744140    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:38.806028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.805998    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"]
Sep 08 16:36:38.809771 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.809752    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:38.822545 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.822512    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 16:36:38.822545 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.822546    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dmjj6\""
Sep 08 16:36:38.822760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.822560    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 16:36:38.822828 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.822814    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 16:36:38.822969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.822950    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 16:36:38.837012 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.836975    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"]
Sep 08 16:36:38.928505 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.928464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-manifests\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:38.928505 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.928503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:38.928736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.928582    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g47cw\" (UniqueName: \"kubernetes.io/projected/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-kube-api-access-g47cw\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:38.928736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.928624    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-tmp\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:38.928736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.928645    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:38.970694 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:38.970651    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:39.029790 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.029707    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.029790 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.029771    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-manifests\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.029790 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.029789    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.030308 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.029829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g47cw\" (UniqueName: \"kubernetes.io/projected/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-kube-api-access-g47cw\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.030308 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.029907    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-tmp\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.030308 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.030198    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-manifests\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.032740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.032701    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-webhook-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.032913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.032762    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-tmp\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.033018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.033001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.042124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.042090    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g47cw\" (UniqueName: \"kubernetes.io/projected/324a88f2-c4b3-44bc-9a4d-dda628cf4e7e-kube-api-access-g47cw\") pod \"opendatahub-operator-controller-manager-86d7bb586f-qfxwb\" (UID: \"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e\") " pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.071087 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.071049    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:39.120603 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.120555    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:39.188621 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.188579    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:39.302649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.302569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:39.377785 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.377753    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:39.423733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:39.423705    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"]
Sep 08 16:36:39.426487 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:36:39.426462    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod324a88f2_c4b3_44bc_9a4d_dda628cf4e7e.slice/crio-58ad638cbb4d3ca3c40940e85b11f8324628b1932c7f2ba1b991453197cfc8bf WatchSource:0}: Error finding container 58ad638cbb4d3ca3c40940e85b11f8324628b1932c7f2ba1b991453197cfc8bf: Status 404 returned error can't find the container with id 58ad638cbb4d3ca3c40940e85b11f8324628b1932c7f2ba1b991453197cfc8bf
Sep 08 16:36:40.258146 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:40.258105    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb" event={"ID":"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e","Type":"ContainerStarted","Data":"58ad638cbb4d3ca3c40940e85b11f8324628b1932c7f2ba1b991453197cfc8bf"}
Sep 08 16:36:43.275632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:43.275592    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb" event={"ID":"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e","Type":"ContainerStarted","Data":"b772543fc91d32d5ef3648ebbe23349d791c185741c19fad3a73278bf42f1847"}
Sep 08 16:36:44.282211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.282170    2581 generic.go:356] "Generic (PLEG): container finished" podID="324a88f2-c4b3-44bc-9a4d-dda628cf4e7e" containerID="b772543fc91d32d5ef3648ebbe23349d791c185741c19fad3a73278bf42f1847" exitCode=0
Sep 08 16:36:44.282605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.282262    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb" event={"ID":"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e","Type":"ContainerDied","Data":"b772543fc91d32d5ef3648ebbe23349d791c185741c19fad3a73278bf42f1847"}
Sep 08 16:36:44.305895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.305858    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:44.306079 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.305919    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:44.310734 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.310704    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:44.632274 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.632187    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:44.741535 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:44.741500    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:45.289614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.289574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb" event={"ID":"324a88f2-c4b3-44bc-9a4d-dda628cf4e7e","Type":"ContainerStarted","Data":"a4595b366b223c38c5080fcdf3eefc30e2797122733b3826bf64841576c36475"}
Sep 08 16:36:45.290109 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.289736    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:45.293606 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.293584    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554d8c779-fmjmz"
Sep 08 16:36:45.324718 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.324662    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb" podStartSLOduration=2.478984007 podStartE2EDuration="7.324643556s" totalImagesPullingTime="3.810543073s" totalInitContainerRuntime="1.035116476s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:36:45.321744041 +0000 UTC m=+373.310180023" watchObservedRunningTime="2026-09-08 16:36:45.324643556 +0000 UTC m=+373.313079509"
Sep 08 16:36:45.393977 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.393943    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8778f784-w4xjh"]
Sep 08 16:36:45.500995 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.500958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:45.601680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:45.601605    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:56.297229 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:56.297194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-86d7bb586f-qfxwb"
Sep 08 16:36:58.032638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:58.032607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:58.186013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:58.185977    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:58.464827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:58.464788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:58.633646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:58.633613    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:36:59.126368 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.126333    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"]
Sep 08 16:36:59.129986 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.129963    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.133914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.133883    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 16:36:59.134077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.133881    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 16:36:59.134077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.133879    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 16:36:59.134077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.133892    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-qnpp5\""
Sep 08 16:36:59.134077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.133894    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 16:36:59.134077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.134064    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 16:36:59.139940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.139917    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"]
Sep 08 16:36:59.220220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.220175    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ea41980-826b-4c23-9f76-53735cc48b2d-metrics-cert\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.220220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.220222    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd4jk\" (UniqueName: \"kubernetes.io/projected/3ea41980-826b-4c23-9f76-53735cc48b2d-kube-api-access-fd4jk\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.220438 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.220316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ea41980-826b-4c23-9f76-53735cc48b2d-manager-config\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.220438 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.220408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ea41980-826b-4c23-9f76-53735cc48b2d-cert\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.321084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.321045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ea41980-826b-4c23-9f76-53735cc48b2d-manager-config\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.321279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.321124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ea41980-826b-4c23-9f76-53735cc48b2d-cert\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.321279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.321161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ea41980-826b-4c23-9f76-53735cc48b2d-metrics-cert\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.321279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.321183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd4jk\" (UniqueName: \"kubernetes.io/projected/3ea41980-826b-4c23-9f76-53735cc48b2d-kube-api-access-fd4jk\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.321741 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.321713    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3ea41980-826b-4c23-9f76-53735cc48b2d-manager-config\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.324071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.324039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ea41980-826b-4c23-9f76-53735cc48b2d-metrics-cert\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.324192 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.324039    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3ea41980-826b-4c23-9f76-53735cc48b2d-cert\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.332781 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.332749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd4jk\" (UniqueName: \"kubernetes.io/projected/3ea41980-826b-4c23-9f76-53735cc48b2d-kube-api-access-fd4jk\") pod \"lws-controller-manager-76d8558585-ppg4n\" (UID: \"3ea41980-826b-4c23-9f76-53735cc48b2d\") " pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.440077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.440036    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:36:59.716107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.716069    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"]
Sep 08 16:36:59.718596 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:36:59.718569    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea41980_826b_4c23_9f76_53735cc48b2d.slice/crio-4d0e7b78341951fdf30e35efabfbff6461f3c1019a493970362230c5a42d6328 WatchSource:0}: Error finding container 4d0e7b78341951fdf30e35efabfbff6461f3c1019a493970362230c5a42d6328: Status 404 returned error can't find the container with id 4d0e7b78341951fdf30e35efabfbff6461f3c1019a493970362230c5a42d6328
Sep 08 16:36:59.970960 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:36:59.970871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:00.048262 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:00.048225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:00.356894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:00.356783    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n" event={"ID":"3ea41980-826b-4c23-9f76-53735cc48b2d","Type":"ContainerStarted","Data":"4d0e7b78341951fdf30e35efabfbff6461f3c1019a493970362230c5a42d6328"}
Sep 08 16:37:01.053048 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:01.053003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:03.373165 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:03.373126    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n" event={"ID":"3ea41980-826b-4c23-9f76-53735cc48b2d","Type":"ContainerStarted","Data":"00830d9c98873db524c6a47b2c9a56e15e71aaf0fa32e4b41fb1287491512fd3"}
Sep 08 16:37:03.373533 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:03.373270    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:37:03.390598 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:03.390534    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n" podStartSLOduration=1.708644498 podStartE2EDuration="4.39051625s" totalImagesPullingTime="2.681871752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:03.388232716 +0000 UTC m=+391.376668670" watchObservedRunningTime="2026-09-08 16:37:03.39051625 +0000 UTC m=+391.378952204"
Sep 08 16:37:04.423940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:04.423899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:04.519653 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:04.519596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:05.025987 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.025957    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"]
Sep 08 16:37:05.029630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.029606    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.032308 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.032284    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 16:37:05.032496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.032412    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 16:37:05.032579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.032538    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-n7h8q\""
Sep 08 16:37:05.032666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.032644    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 16:37:05.044612 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.044586    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"]
Sep 08 16:37:05.057105 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.057081    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:05.075742 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.075712    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.075929 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.075751    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4qc8\" (UniqueName: \"kubernetes.io/projected/818bb221-c71b-4e7f-a054-3dc1ccadde14-kube-api-access-l4qc8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.075929 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.075777    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.076010 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.075929    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.076010 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.075950    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.076010 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.075967    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.076117 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.076021    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.076117 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.076042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.076117 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.076056    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818bb221-c71b-4e7f-a054-3dc1ccadde14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177337    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177384    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4qc8\" (UniqueName: \"kubernetes.io/projected/818bb221-c71b-4e7f-a054-3dc1ccadde14-kube-api-access-l4qc8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177519    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177544    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.177643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177566    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818bb221-c71b-4e7f-a054-3dc1ccadde14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.178042 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.177937    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.178042 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.178015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.178123 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.178051    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.178123 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.178078    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.178324 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.178301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/818bb221-c71b-4e7f-a054-3dc1ccadde14-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.180158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.180119    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.180288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.180241    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.192335 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.192301    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/818bb221-c71b-4e7f-a054-3dc1ccadde14-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.192520 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.192438    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4qc8\" (UniqueName: \"kubernetes.io/projected/818bb221-c71b-4e7f-a054-3dc1ccadde14-kube-api-access-l4qc8\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs\" (UID: \"818bb221-c71b-4e7f-a054-3dc1ccadde14\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.217617 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.217581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:05.316145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.316058    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:05.340651 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.340619    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:05.620878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:05.620796    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"]
Sep 08 16:37:05.623157 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:37:05.623132    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818bb221_c71b_4e7f_a054_3dc1ccadde14.slice/crio-b03471089b432da494736d749ee024f2a24c1a2cf391e8ca93b07e11ad61ddd9 WatchSource:0}: Error finding container b03471089b432da494736d749ee024f2a24c1a2cf391e8ca93b07e11ad61ddd9: Status 404 returned error can't find the container with id b03471089b432da494736d749ee024f2a24c1a2cf391e8ca93b07e11ad61ddd9
Sep 08 16:37:06.390126 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:06.390080    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs" event={"ID":"818bb221-c71b-4e7f-a054-3dc1ccadde14","Type":"ContainerStarted","Data":"b03471089b432da494736d749ee024f2a24c1a2cf391e8ca93b07e11ad61ddd9"}
Sep 08 16:37:08.362473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:08.362420    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:37:08.362763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:08.362516    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:37:08.362763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:08.362557    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:37:09.050539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.050498    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xwmjl"]
Sep 08 16:37:09.054071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.054042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.056491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.056460    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 16:37:09.056633 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.056519    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-nk9zx\""
Sep 08 16:37:09.063940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.063909    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xwmjl"]
Sep 08 16:37:09.085339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.085303    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:09.116443 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.116409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xm2\" (UniqueName: \"kubernetes.io/projected/2b919858-2349-4df2-aef9-fa22ddcef0ad-kube-api-access-b8xm2\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.116647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.116481    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b919858-2349-4df2-aef9-fa22ddcef0ad-cert\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.145042 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.145005    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:09.217802 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.217763    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b919858-2349-4df2-aef9-fa22ddcef0ad-cert\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.218017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.217906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xm2\" (UniqueName: \"kubernetes.io/projected/2b919858-2349-4df2-aef9-fa22ddcef0ad-kube-api-access-b8xm2\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.218017 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:37:09.217944    2581 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 16:37:09.218017 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:37:09.218009    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2b919858-2349-4df2-aef9-fa22ddcef0ad-cert podName:2b919858-2349-4df2-aef9-fa22ddcef0ad nodeName:}" failed. No retries permitted until 2026-09-08 16:37:09.717992894 +0000 UTC m=+397.706428827 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2b919858-2349-4df2-aef9-fa22ddcef0ad-cert") pod "odh-model-controller-7998c67dc4-xwmjl" (UID: "2b919858-2349-4df2-aef9-fa22ddcef0ad") : secret "odh-model-controller-webhook-cert" not found
Sep 08 16:37:09.226460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.226424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xm2\" (UniqueName: \"kubernetes.io/projected/2b919858-2349-4df2-aef9-fa22ddcef0ad-kube-api-access-b8xm2\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.245286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.245254    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:09.407892 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.407770    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs" event={"ID":"818bb221-c71b-4e7f-a054-3dc1ccadde14","Type":"ContainerStarted","Data":"ad3e8802df2edf8251cb8a2793e0af28e95bfd60d861be29ea649ad97ad6bea0"}
Sep 08 16:37:09.428394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.428328    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs" podStartSLOduration=1.6914633860000001 podStartE2EDuration="4.42830836s" totalImagesPullingTime="2.736844974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:09.427232602 +0000 UTC m=+397.415668560" watchObservedRunningTime="2026-09-08 16:37:09.42830836 +0000 UTC m=+397.416744314"
Sep 08 16:37:09.448573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.448540    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:09.644381 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.644346    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8mkwr"]
Sep 08 16:37:09.648156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.648138    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:09.650399 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.650378    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 08 16:37:09.657428 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.657400    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8mkwr"]
Sep 08 16:37:09.658494 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.658436    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:09.723445 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.723409    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-tls-certs\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:09.723624 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.723490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b919858-2349-4df2-aef9-fa22ddcef0ad-cert\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.723624 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.723514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgpbk\" (UniqueName: \"kubernetes.io/projected/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-kube-api-access-lgpbk\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:09.726189 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.726161    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2b919858-2349-4df2-aef9-fa22ddcef0ad-cert\") pod \"odh-model-controller-7998c67dc4-xwmjl\" (UID: \"2b919858-2349-4df2-aef9-fa22ddcef0ad\") " pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.824208 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.824166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-tls-certs\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:09.824411 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.824252    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgpbk\" (UniqueName: \"kubernetes.io/projected/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-kube-api-access-lgpbk\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:09.824411 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:37:09.824343    2581 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Sep 08 16:37:09.824544 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:37:09.824441    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-tls-certs podName:5c83bcd3-82b8-4e5e-ade4-6ecbee495210 nodeName:}" failed. No retries permitted until 2026-09-08 16:37:10.324417961 +0000 UTC m=+398.312853894 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-tls-certs") pod "model-serving-api-54d89bd5fc-8mkwr" (UID: "5c83bcd3-82b8-4e5e-ade4-6ecbee495210") : secret "model-serving-api-tls" not found
Sep 08 16:37:09.832518 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.832488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgpbk\" (UniqueName: \"kubernetes.io/projected/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-kube-api-access-lgpbk\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:09.966983 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.966947    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:09.984890 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:09.984862    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:10.236278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.236253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-xwmjl"]
Sep 08 16:37:10.238393 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:37:10.238363    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b919858_2349_4df2_aef9_fa22ddcef0ad.slice/crio-3ba9bf6f09d1c88e1786df1c0a18f118c907133ec7ba5cdb5624b29b2f2e493d WatchSource:0}: Error finding container 3ba9bf6f09d1c88e1786df1c0a18f118c907133ec7ba5cdb5624b29b2f2e493d: Status 404 returned error can't find the container with id 3ba9bf6f09d1c88e1786df1c0a18f118c907133ec7ba5cdb5624b29b2f2e493d
Sep 08 16:37:10.329619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.329569    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-tls-certs\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:10.332567 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.332537    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5c83bcd3-82b8-4e5e-ade4-6ecbee495210-tls-certs\") pod \"model-serving-api-54d89bd5fc-8mkwr\" (UID: \"5c83bcd3-82b8-4e5e-ade4-6ecbee495210\") " pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:10.341608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.341572    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:10.347486 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.347460    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:10.414668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.414627    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl" event={"ID":"2b919858-2349-4df2-aef9-fa22ddcef0ad","Type":"ContainerStarted","Data":"3ba9bf6f09d1c88e1786df1c0a18f118c907133ec7ba5cdb5624b29b2f2e493d"}
Sep 08 16:37:10.415152 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.415073    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:10.416108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.416083    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs"
Sep 08 16:37:10.418623 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.418585    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8778f784-w4xjh" podUID="eab27ff1-1ed6-4eb4-a104-d060617a63fe" containerName="console" containerID="cri-o://2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81" gracePeriod=15
Sep 08 16:37:10.559668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.559627    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:10.665899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.665872    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733402    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-oauth-serving-cert\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733448    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-config\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733549    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-service-ca\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733600    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-oauth-config\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733642    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-trusted-ca-bundle\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733671    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2m2rx\" (UniqueName: \"kubernetes.io/projected/eab27ff1-1ed6-4eb4-a104-d060617a63fe-kube-api-access-2m2rx\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.733762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733705    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-serving-cert\") pod \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\" (UID: \"eab27ff1-1ed6-4eb4-a104-d060617a63fe\") "
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733763    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733812    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-config" (OuterVolumeSpecName: "console-config") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.733911    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-service-ca" (OuterVolumeSpecName: "service-ca") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.734101    2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-oauth-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.734117    2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.734130    2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.734250 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.734188    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:37:10.736728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.736695    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:37:10.736728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.736701    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab27ff1-1ed6-4eb4-a104-d060617a63fe-kube-api-access-2m2rx" (OuterVolumeSpecName: "kube-api-access-2m2rx") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "kube-api-access-2m2rx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:37:10.736728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.736717    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "eab27ff1-1ed6-4eb4-a104-d060617a63fe" (UID: "eab27ff1-1ed6-4eb4-a104-d060617a63fe"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:37:10.835271 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.835175    2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-oauth-config\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.835271 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.835204    2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eab27ff1-1ed6-4eb4-a104-d060617a63fe-trusted-ca-bundle\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.835271 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.835213    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2m2rx\" (UniqueName: \"kubernetes.io/projected/eab27ff1-1ed6-4eb4-a104-d060617a63fe-kube-api-access-2m2rx\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.835271 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.835222    2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/eab27ff1-1ed6-4eb4-a104-d060617a63fe-console-serving-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:37:10.836066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:10.836044    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-8mkwr"]
Sep 08 16:37:10.838579 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:37:10.838547    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c83bcd3_82b8_4e5e_ade4_6ecbee495210.slice/crio-a700f26bd6f0fc812a3acc18e672785ef6ad5f4301770315388e38a85665725a WatchSource:0}: Error finding container a700f26bd6f0fc812a3acc18e672785ef6ad5f4301770315388e38a85665725a: Status 404 returned error can't find the container with id a700f26bd6f0fc812a3acc18e672785ef6ad5f4301770315388e38a85665725a
Sep 08 16:37:11.420923 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.420885    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr" event={"ID":"5c83bcd3-82b8-4e5e-ade4-6ecbee495210","Type":"ContainerStarted","Data":"a700f26bd6f0fc812a3acc18e672785ef6ad5f4301770315388e38a85665725a"}
Sep 08 16:37:11.422223 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.422196    2581 generic.go:356] "Generic (PLEG): container finished" podID="eab27ff1-1ed6-4eb4-a104-d060617a63fe" containerID="2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81" exitCode=0
Sep 08 16:37:11.422361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.422247    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8778f784-w4xjh"
Sep 08 16:37:11.422361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.422281    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8778f784-w4xjh" event={"ID":"eab27ff1-1ed6-4eb4-a104-d060617a63fe","Type":"ContainerDied","Data":"2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81"}
Sep 08 16:37:11.422361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.422325    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8778f784-w4xjh" event={"ID":"eab27ff1-1ed6-4eb4-a104-d060617a63fe","Type":"ContainerDied","Data":"0ec2b801b591f12d91bd814b3b0820291657eed23c7c978b2f398d43d7d62a88"}
Sep 08 16:37:11.422361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.422344    2581 scope.go:117] "RemoveContainer" containerID="2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81"
Sep 08 16:37:11.431998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.431975    2581 scope.go:117] "RemoveContainer" containerID="2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81"
Sep 08 16:37:11.432438 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:37:11.432413    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81\": container with ID starting with 2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81 not found: ID does not exist" containerID="2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81"
Sep 08 16:37:11.432545 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.432447    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81"} err="failed to get container status \"2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81\": rpc error: code = NotFound desc = could not find container \"2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81\": container with ID starting with 2fddc24acf5a928d1d8003b789a51ec2e5d04673caeca2935fbbf422c5c58a81 not found: ID does not exist"
Sep 08 16:37:11.443626 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.443587    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8778f784-w4xjh"]
Sep 08 16:37:11.447315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:11.447287    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8778f784-w4xjh"]
Sep 08 16:37:12.174288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:12.174221    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:12.242154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:12.242116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:12.469084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:12.469049    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab27ff1-1ed6-4eb4-a104-d060617a63fe" path="/var/lib/kubelet/pods/eab27ff1-1ed6-4eb4-a104-d060617a63fe/volumes"
Sep 08 16:37:14.111149 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.111115    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:14.380894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.380792    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-76d8558585-ppg4n"
Sep 08 16:37:14.445323 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.445283    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl" event={"ID":"2b919858-2349-4df2-aef9-fa22ddcef0ad","Type":"ContainerStarted","Data":"fac036a052faa763f24ec1f27ffda2d612ab5eedb69b58939ecd80f2874aeeec"}
Sep 08 16:37:14.445532 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.445402    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:14.447097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.447072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr" event={"ID":"5c83bcd3-82b8-4e5e-ade4-6ecbee495210","Type":"ContainerStarted","Data":"35509c3c4eb1bd0c1d4954425ef724a71c07b7871d16acc42c7d2d5089e37310"}
Sep 08 16:37:14.447220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.447162    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:14.482526 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.482459    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl" podStartSLOduration=1.490270708 podStartE2EDuration="5.482435145s" totalImagesPullingTime="3.992164437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:14.481557775 +0000 UTC m=+402.469993734" watchObservedRunningTime="2026-09-08 16:37:14.482435145 +0000 UTC m=+402.470871104"
Sep 08 16:37:14.520940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:14.520871    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr" podStartSLOduration=2.134061512 podStartE2EDuration="5.520805617s" totalImagesPullingTime="3.386744105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:14.520482571 +0000 UTC m=+402.508918526" watchObservedRunningTime="2026-09-08 16:37:14.520805617 +0000 UTC m=+402.509241582"
Sep 08 16:37:15.799695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.799651    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"]
Sep 08 16:37:15.800228 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.800212    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab27ff1-1ed6-4eb4-a104-d060617a63fe" containerName="console"
Sep 08 16:37:15.800278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.800230    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab27ff1-1ed6-4eb4-a104-d060617a63fe" containerName="console"
Sep 08 16:37:15.800312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.800295    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab27ff1-1ed6-4eb4-a104-d060617a63fe" containerName="console"
Sep 08 16:37:15.803556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.803537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.807743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.807713    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 16:37:15.807899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.807752    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xgf4w\""
Sep 08 16:37:15.807899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.807797    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 16:37:15.808018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.807974    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 16:37:15.817860 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.817812    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"]
Sep 08 16:37:15.884228 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884191    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.884408 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.884408 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884354    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qlbt\" (UniqueName: \"kubernetes.io/projected/b14f374c-fbc3-4890-b4c6-6e80a76947ba-kube-api-access-6qlbt\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.884408 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884399    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.884540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884415    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.884540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884437    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.884540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.884499    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14f374c-fbc3-4890-b4c6-6e80a76947ba-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985046 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985007    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14f374c-fbc3-4890-b4c6-6e80a76947ba-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985243 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985314 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985248    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985377 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qlbt\" (UniqueName: \"kubernetes.io/projected/b14f374c-fbc3-4890-b4c6-6e80a76947ba-kube-api-access-6qlbt\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985393    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985422    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.985540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.985447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.986121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.986098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.987694 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.987673    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.987818 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.987759    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.988122 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.988097    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b14f374c-fbc3-4890-b4c6-6e80a76947ba-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.988186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.988160    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.993463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.993440    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b14f374c-fbc3-4890-b4c6-6e80a76947ba-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:15.993716 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:15.993698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qlbt\" (UniqueName: \"kubernetes.io/projected/b14f374c-fbc3-4890-b4c6-6e80a76947ba-kube-api-access-6qlbt\") pod \"istiod-openshift-gateway-5677ccb49b-fngj4\" (UID: \"b14f374c-fbc3-4890-b4c6-6e80a76947ba\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:16.112748 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:16.112660    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:16.393417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:16.393331    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"]
Sep 08 16:37:16.396565 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:37:16.396527    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb14f374c_fbc3_4890_b4c6_6e80a76947ba.slice/crio-aedb9ec5b5064631bdc27d53ea94f70e84606fba50d8549e4fece8f1ee9714a9 WatchSource:0}: Error finding container aedb9ec5b5064631bdc27d53ea94f70e84606fba50d8549e4fece8f1ee9714a9: Status 404 returned error can't find the container with id aedb9ec5b5064631bdc27d53ea94f70e84606fba50d8549e4fece8f1ee9714a9
Sep 08 16:37:16.466384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:16.466345    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4" event={"ID":"b14f374c-fbc3-4890-b4c6-6e80a76947ba","Type":"ContainerStarted","Data":"aedb9ec5b5064631bdc27d53ea94f70e84606fba50d8549e4fece8f1ee9714a9"}
Sep 08 16:37:18.622581 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:18.622536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:18.715916 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:18.715887    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:18.776548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:18.776515    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:37:18.776617 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:18.776609    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:37:18.844772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:18.844745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:19.038217 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:19.038185    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:19.133297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:19.133245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:19.485266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:19.485226    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4" event={"ID":"b14f374c-fbc3-4890-b4c6-6e80a76947ba","Type":"ContainerStarted","Data":"ac38a4219cf09130a067b7c92df7a957a29ca0c158db4c3b27b5d8eb59282fc2"}
Sep 08 16:37:19.487511 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:19.486479    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:19.488579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:19.488555    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4"
Sep 08 16:37:19.508058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:19.508004    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-fngj4" podStartSLOduration=2.130887707 podStartE2EDuration="4.507986672s" totalImagesPullingTime="2.377098965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:37:19.506548169 +0000 UTC m=+407.494984158" watchObservedRunningTime="2026-09-08 16:37:19.507986672 +0000 UTC m=+407.496422639"
Sep 08 16:37:25.456925 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:25.456888    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-xwmjl"
Sep 08 16:37:25.459009 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:25.458984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-8mkwr"
Sep 08 16:37:32.816501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:32.816453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:47.458004 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:47.457966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:37:47.521746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:37:47.521707    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:10.074703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:10.074570    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:10.168245 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:10.168209    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:25.741752 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:25.741708    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:25.842312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:25.842272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:25.979355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:25.979322    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:28.764396 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:28.764359    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:30.448435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:30.448385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:30.565084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:30.565051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:31.152506 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:31.152471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:31.569201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:31.569170    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:31.867959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:31.867825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:32.633232 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:32.633169    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:34.772971 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:34.772935    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:35.166455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:35.166347    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:36.611155 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:36.611100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:38.578377 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:38.578345    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:38.670227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:38.670193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:42.162659 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:42.162621    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:42.245152 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:42.245113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:42.310806 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:42.310773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:44.580503 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:44.580470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:44.666446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:44.666416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:46.161690 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:46.161656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:46.261369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:46.261332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:46.318807 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:46.318759    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:55.027608 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:55.027571    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:55.199099 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:55.199065    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:57.654169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:57.654122    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:38:57.754677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:38:57.754604    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:00.789640 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:00.789607    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:00.892953 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:00.892916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:05.201269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:05.201222    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:05.301356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:05.301317    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:05.423070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:05.423033    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:05.533169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:05.533061    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:06.411343 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:06.411307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:06.509775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:06.509737    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:14.556186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:14.556147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:14.615240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:14.615199    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:15.163303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:15.163268    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:15.264810 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:15.264781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:18.192652 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:18.192615    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:18.293656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:18.293625    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:19.889899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:19.889865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:25.710185 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.710144    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"]
Sep 08 16:39:25.713740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.713713    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.716211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.716183    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5vrfc\""
Sep 08 16:39:25.726018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.725984    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"]
Sep 08 16:39:25.738625 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.738588    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:25.833082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833084    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833102    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833274    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833303    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ppfk\" (UniqueName: \"kubernetes.io/projected/7da861c5-9489-4ca8-9863-c616d748d2b6-kube-api-access-8ppfk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833609 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da861c5-9489-4ca8-9863-c616d748d2b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.833609 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.833393    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934052 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934052 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934050    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934255    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934290    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934319    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ppfk\" (UniqueName: \"kubernetes.io/projected/7da861c5-9489-4ca8-9863-c616d748d2b6-kube-api-access-8ppfk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da861c5-9489-4ca8-9863-c616d748d2b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934423    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.934944 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934923    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.935047 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.934931    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.935047 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.935004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.935278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.935260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7da861c5-9489-4ca8-9863-c616d748d2b6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.936596 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.936575    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.937350 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.937332    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.942680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.942633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7da861c5-9489-4ca8-9863-c616d748d2b6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.943461 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.943436    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ppfk\" (UniqueName: \"kubernetes.io/projected/7da861c5-9489-4ca8-9863-c616d748d2b6-kube-api-access-8ppfk\") pod \"maas-default-gateway-openshift-default-78bb78ff78-fw42b\" (UID: \"7da861c5-9489-4ca8-9863-c616d748d2b6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:25.960657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:25.960566    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:26.025453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:26.025404    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:26.317982 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:26.315207    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"]
Sep 08 16:39:26.321946 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:39:26.321915    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da861c5_9489_4ca8_9863_c616d748d2b6.slice/crio-566468e51418af20159e5f3781c7dc331c17e3b7994c00860f194f46df152373 WatchSource:0}: Error finding container 566468e51418af20159e5f3781c7dc331c17e3b7994c00860f194f46df152373: Status 404 returned error can't find the container with id 566468e51418af20159e5f3781c7dc331c17e3b7994c00860f194f46df152373
Sep 08 16:39:26.324190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:26.324154    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:39:26.324272 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:26.324226    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:39:26.324272 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:26.324256    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:39:27.123631 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:27.123589    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" event={"ID":"7da861c5-9489-4ca8-9863-c616d748d2b6","Type":"ContainerStarted","Data":"511b1f147266335cde37430bd7fcc220c49f8ca56c1e018ddf9f517f47277267"}
Sep 08 16:39:27.124058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:27.123658    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" event={"ID":"7da861c5-9489-4ca8-9863-c616d748d2b6","Type":"ContainerStarted","Data":"566468e51418af20159e5f3781c7dc331c17e3b7994c00860f194f46df152373"}
Sep 08 16:39:27.144572 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:27.144504    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" podStartSLOduration=2.144483555 podStartE2EDuration="2.144483555s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:39:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:39:27.14224903 +0000 UTC m=+535.130684985" watchObservedRunningTime="2026-09-08 16:39:27.144483555 +0000 UTC m=+535.132919509"
Sep 08 16:39:28.025623 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:28.025579    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:28.030685 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:28.030654    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:28.128278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:28.128242    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:28.129273 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:28.129254    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:39:29.385923 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:29.385879    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:40.323171 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:40.323101    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:40.425763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:40.425726    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:40.525315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:40.525266    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:41.158884 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:41.158824    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:41.245453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:41.245420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:59.584871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:59.584805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:39:59.688971 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:39:59.688920    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:00.057563 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:00.057527    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:13.031505 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:13.031470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:13.261135 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:13.261092    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.453443 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.453410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.555333 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.555297    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.619240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.619200    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.679717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.679682    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-784b94fdd6-flk9p"]
Sep 08 16:40:20.683448 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.683424    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.685826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.685796    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 16:40:20.686565 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.686548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8sc6g\""
Sep 08 16:40:20.686669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.686572    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 16:40:20.686669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.686616    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 16:40:20.692348 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.692318    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-flk9p"]
Sep 08 16:40:20.705329 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.705243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.767285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.767227    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-webhook-cert\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.767478 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.767315    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-metrics-certs\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.767478 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.767342    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgwnz\" (UniqueName: \"kubernetes.io/projected/7033024b-7ab9-4117-92f7-e1ccb272d30f-kube-api-access-sgwnz\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.806071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.806038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:20.868388 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.868352    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-webhook-cert\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.868573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.868432    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-metrics-certs\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.868573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.868453    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgwnz\" (UniqueName: \"kubernetes.io/projected/7033024b-7ab9-4117-92f7-e1ccb272d30f-kube-api-access-sgwnz\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.871144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.871107    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-metrics-certs\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.871144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.871137    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-webhook-cert\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.876902 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.876871    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgwnz\" (UniqueName: \"kubernetes.io/projected/7033024b-7ab9-4117-92f7-e1ccb272d30f-kube-api-access-sgwnz\") pod \"maas-controller-784b94fdd6-flk9p\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") " pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:20.995039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:20.994941    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:21.274360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:21.274328    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-flk9p"]
Sep 08 16:40:21.277028 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:40:21.276999    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7033024b_7ab9_4117_92f7_e1ccb272d30f.slice/crio-7f27597b1e81ad11b568406469388cb67e243d3bda349de76ad6b510a82bf6ca WatchSource:0}: Error finding container 7f27597b1e81ad11b568406469388cb67e243d3bda349de76ad6b510a82bf6ca: Status 404 returned error can't find the container with id 7f27597b1e81ad11b568406469388cb67e243d3bda349de76ad6b510a82bf6ca
Sep 08 16:40:21.401893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:21.401858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-flk9p" event={"ID":"7033024b-7ab9-4117-92f7-e1ccb272d30f","Type":"ContainerStarted","Data":"7f27597b1e81ad11b568406469388cb67e243d3bda349de76ad6b510a82bf6ca"}
Sep 08 16:40:23.464050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:23.464013    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:23.563705 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:23.563664    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:24.421805 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:24.421773    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-flk9p" event={"ID":"7033024b-7ab9-4117-92f7-e1ccb272d30f","Type":"ContainerStarted","Data":"ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb"}
Sep 08 16:40:24.422056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:24.421951    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:24.442067 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:24.442010    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-784b94fdd6-flk9p" podStartSLOduration=1.929321684 podStartE2EDuration="4.44199175s" totalImagesPullingTime="2.512670066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:40:24.439815449 +0000 UTC m=+592.428251428" watchObservedRunningTime="2026-09-08 16:40:24.44199175 +0000 UTC m=+592.430427704"
Sep 08 16:40:32.417812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:32.417779    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:40:32.418359 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:32.417921    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:40:35.429727 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:35.429695    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 16:40:56.316127 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:56.316076    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:57.813032 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:57.812978    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:57.914248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:57.914214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:58.015738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.015695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:58.033429 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.033386    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"]
Sep 08 16:40:58.040207 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.040176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.043648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.043620    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 16:40:58.043648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.043634    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 16:40:58.043648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.043620    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 16:40:58.043970 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.043705    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-dzvtd\""
Sep 08 16:40:58.044043 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.044018    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 16:40:58.051705 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.051650    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"]
Sep 08 16:40:58.091641 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.091530    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:58.138602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.138561    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f5a467-4687-4c87-97de-fa45f634e611-openshift-service-ca\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.138800 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.138716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-maas-api-tls\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.138800 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.138752    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-metrics-certs\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.138800 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.138771    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkcbg\" (UniqueName: \"kubernetes.io/projected/a7f5a467-4687-4c87-97de-fa45f634e611-kube-api-access-wkcbg\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.240071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.240032    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f5a467-4687-4c87-97de-fa45f634e611-openshift-service-ca\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.240260 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.240151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-maas-api-tls\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.240260 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.240175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-metrics-certs\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.240260 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.240192    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkcbg\" (UniqueName: \"kubernetes.io/projected/a7f5a467-4687-4c87-97de-fa45f634e611-kube-api-access-wkcbg\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.240761 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.240732    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f5a467-4687-4c87-97de-fa45f634e611-openshift-service-ca\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.242898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.242860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-maas-api-tls\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.243033 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.242990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-metrics-certs\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.249255 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.249222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkcbg\" (UniqueName: \"kubernetes.io/projected/a7f5a467-4687-4c87-97de-fa45f634e611-kube-api-access-wkcbg\") pod \"maas-api-7d686bf8c4-2cnjh\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") " pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.353717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.353610    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:40:58.454984 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.454946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:58.556310 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.556280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:40:58.635665 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:58.635585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"]
Sep 08 16:40:58.638549 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:40:58.638516    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f5a467_4687_4c87_97de_fa45f634e611.slice/crio-21b4f27e4e22f682469c9935b1beb7c1097a3dd0d58ad643d4c707711b7e12c7 WatchSource:0}: Error finding container 21b4f27e4e22f682469c9935b1beb7c1097a3dd0d58ad643d4c707711b7e12c7: Status 404 returned error can't find the container with id 21b4f27e4e22f682469c9935b1beb7c1097a3dd0d58ad643d4c707711b7e12c7
Sep 08 16:40:59.595116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:40:59.595081    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh" event={"ID":"a7f5a467-4687-4c87-97de-fa45f634e611","Type":"ContainerStarted","Data":"21b4f27e4e22f682469c9935b1beb7c1097a3dd0d58ad643d4c707711b7e12c7"}
Sep 08 16:41:01.611014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:01.610966    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh" event={"ID":"a7f5a467-4687-4c87-97de-fa45f634e611","Type":"ContainerStarted","Data":"6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f"}
Sep 08 16:41:01.612028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:01.612000    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:41:01.632029 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:01.631970    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh" podStartSLOduration=1.508105577 podStartE2EDuration="3.631950368s" totalImagesPullingTime="2.123844791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:40:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:01.628653724 +0000 UTC m=+629.617089679" watchObservedRunningTime="2026-09-08 16:41:01.631950368 +0000 UTC m=+629.620386319"
Sep 08 16:41:08.631947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.631911    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 16:41:08.653922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.653890    2581 generic.go:356] "Generic (PLEG): container finished" podID="7da861c5-9489-4ca8-9863-c616d748d2b6" containerID="511b1f147266335cde37430bd7fcc220c49f8ca56c1e018ddf9f517f47277267" exitCode=0
Sep 08 16:41:08.654097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.653960    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" event={"ID":"7da861c5-9489-4ca8-9863-c616d748d2b6","Type":"ContainerDied","Data":"511b1f147266335cde37430bd7fcc220c49f8ca56c1e018ddf9f517f47277267"}
Sep 08 16:41:08.654404 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.654390    2581 scope.go:117] "RemoveContainer" containerID="511b1f147266335cde37430bd7fcc220c49f8ca56c1e018ddf9f517f47277267"
Sep 08 16:41:08.655465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.655435    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:41:08.655547 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.655533    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:41:08.655588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:08.655568    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:41:09.604980 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:09.604931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:09.661175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:09.661142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" event={"ID":"7da861c5-9489-4ca8-9863-c616d748d2b6","Type":"ContainerStarted","Data":"16e598638df8b301b529559cf4799eee8bf6f9df7258350becb2a6a8f84c5477"}
Sep 08 16:41:09.685534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:09.685472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:10.027701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:10.027663    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:41:10.028131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:10.028100    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fw42b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 16:41:10.028396 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:10.028360    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" podUID="7da861c5-9489-4ca8-9863-c616d748d2b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 16:41:11.026127 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:11.026083    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fw42b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 16:41:11.026797 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:11.026758    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" podUID="7da861c5-9489-4ca8-9863-c616d748d2b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 16:41:12.026507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:12.026470    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fw42b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 16:41:12.027107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:12.027070    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" podUID="7da861c5-9489-4ca8-9863-c616d748d2b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 16:41:13.026562 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:13.026508    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fw42b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 16:41:13.027116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:13.026599    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" podUID="7da861c5-9489-4ca8-9863-c616d748d2b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 16:41:13.128862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:13.128785    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:41:14.027138 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:14.026615    2581 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-fw42b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 16:41:14.027138 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:14.026704    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b" podUID="7da861c5-9489-4ca8-9863-c616d748d2b6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 16:41:15.075774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:15.075735    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:41:15.078004 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:15.077975    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-fw42b"
Sep 08 16:41:16.254809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:16.254749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:30.862560 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:30.862529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:38.626941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.626884    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"]
Sep 08 16:41:38.630505 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.630479    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.633086 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.633057    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 16:41:38.633247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.633128    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 16:41:38.633247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.633151    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 16:41:38.633966 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.633944    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-zk588\""
Sep 08 16:41:38.641003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.640967    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"]
Sep 08 16:41:38.646939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.646904    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.647102 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.647025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.647102 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.647063    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.647102 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.647094    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp5v2\" (UniqueName: \"kubernetes.io/projected/f8fcd2cc-952a-46e5-b66b-83d90698306f-kube-api-access-pp5v2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.647211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.647166    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.647249 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.647210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8fcd2cc-952a-46e5-b66b-83d90698306f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.651862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.651809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:38.748707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.748661    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.748969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.748739    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.748969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.748764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.748969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.748791    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp5v2\" (UniqueName: \"kubernetes.io/projected/f8fcd2cc-952a-46e5-b66b-83d90698306f-kube-api-access-pp5v2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.748969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.748877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.748969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.748906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8fcd2cc-952a-46e5-b66b-83d90698306f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.749275 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.749245    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.749331 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.749260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.749368 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.749331    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.751259 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.751235    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f8fcd2cc-952a-46e5-b66b-83d90698306f-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.751505 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.751488    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8fcd2cc-952a-46e5-b66b-83d90698306f-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.758016 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.757990    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp5v2\" (UniqueName: \"kubernetes.io/projected/f8fcd2cc-952a-46e5-b66b-83d90698306f-kube-api-access-pp5v2\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4\" (UID: \"f8fcd2cc-952a-46e5-b66b-83d90698306f\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:38.943058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:38.943021    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:39.215867 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:39.215820    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"]
Sep 08 16:41:39.217078 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:41:39.217048    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8fcd2cc_952a_46e5_b66b_83d90698306f.slice/crio-5667074ae637e66452a6863fe933785a8f85414a0ec165c7528b3cab6334a1bd WatchSource:0}: Error finding container 5667074ae637e66452a6863fe933785a8f85414a0ec165c7528b3cab6334a1bd: Status 404 returned error can't find the container with id 5667074ae637e66452a6863fe933785a8f85414a0ec165c7528b3cab6334a1bd
Sep 08 16:41:39.218515 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:39.218497    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:41:39.462520 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:39.462484    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:39.810226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:39.810187    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4" event={"ID":"f8fcd2cc-952a-46e5-b66b-83d90698306f","Type":"ContainerStarted","Data":"5667074ae637e66452a6863fe933785a8f85414a0ec165c7528b3cab6334a1bd"}
Sep 08 16:41:40.817080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:40.817041    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4" event={"ID":"f8fcd2cc-952a-46e5-b66b-83d90698306f","Type":"ContainerStarted","Data":"84ada195aef2bd022880fa99d5c9f65afe4db72827713d940466ba81f28f2b39"}
Sep 08 16:41:40.835429 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:40.835372    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4" podStartSLOduration=1.858627198 podStartE2EDuration="2.835353778s" totalImagesPullingTime="976.72658ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:41:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:40.834091243 +0000 UTC m=+668.822527197" watchObservedRunningTime="2026-09-08 16:41:40.835353778 +0000 UTC m=+668.823789761"
Sep 08 16:41:45.757108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:45.757075    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:48.943735 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:48.943683    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:48.944230 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:48.943761    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:48.957287 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:48.957249    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:49.873436 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:49.873404    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4"
Sep 08 16:41:50.364782 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:50.364744    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:54.424048 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.424006    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"]
Sep 08 16:41:54.426654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.426629    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.429170 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.429143    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 16:41:54.443663 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.443622    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"]
Sep 08 16:41:54.456669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.456633    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:41:54.508140 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.508100    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.508317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.508154    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.508317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.508223    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.508317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.508238    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.508317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.508298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvd79\" (UniqueName: \"kubernetes.io/projected/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-kube-api-access-nvd79\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.508457 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.508364    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609059 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609019    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609059 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609056    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609291 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609079    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvd79\" (UniqueName: \"kubernetes.io/projected/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-kube-api-access-nvd79\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609291 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609291 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609291 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609212    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609547 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609520    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609621    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.609689 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.609654    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.611568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.611540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.611943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.611921    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.617341 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.617308    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvd79\" (UniqueName: \"kubernetes.io/projected/7a09ec4a-f8cf-4e2d-8281-6c9525eab299-kube-api-access-nvd79\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-9khw2\" (UID: \"7a09ec4a-f8cf-4e2d-8281-6c9525eab299\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:54.741022 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:54.740983    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:41:55.018316 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:55.018287    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"]
Sep 08 16:41:55.020518 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:41:55.020488    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a09ec4a_f8cf_4e2d_8281_6c9525eab299.slice/crio-0e8ed5d18bedefd668b09080027aee2e656f50564f6f7b7602c70d85fd43ea1d WatchSource:0}: Error finding container 0e8ed5d18bedefd668b09080027aee2e656f50564f6f7b7602c70d85fd43ea1d: Status 404 returned error can't find the container with id 0e8ed5d18bedefd668b09080027aee2e656f50564f6f7b7602c70d85fd43ea1d
Sep 08 16:41:55.894853 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:55.894796    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2" event={"ID":"7a09ec4a-f8cf-4e2d-8281-6c9525eab299","Type":"ContainerStarted","Data":"555a19d30883b225b306d7031ec561bb5d5a0192ea81a56d68a02f20ac22822b"}
Sep 08 16:41:55.895246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:55.894888    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2" event={"ID":"7a09ec4a-f8cf-4e2d-8281-6c9525eab299","Type":"ContainerStarted","Data":"0e8ed5d18bedefd668b09080027aee2e656f50564f6f7b7602c70d85fd43ea1d"}
Sep 08 16:41:55.912947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:41:55.912888    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2" podStartSLOduration=1.718059504 podStartE2EDuration="1.912849786s" totalImagesPullingTime="194.790282ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:41:55.911950639 +0000 UTC m=+683.900386593" watchObservedRunningTime="2026-09-08 16:41:55.912849786 +0000 UTC m=+683.901285730"
Sep 08 16:42:01.463826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:01.463789    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:04.741306 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:04.741252    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:42:04.741703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:04.741332    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:42:04.754029 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:04.754001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:42:04.951805 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:04.951771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-9khw2"
Sep 08 16:42:28.243666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:28.243629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:42:28.343214 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:42:28.343184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:01.184366 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:01.184327    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:01.282548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:01.282512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:02.346718 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:02.346679    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:02.437375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:02.437341    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:18.223799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.223731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:18.345010 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.344966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:18.524706 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.524605    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"]
Sep 08 16:43:18.528573 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.528549    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.531194 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.531165    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-c9b098-openshift-default-dockercfg-tnpbr\""
Sep 08 16:43:18.542216 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.542177    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"]
Sep 08 16:43:18.550397 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.550365    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:18.570746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.570706    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-podinfo\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.570965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.570796    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-credential-socket\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.570965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.570934    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-token\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.571071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.571054    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-envoy\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.571130 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.571089    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-certs\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.571188 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.571158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz6tp\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-kube-api-access-vz6tp\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.571246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.571225    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istiod-ca-cert\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.571302 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.571265    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-socket\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.571360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.571307    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-data\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.672940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.672886    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-data\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.672962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-podinfo\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673020    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-credential-socket\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673103    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-token\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673153    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-envoy\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673183    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-certs\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz6tp\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-kube-api-access-vz6tp\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673250    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istiod-ca-cert\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-socket\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673333    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-data\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673534    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-credential-socket\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673616    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-socket\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.673985 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.673812    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-certs\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.674283 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.674260    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istiod-ca-cert\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.676308 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.676282    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-podinfo\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.676458 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.676408    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-envoy\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.700614 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.700573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz6tp\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-kube-api-access-vz6tp\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.707605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.707573    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-token\") pod \"e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") " pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.841796 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.841694    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:18.996107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:18.996064    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:19.122703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.122673    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"]
Sep 08 16:43:19.124502 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:43:19.124473    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcd7fc1c_8ea0_4bc1_852f_57ee754b4b28.slice/crio-126b23baebeac91e8d442af7e567c976fe2715fa6dc1d6c39c738e2a29424ff1 WatchSource:0}: Error finding container 126b23baebeac91e8d442af7e567c976fe2715fa6dc1d6c39c738e2a29424ff1: Status 404 returned error can't find the container with id 126b23baebeac91e8d442af7e567c976fe2715fa6dc1d6c39c738e2a29424ff1
Sep 08 16:43:19.126672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.126637    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:19.126756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.126713    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:19.126756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.126742    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:19.329075 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.329037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" event={"ID":"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28","Type":"ContainerStarted","Data":"28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"}
Sep 08 16:43:19.329586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.329110    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" event={"ID":"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28","Type":"ContainerStarted","Data":"126b23baebeac91e8d442af7e567c976fe2715fa6dc1d6c39c738e2a29424ff1"}
Sep 08 16:43:19.351623 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.351543    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podStartSLOduration=1.351514775 podStartE2EDuration="1.351514775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:19.348647739 +0000 UTC m=+767.337083700" watchObservedRunningTime="2026-09-08 16:43:19.351514775 +0000 UTC m=+767.339950729"
Sep 08 16:43:19.671933 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.671890    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:19.778647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.778612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:19.842895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:19.842820    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:20.137749 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:20.137714    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:20.847709 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:20.847672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:21.279077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:21.279038    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:21.340432 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:21.340399    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:21.341657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:21.341632    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:21.575417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:21.575316    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:21.675907 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:21.675876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:22.571018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.570978    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"]
Sep 08 16:43:22.575865 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.575823    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.578575 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.578544    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c9b098-serving-cert\""
Sep 08 16:43:22.586691 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.586661    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"]
Sep 08 16:43:22.608021 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.607975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:22.614411 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.614371    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093a6379-5a41-4e74-ab05-b76ced36a856-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.614629 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.614539    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-metrics-certs\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.614699 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.614642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.614745 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.614716    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f7hg\" (UniqueName: \"kubernetes.io/projected/093a6379-5a41-4e74-ab05-b76ced36a856-kube-api-access-9f7hg\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.711094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.711057    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:22.715367 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.715333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093a6379-5a41-4e74-ab05-b76ced36a856-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.715501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.715443    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-metrics-certs\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.715547 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.715512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.715587 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.715572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f7hg\" (UniqueName: \"kubernetes.io/projected/093a6379-5a41-4e74-ab05-b76ced36a856-kube-api-access-9f7hg\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.715649 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:43:22.715624    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-serving-cert: secret "maas-api-e2e-inf-a-c9b098-serving-cert" not found
Sep 08 16:43:22.715727 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:43:22.715715    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls podName:093a6379-5a41-4e74-ab05-b76ced36a856 nodeName:}" failed. No retries permitted until 2026-09-08 16:43:23.215691003 +0000 UTC m=+771.204126935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls") pod "maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" (UID: "093a6379-5a41-4e74-ab05-b76ced36a856") : secret "maas-api-e2e-inf-a-c9b098-serving-cert" not found
Sep 08 16:43:22.716118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.716086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093a6379-5a41-4e74-ab05-b76ced36a856-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.718247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.718222    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-metrics-certs\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.724675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.724645    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f7hg\" (UniqueName: \"kubernetes.io/projected/093a6379-5a41-4e74-ab05-b76ced36a856-kube-api-access-9f7hg\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:22.809704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:22.809657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:23.223067 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:23.223021    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:23.226071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:23.226017    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls\") pod \"maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:23.273034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:23.272998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:23.391620 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:23.391584    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:23.491127 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:23.491035    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:23.796511 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:23.796459    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"]
Sep 08 16:43:23.799273 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:43:23.799241    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod093a6379_5a41_4e74_ab05_b76ced36a856.slice/crio-ff362c5759f3411ef065337c188271327de80d0cc228f0473c47f979e5ca41f3 WatchSource:0}: Error finding container ff362c5759f3411ef065337c188271327de80d0cc228f0473c47f979e5ca41f3: Status 404 returned error can't find the container with id ff362c5759f3411ef065337c188271327de80d0cc228f0473c47f979e5ca41f3
Sep 08 16:43:24.360898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:24.360866    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" event={"ID":"093a6379-5a41-4e74-ab05-b76ced36a856","Type":"ContainerStarted","Data":"ff362c5759f3411ef065337c188271327de80d0cc228f0473c47f979e5ca41f3"}
Sep 08 16:43:25.368299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:25.368260    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" event={"ID":"093a6379-5a41-4e74-ab05-b76ced36a856","Type":"ContainerStarted","Data":"d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792"}
Sep 08 16:43:25.368700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:25.368412    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:25.388914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:25.388846    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" podStartSLOduration=2.861397493 podStartE2EDuration="3.38881179s" totalImagesPullingTime="527.414297ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:25.387453354 +0000 UTC m=+773.375889322" watchObservedRunningTime="2026-09-08 16:43:25.38881179 +0000 UTC m=+773.377247744"
Sep 08 16:43:26.767508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:26.767471    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:26.829083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:26.829045    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:27.058156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.058049    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"]
Sep 08 16:43:27.062457 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.062430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.065496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.065464    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4c81c932-openshift-default-dockercfg-9rqr7\""
Sep 08 16:43:27.074697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.074669    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"]
Sep 08 16:43:27.095930 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.095899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:27.170444 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.170398    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-data\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.170889 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.170811    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-certs\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171037    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-token\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171090    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-socket\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2j9ks\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-kube-api-access-2j9ks\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171196    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-podinfo\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171419 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171231    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istiod-ca-cert\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171419 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171277    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-envoy\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.171419 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.171316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-credential-socket\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.252302 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.252271    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:27.272427 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-podinfo\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272427 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272427    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istiod-ca-cert\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272457    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-envoy\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-credential-socket\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-data\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272617    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-certs\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272643    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-token\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272991 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272686    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-socket\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.272991 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.272738    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2j9ks\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-kube-api-access-2j9ks\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.273100 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.273077    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-data\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.273175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.273120    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-credential-socket\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.273222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.273172    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-socket\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.273318 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.273288    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istiod-ca-cert\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.273388 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.273355    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-certs\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.275776 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.275749    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-podinfo\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.275990 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.275969    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-envoy\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.281725 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.281692    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2j9ks\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-kube-api-access-2j9ks\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.281882 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.281698    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-token\") pod \"e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") " pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.353268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.353165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:27.375634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.375602    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:27.468333 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.467971    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"]
Sep 08 16:43:27.472481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.472015    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.474746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.474700    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-4cea93-openshift-default-dockercfg-fzd9q\""
Sep 08 16:43:27.485942 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.485899    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"]
Sep 08 16:43:27.498054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.498021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:27.578646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578579    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-socket\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.578879 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578695    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5zlx\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-kube-api-access-h5zlx\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.578879 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578813    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istiod-ca-cert\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.578879 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578859    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-token\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.579069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578885    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-envoy\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.579069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-certs\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.579069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.578969    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-podinfo\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.579069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.579017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-credential-socket\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.579069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.579068    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-data\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.623099 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.623014    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:27.666581 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.666551    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"]
Sep 08 16:43:27.669274 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:43:27.669208    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c518c17_4d99_43a5_9df9_1eda3ebc7b72.slice/crio-197ed1f2d3f21972cc0921d91540a5758b8af087ff78f69f41fb45c052a3b027 WatchSource:0}: Error finding container 197ed1f2d3f21972cc0921d91540a5758b8af087ff78f69f41fb45c052a3b027: Status 404 returned error can't find the container with id 197ed1f2d3f21972cc0921d91540a5758b8af087ff78f69f41fb45c052a3b027
Sep 08 16:43:27.672584 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.672538    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:27.672736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.672649    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:27.672736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.672691    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:27.679646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-data\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.679773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679659    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-socket\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.679773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679703    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5zlx\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-kube-api-access-h5zlx\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.679913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679806    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istiod-ca-cert\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.679913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679877    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-token\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.679913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679906    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-envoy\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-certs\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.679994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-podinfo\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.680041    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-credential-socket\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680210 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.680068    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-data\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680210 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.680076    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-socket\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680405 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.680380    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-certs\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.680407    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-credential-socket\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.680549 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.680523    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istiod-ca-cert\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.682538 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.682513    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-envoy\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.682746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.682722    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-podinfo\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.688405 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.688371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-token\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.688589 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.688540    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5zlx\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-kube-api-access-h5zlx\") pod \"e2e-autores-4cea93-openshift-default-f559bdc44-l62kw\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") " pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:27.790543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:27.790495    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:28.074884 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.074853    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"]
Sep 08 16:43:28.077584 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:43:28.077556    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd31b1f3_f6a3_42dc_8496_8b30e1c63ccb.slice/crio-9346ed285c2397699314cd0bdc6c087f3126e9eec324249f7fb1b2c1d08395f8 WatchSource:0}: Error finding container 9346ed285c2397699314cd0bdc6c087f3126e9eec324249f7fb1b2c1d08395f8: Status 404 returned error can't find the container with id 9346ed285c2397699314cd0bdc6c087f3126e9eec324249f7fb1b2c1d08395f8
Sep 08 16:43:28.080061 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.080029    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:28.080140 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.080100    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:28.080140 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.080127    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:28.387203 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.387101    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" event={"ID":"4c518c17-4d99-43a5-9df9-1eda3ebc7b72","Type":"ContainerStarted","Data":"e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"}
Sep 08 16:43:28.387203 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.387183    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" event={"ID":"4c518c17-4d99-43a5-9df9-1eda3ebc7b72","Type":"ContainerStarted","Data":"197ed1f2d3f21972cc0921d91540a5758b8af087ff78f69f41fb45c052a3b027"}
Sep 08 16:43:28.389081 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.389044    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" event={"ID":"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb","Type":"ContainerStarted","Data":"4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"}
Sep 08 16:43:28.389248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.389111    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" event={"ID":"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb","Type":"ContainerStarted","Data":"9346ed285c2397699314cd0bdc6c087f3126e9eec324249f7fb1b2c1d08395f8"}
Sep 08 16:43:28.411493 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.411433    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podStartSLOduration=1.411413476 podStartE2EDuration="1.411413476s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:28.408558778 +0000 UTC m=+776.396994734" watchObservedRunningTime="2026-09-08 16:43:28.411413476 +0000 UTC m=+776.399849430"
Sep 08 16:43:28.433027 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.432965    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podStartSLOduration=1.432945819 podStartE2EDuration="1.432945819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:28.430695669 +0000 UTC m=+776.419131626" watchObservedRunningTime="2026-09-08 16:43:28.432945819 +0000 UTC m=+776.421381877"
Sep 08 16:43:28.791203 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:28.791166    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:29.376615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.376572    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:29.382456 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.382425    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:29.394081 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.394051    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:29.395026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.395002    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:29.797533 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.797481    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:29.863050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.863012    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:29.959600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:29.959560    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:30.357935 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:30.357865    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:30.400122 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:30.400086    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:30.401269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:30.401244    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:43:30.433630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:30.433586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:31.144280 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:31.144244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:31.245674 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:31.245622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:31.379785 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:31.379754    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:43:31.503421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:31.503385    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:31.818967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:31.818793    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:31.898287 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:31.898249    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:32.530921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:32.530802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:32.624585 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:32.624546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:32.762464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:32.762431    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:33.197125 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:33.197084    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:33.295403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:33.295368    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:34.062992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:34.062961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:34.714603 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:34.714546    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:34.928455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:34.928404    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:37.290196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:37.290161    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:37.382077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:37.382028    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:43:37.382319 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:37.382123    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:43:37.495225 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:37.495182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:37.686920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:37.686822    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:37.864197 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:37.864148    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:38.153760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:38.153634    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:40.435026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.434911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:40.473281 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.473239    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerID="28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90" exitCode=0
Sep 08 16:43:40.473467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.473306    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" event={"ID":"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28","Type":"ContainerDied","Data":"28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"}
Sep 08 16:43:40.473764 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.473749    2581 scope.go:117] "RemoveContainer" containerID="28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"
Sep 08 16:43:40.475039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.475010    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:40.475113 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.475094    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:40.475163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:40.475133    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:41.410432 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.410387    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:41.487206 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.487165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" event={"ID":"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28","Type":"ContainerStarted","Data":"ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75"}
Sep 08 16:43:41.518762 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.518715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:41.660496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.660412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:41.842079 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.842042    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:41.842890 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.842856    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:43:41.843184 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:41.843139    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 16:43:42.251484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:42.251409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:42.843142 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:42.843094    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:43:42.843787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:42.843752    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 16:43:43.842852 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:43.842227    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:43:43.842852 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:43.842306    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 16:43:43.854107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:43.853983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:44.842237 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:44.842188    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:43:44.842447 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:44.842254    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 16:43:45.435063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:45.435014    2581 patch_prober.go:28] interesting pod/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:43:45.435481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:45.435080    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:43:45.842664 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:45.842566    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:43:45.842664 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:45.842631    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 16:43:46.283448 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.283407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:46.629322 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.629174    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:46.843211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.843159    2581 patch_prober.go:28] interesting pod/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 08 16:43:46.843404 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.843253    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 08 16:43:46.929926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.928164    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"]
Sep 08 16:43:46.946246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.946150    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:46.957861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.954417    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-43a905-openshift-default-dockercfg-25w8x\""
Sep 08 16:43:46.961823 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.961764    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"]
Sep 08 16:43:46.979081 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:46.976586    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047484    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-certs\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047612    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-podinfo\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047644    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istiod-ca-cert\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-data\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-envoy\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047743    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-token\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047774    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-866rj\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-kube-api-access-866rj\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047822    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-credential-socket\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.048106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.047932    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-socket\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.149750 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.149708    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-podinfo\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.150093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.150067    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istiod-ca-cert\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.150944    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istiod-ca-cert\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.150962    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-data\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151002    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-envoy\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-token\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151071    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-866rj\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-kube-api-access-866rj\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151123    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-credential-socket\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151216    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-socket\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-certs\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.151719 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.151697    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-certs\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.152477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.152127    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-data\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.152477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.152432    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-socket\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.152667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.152500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-credential-socket\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.153482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.153421    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-podinfo\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.155318 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.155251    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-envoy\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.166952 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.164660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-token\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.166952 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.166864    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-866rj\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-kube-api-access-866rj\") pod \"e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") " pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.180599 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.180495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:47.291472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.291430    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:47.605961 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.605915    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"]
Sep 08 16:43:47.607438 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:43:47.607406    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b3fdc8_5498_43fa_b3af_aa0329d128c0.slice/crio-411d4b7dd9cbf4d3339203d642218f89e377a4af47eddd6ea3e910a01e78a453 WatchSource:0}: Error finding container 411d4b7dd9cbf4d3339203d642218f89e377a4af47eddd6ea3e910a01e78a453: Status 404 returned error can't find the container with id 411d4b7dd9cbf4d3339203d642218f89e377a4af47eddd6ea3e910a01e78a453
Sep 08 16:43:47.610883 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.610811    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:47.611023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.610956    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:47.611023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.611016    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:47.848278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.848232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:47.848892 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.848850    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:47.850109 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:47.850078    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:43:48.524546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.524514    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:48.538946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.538912    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" event={"ID":"11b3fdc8-5498-43fa-b3af-aa0329d128c0","Type":"ContainerStarted","Data":"ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"}
Sep 08 16:43:48.539151 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.538972    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" event={"ID":"11b3fdc8-5498-43fa-b3af-aa0329d128c0","Type":"ContainerStarted","Data":"411d4b7dd9cbf4d3339203d642218f89e377a4af47eddd6ea3e910a01e78a453"}
Sep 08 16:43:48.562565 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.562511    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podStartSLOduration=2.56249138 podStartE2EDuration="2.56249138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:43:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:43:48.560458577 +0000 UTC m=+796.548894533" watchObservedRunningTime="2026-09-08 16:43:48.56249138 +0000 UTC m=+796.550927334"
Sep 08 16:43:48.627723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.627680    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:48.722095 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.722063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:48.958525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:48.958489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:49.292256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.292151    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:49.297600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.297568    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:49.546734 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.546645    2581 generic.go:356] "Generic (PLEG): container finished" podID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerID="e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb" exitCode=0
Sep 08 16:43:49.546734 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.546697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" event={"ID":"4c518c17-4d99-43a5-9df9-1eda3ebc7b72","Type":"ContainerDied","Data":"e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"}
Sep 08 16:43:49.547039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.547020    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:49.547380 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.547363    2581 scope.go:117] "RemoveContainer" containerID="e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"
Sep 08 16:43:49.548299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.547895    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:43:49.548743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.548713    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:49.548812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.548801    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:49.548876 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:49.548858    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:43:50.554662 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:50.554623    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" event={"ID":"4c518c17-4d99-43a5-9df9-1eda3ebc7b72","Type":"ContainerStarted","Data":"3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f"}
Sep 08 16:43:50.606467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:50.606428    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:50.706435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:50.706401    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:51.375913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:51.375873    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:51.376125 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:51.376103    2581 patch_prober.go:28] interesting pod/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 16:43:51.376173 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:51.376151    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 16:43:51.756396 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:51.756357    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:51.861988 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:51.861955    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:51.937052 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:51.937019    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:52.376367 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:52.376331    2581 patch_prober.go:28] interesting pod/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 16:43:52.376568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:52.376406    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 16:43:52.812207 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:52.812152    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:52.914116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:52.914060    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:53.376266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:53.376180    2581 patch_prober.go:28] interesting pod/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 16:43:53.376266 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:53.376250    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 16:43:53.901461 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:53.901419    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:54.376491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:54.376449    2581 patch_prober.go:28] interesting pod/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 16:43:54.376682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:54.376511    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 16:43:54.730342 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:54.730302    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:55.376371 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:55.376332    2581 patch_prober.go:28] interesting pod/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body=
Sep 08 16:43:55.377006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:55.376970    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused"
Sep 08 16:43:55.755070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:55.755027    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:55.857447 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:55.857405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:55.958320 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:55.958267    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:43:56.380887 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:56.380823    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:56.381312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:56.381243    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:56.381929 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:56.381913    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:43:56.730151 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:43:56.730111    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:00.427652 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:00.427611    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:05.652080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:05.651986    2581 generic.go:356] "Generic (PLEG): container finished" podID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerID="4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50" exitCode=0
Sep 08 16:44:05.652080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:05.652066    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" event={"ID":"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb","Type":"ContainerDied","Data":"4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"}
Sep 08 16:44:05.652587 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:05.652570    2581 scope.go:117] "RemoveContainer" containerID="4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"
Sep 08 16:44:05.653926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:05.653892    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:05.654060 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:05.653985    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:05.654060 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:05.654033    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:06.660237 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:06.660196    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" event={"ID":"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb","Type":"ContainerStarted","Data":"19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58"}
Sep 08 16:44:06.791626 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:06.791576    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:44:06.791809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:06.791788    2581 patch_prober.go:28] interesting pod/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 08 16:44:06.791891 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:06.791869    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 08 16:44:07.791243 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:07.791199    2581 patch_prober.go:28] interesting pod/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 08 16:44:07.791698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:07.791275    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 08 16:44:08.791752 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:08.791706    2581 patch_prober.go:28] interesting pod/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 08 16:44:08.792188 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:08.791763    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 08 16:44:09.791489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:09.791440    2581 patch_prober.go:28] interesting pod/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 08 16:44:09.791674 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:09.791511    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 08 16:44:10.791303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:10.791256    2581 patch_prober.go:28] interesting pod/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 08 16:44:10.791711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:10.791336    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 08 16:44:11.492958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.492923    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:11.695476 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.695441    2581 generic.go:356] "Generic (PLEG): container finished" podID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerID="ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6" exitCode=0
Sep 08 16:44:11.695655 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.695518    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" event={"ID":"11b3fdc8-5498-43fa-b3af-aa0329d128c0","Type":"ContainerDied","Data":"ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"}
Sep 08 16:44:11.696356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.696339    2581 scope.go:117] "RemoveContainer" containerID="ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"
Sep 08 16:44:11.697633 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.697603    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:11.697688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.697677    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:11.697728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.697707    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:11.791472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.791370    2581 patch_prober.go:28] interesting pod/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body=
Sep 08 16:44:11.791472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:11.791420    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused"
Sep 08 16:44:12.376058 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.376021    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.488746 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.488673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.589357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.589321    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.689995 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.689966    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.702675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.702644    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" event={"ID":"11b3fdc8-5498-43fa-b3af-aa0329d128c0","Type":"ContainerStarted","Data":"13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2"}
Sep 08 16:44:12.763665 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.763629    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:12.848219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.848187    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:44:12.850281 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.850256    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:44:12.854151 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.853647    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:44:12.859500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.859330    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"]
Sep 08 16:44:12.859959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.859920    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy" containerID="cri-o://3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f" gracePeriod=30
Sep 08 16:44:12.894529 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:12.894489    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:13.003447 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.003363    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:13.292085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.291963    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:44:13.292287 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.292226    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:44:13.292375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.292295    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 16:44:13.329669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.329623    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:13.430749 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.430716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:13.590386 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.590289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:13.840294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.840244    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"]
Sep 08 16:44:13.844462 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.844381    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.847763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.847718    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-fc1daf8b-gw-openshift-default-dockercfg-d8xjc\""
Sep 08 16:44:13.858351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.858323    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"]
Sep 08 16:44:13.903681 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.903637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:13.985355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985158    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8zsm\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-kube-api-access-n8zsm\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-podinfo\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985299    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-token\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985338    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-data\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istiod-ca-cert\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985629    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-certs\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985666    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-envoy\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985700    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-credential-socket\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:13.985939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:13.985781    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-socket\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.086982 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.086940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-certs\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.086982 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.086990    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-envoy\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087009    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-credential-socket\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087058    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-socket\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087089    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8zsm\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-kube-api-access-n8zsm\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-podinfo\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087166    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-token\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087256 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087223    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-data\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087558 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087282    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istiod-ca-cert\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087558 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-certs\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087558 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087516    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-credential-socket\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.087717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.087659    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-data\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.088077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.088049    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-socket\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.088178 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.088063    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istiod-ca-cert\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.089530 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.089507    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-envoy\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.089743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.089723    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-podinfo\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.095657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.095600    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-token\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.095827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.095804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8zsm\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-kube-api-access-n8zsm\") pod \"e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") " pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.161727 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.161689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:14.262330 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.262300    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:14.292205 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.292173    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:44:14.292399 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.292226    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 16:44:14.479403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.479370    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"]
Sep 08 16:44:14.481798 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:44:14.481747    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e86f880_33ad_4019_a6f8_fbd69ad3f2d4.slice/crio-6ee09234fb583cc226d9458f21aa8b1b1f45bed546e457a86c3297804ad2e4e2 WatchSource:0}: Error finding container 6ee09234fb583cc226d9458f21aa8b1b1f45bed546e457a86c3297804ad2e4e2: Status 404 returned error can't find the container with id 6ee09234fb583cc226d9458f21aa8b1b1f45bed546e457a86c3297804ad2e4e2
Sep 08 16:44:14.484607 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.484556    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:14.484708 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.484654    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:14.484708 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.484693    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:14.725823 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.725423    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" event={"ID":"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4","Type":"ContainerStarted","Data":"d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"}
Sep 08 16:44:14.725823 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.725514    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" event={"ID":"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4","Type":"ContainerStarted","Data":"6ee09234fb583cc226d9458f21aa8b1b1f45bed546e457a86c3297804ad2e4e2"}
Sep 08 16:44:14.747658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:14.746422    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podStartSLOduration=1.746398454 podStartE2EDuration="1.746398454s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:14.745370126 +0000 UTC m=+822.733806083" watchObservedRunningTime="2026-09-08 16:44:14.746398454 +0000 UTC m=+822.734834440"
Sep 08 16:44:15.161978 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.161872    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:15.168490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.168458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:15.292137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.292101    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:44:15.292304 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.292184    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 16:44:15.529523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.529486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:15.732496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.732463    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:15.733510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:15.733484    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:16.203459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.203418    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.292734 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.292688    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:44:16.292960 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.292795    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 16:44:16.301903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.301876    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.588702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.588618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.662646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.662614    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:16.826317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:16.826272    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:17.152167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:17.152129    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:17.263269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:17.263238    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:17.292176 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:17.292143    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:44:17.292357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:17.292198    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 16:44:18.172105 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.172078    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:44:18.292701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.292656    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 16:44:18.293240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.292726    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 16:44:18.356184 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356142    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-certs\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356204    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-token\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356263    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-data\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356289    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istiod-ca-cert\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356317    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-socket\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356358    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-credential-socket\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2j9ks\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-kube-api-access-2j9ks\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-envoy\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356648 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356531    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-podinfo\") pod \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\" (UID: \"4c518c17-4d99-43a5-9df9-1eda3ebc7b72\") "
Sep 08 16:44:18.356798 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356685    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:44:18.356900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.356858    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:18.357097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357065    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:18.357403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357114    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:18.357585 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357564    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-data" (OuterVolumeSpecName: "istio-data") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:18.357699 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357678    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.357763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357706    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.357763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357727    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.357763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.357741    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.359397 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.359366    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-kube-api-access-2j9ks" (OuterVolumeSpecName: "kube-api-access-2j9ks") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "kube-api-access-2j9ks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:18.359523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.359449    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-token" (OuterVolumeSpecName: "istio-token") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:18.359523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.359464    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:18.359604 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.359578    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4c518c17-4d99-43a5-9df9-1eda3ebc7b72" (UID: "4c518c17-4d99-43a5-9df9-1eda3ebc7b72"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:44:18.458675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.458634    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.458675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.458670    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.458675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.458678    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.458675 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.458686    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2j9ks\" (UniqueName: \"kubernetes.io/projected/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-kube-api-access-2j9ks\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.459002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.458701    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4c518c17-4d99-43a5-9df9-1eda3ebc7b72-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:18.752316 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.752207    2581 generic.go:356] "Generic (PLEG): container finished" podID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerID="3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f" exitCode=0
Sep 08 16:44:18.752316 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.752292    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"
Sep 08 16:44:18.752316 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.752299    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" event={"ID":"4c518c17-4d99-43a5-9df9-1eda3ebc7b72","Type":"ContainerDied","Data":"3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f"}
Sep 08 16:44:18.752563 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.752394    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4" event={"ID":"4c518c17-4d99-43a5-9df9-1eda3ebc7b72","Type":"ContainerDied","Data":"197ed1f2d3f21972cc0921d91540a5758b8af087ff78f69f41fb45c052a3b027"}
Sep 08 16:44:18.752563 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.752420    2581 scope.go:117] "RemoveContainer" containerID="3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f"
Sep 08 16:44:18.763279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.763258    2581 scope.go:117] "RemoveContainer" containerID="e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"
Sep 08 16:44:18.773968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.773930    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"]
Sep 08 16:44:18.774536 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.774513    2581 scope.go:117] "RemoveContainer" containerID="3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f"
Sep 08 16:44:18.774937 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:44:18.774913    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f\": container with ID starting with 3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f not found: ID does not exist" containerID="3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f"
Sep 08 16:44:18.775034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.774948    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f"} err="failed to get container status \"3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f\": rpc error: code = NotFound desc = could not find container \"3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f\": container with ID starting with 3f133c6de7a3bf1c8cc8e0466861216de53c12dccfef56e79800a21296c4038f not found: ID does not exist"
Sep 08 16:44:18.775034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.774970    2581 scope.go:117] "RemoveContainer" containerID="e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"
Sep 08 16:44:18.775251 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:44:18.775228    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb\": container with ID starting with e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb not found: ID does not exist" containerID="e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"
Sep 08 16:44:18.775330 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.775257    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb"} err="failed to get container status \"e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb\": rpc error: code = NotFound desc = could not find container \"e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb\": container with ID starting with e7346446d5775166e43e204a6bc9d19c0c1b173cfdd54a763a7326e60be8bddb not found: ID does not exist"
Sep 08 16:44:18.779702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:18.779673    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4c81c932-openshift-default-65d9f9dc9d-jrpj4"]
Sep 08 16:44:19.296550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:19.296520    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:44:19.296967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:19.296826    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:44:19.297852 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:19.297813    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:44:20.075680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:20.075619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:20.468643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:20.468604    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" path="/var/lib/kubelet/pods/4c518c17-4d99-43a5-9df9-1eda3ebc7b72/volumes"
Sep 08 16:44:25.725008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:25.724940    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:31.774062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:31.774002    2581 patch_prober.go:28] interesting pod/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:44:31.774580 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:31.774074    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:44:34.859685 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:34.859652    2581 generic.go:356] "Generic (PLEG): container finished" podID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerID="d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3" exitCode=0
Sep 08 16:44:34.860147 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:34.859718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" event={"ID":"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4","Type":"ContainerDied","Data":"d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"}
Sep 08 16:44:34.860193 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:34.860175    2581 scope.go:117] "RemoveContainer" containerID="d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"
Sep 08 16:44:34.861619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:34.861582    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:34.861714 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:34.861676    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:34.861757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:34.861725    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:35.867031 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:35.866994    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" event={"ID":"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4","Type":"ContainerStarted","Data":"8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747"}
Sep 08 16:44:36.163015 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:36.162886    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:36.163187 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:36.163156    2581 patch_prober.go:28] interesting pod/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 16:44:36.163251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:36.163227    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 16:44:37.162741 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:37.162700    2581 patch_prober.go:28] interesting pod/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 16:44:37.163169 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:37.162777    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 16:44:38.162445 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:38.162402    2581 patch_prober.go:28] interesting pod/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 16:44:38.162649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:38.162472    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 16:44:39.162561 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:39.162521    2581 patch_prober.go:28] interesting pod/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 16:44:39.162990 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:39.162594    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 16:44:40.163032 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:40.162992    2581 patch_prober.go:28] interesting pod/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 16:44:40.163713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:40.163675    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 16:44:41.277575 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:41.277536    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:41.278018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:41.277818    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:41.278787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:41.278762    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:46.766381 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:46.766343    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:48.013226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:48.013192    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:48.114508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:48.114479    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:48.213507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:48.213470    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:48.317077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:48.316986    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:48.423297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:48.423244    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"]
Sep 08 16:44:48.424411 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:48.424127    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy" containerID="cri-o://8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747" gracePeriod=30
Sep 08 16:44:49.206542 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.206502    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"]
Sep 08 16:44:49.207779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.207750    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy"
Sep 08 16:44:49.207965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.207952    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy"
Sep 08 16:44:49.208071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.208060    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy"
Sep 08 16:44:49.208147 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.208138    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy"
Sep 08 16:44:49.208328 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.208317    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy"
Sep 08 16:44:49.208418 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.208409    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c518c17-4d99-43a5-9df9-1eda3ebc7b72" containerName="istio-proxy"
Sep 08 16:44:49.211564 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.211537    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.214550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.214521    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-30506528-openshift-default-dockercfg-d2vlz\""
Sep 08 16:44:49.230201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.230068    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"]
Sep 08 16:44:49.313542 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313506    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-certs\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.313542 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313558    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-data\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.313893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313665    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-socket\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.313893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313734    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-podinfo\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.313893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313779    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-token\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.313893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313815    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-envoy\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.313893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313887    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-credential-socket\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.314204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.313940    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istiod-ca-cert\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.314204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.314058    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6sgm\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-kube-api-access-n6sgm\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-socket\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415361    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-podinfo\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-token\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-envoy\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-credential-socket\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415491    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istiod-ca-cert\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415554    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6sgm\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-kube-api-access-n6sgm\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415613    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-certs\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-data\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.415920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415882    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-socket\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.416084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.415974    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-data\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.416156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.416129    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-credential-socket\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.416210 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.416135    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-certs\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.416342 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.416319    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istiod-ca-cert\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.418342 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.418307    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-envoy\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.418471 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.418410    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-podinfo\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.427574 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.427545    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-token\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.427689 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.427666    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6sgm\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-kube-api-access-n6sgm\") pod \"e2e-ait-30506528-openshift-default-856bdc489d-f84gp\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") " pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.470508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.470414    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:49.532600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.532566    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:49.569455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.569417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:49.815065 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.815031    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"]
Sep 08 16:44:49.816167 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:44:49.816138    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc31b5be8_24fa_4b5c_ab3c_017933f8c160.slice/crio-d4c25faf970064db57bfb191d5da0eaaa48a75406d6aecc2f40068559dffc3c7 WatchSource:0}: Error finding container d4c25faf970064db57bfb191d5da0eaaa48a75406d6aecc2f40068559dffc3c7: Status 404 returned error can't find the container with id d4c25faf970064db57bfb191d5da0eaaa48a75406d6aecc2f40068559dffc3c7
Sep 08 16:44:49.818583 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.818549    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:49.818663 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.818624    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:49.818701 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.818677    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:44:49.953773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.953733    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" event={"ID":"c31b5be8-24fa-4b5c-ab3c-017933f8c160","Type":"ContainerStarted","Data":"237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"}
Sep 08 16:44:49.953993 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.953802    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" event={"ID":"c31b5be8-24fa-4b5c-ab3c-017933f8c160","Type":"ContainerStarted","Data":"d4c25faf970064db57bfb191d5da0eaaa48a75406d6aecc2f40068559dffc3c7"}
Sep 08 16:44:49.986357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:49.986292    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podStartSLOduration=0.986269929 podStartE2EDuration="986.269929ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:44:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:44:49.981641045 +0000 UTC m=+857.970077056" watchObservedRunningTime="2026-09-08 16:44:49.986269929 +0000 UTC m=+857.974705942"
Sep 08 16:44:50.533056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:50.533012    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:50.539003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:50.538974    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:50.959471 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:50.959439    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:50.960579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:50.960559    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:44:51.349176 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:51.349074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:51.444136 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:51.444100    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:52.533175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:52.533125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:52.629664 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:52.629632    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:53.065550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.065520    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:53.163178 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.163144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:44:53.677275 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.677247    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:53.758154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758056    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8zsm\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-kube-api-access-n8zsm\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758110    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-podinfo\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758152    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-credential-socket\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758228    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-certs\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758251    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-data\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758268    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istiod-ca-cert\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758309    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-envoy\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-token\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-socket\") pod \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\" (UID: \"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4\") "
Sep 08 16:44:53.758741 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758464    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:53.758741 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758605    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:53.758741 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758615    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:53.759082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758798    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:53.759082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758816    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.759082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758858    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.759082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.758874    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.759297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.759185    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:44:53.760559 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.760532    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-kube-api-access-n8zsm" (OuterVolumeSpecName: "kube-api-access-n8zsm") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "kube-api-access-n8zsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:53.760685 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.760658    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:44:53.761022 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.761006    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:44:53.761281 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.761259    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" (UID: "1e86f880-33ad-4019-a6f8-fbd69ad3f2d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:44:53.861196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.861154    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8zsm\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-kube-api-access-n8zsm\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.861196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.861191    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.861196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.861203    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.861524 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.861214    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.861524 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.861225    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.861524 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.861235    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:44:53.981268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.981228    2581 generic.go:356] "Generic (PLEG): container finished" podID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerID="8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747" exitCode=0
Sep 08 16:44:53.981448 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.981284    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"
Sep 08 16:44:53.981448 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.981316    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" event={"ID":"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4","Type":"ContainerDied","Data":"8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747"}
Sep 08 16:44:53.981448 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.981376    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6" event={"ID":"1e86f880-33ad-4019-a6f8-fbd69ad3f2d4","Type":"ContainerDied","Data":"6ee09234fb583cc226d9458f21aa8b1b1f45bed546e457a86c3297804ad2e4e2"}
Sep 08 16:44:53.981448 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.981400    2581 scope.go:117] "RemoveContainer" containerID="8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747"
Sep 08 16:44:53.992057 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:53.992037    2581 scope.go:117] "RemoveContainer" containerID="d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"
Sep 08 16:44:54.002021 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.001996    2581 scope.go:117] "RemoveContainer" containerID="8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747"
Sep 08 16:44:54.002372 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:44:54.002353    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747\": container with ID starting with 8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747 not found: ID does not exist" containerID="8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747"
Sep 08 16:44:54.002421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.002388    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747"} err="failed to get container status \"8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747\": rpc error: code = NotFound desc = could not find container \"8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747\": container with ID starting with 8dfea7ef9009e1d361345d024e854eb95e09d857f79d1ff824f50cf517378747 not found: ID does not exist"
Sep 08 16:44:54.002421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.002410    2581 scope.go:117] "RemoveContainer" containerID="d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"
Sep 08 16:44:54.002708 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:44:54.002690    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3\": container with ID starting with d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3 not found: ID does not exist" containerID="d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"
Sep 08 16:44:54.002754 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.002716    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3"} err="failed to get container status \"d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3\": rpc error: code = NotFound desc = could not find container \"d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3\": container with ID starting with d2495860253d439a9cc7b292452ca6841b0d34d351a80cdf80045710880644a3 not found: ID does not exist"
Sep 08 16:44:54.007866 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.007818    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"]
Sep 08 16:44:54.013737 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.013669    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-fc1daf8b-gw-openshift-default-5ccd85bc68-6zkp6"]
Sep 08 16:44:54.471075 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:44:54.471032    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" path="/var/lib/kubelet/pods/1e86f880-33ad-4019-a6f8-fbd69ad3f2d4/volumes"
Sep 08 16:45:00.146634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.146591    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"]
Sep 08 16:45:00.147093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.147078    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy"
Sep 08 16:45:00.147144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.147095    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy"
Sep 08 16:45:00.147144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.147117    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy"
Sep 08 16:45:00.147144 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.147123    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy"
Sep 08 16:45:00.147238 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.147198    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy"
Sep 08 16:45:00.149371 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.149348    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"
Sep 08 16:45:00.152049 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.152021    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-886jf\""
Sep 08 16:45:00.162615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.162585    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"]
Sep 08 16:45:00.164268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.164241    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"
Sep 08 16:45:00.469202 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:45:00.469156    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31e2161d_a2ea_4f6c_9d48_5a7ba27031d5.slice/crio-d625e9390e4ef4a98acff34ecb70c0bc589a5aa6457078968f53475acb2bf4f8 WatchSource:0}: Error finding container d625e9390e4ef4a98acff34ecb70c0bc589a5aa6457078968f53475acb2bf4f8: Status 404 returned error can't find the container with id d625e9390e4ef4a98acff34ecb70c0bc589a5aa6457078968f53475acb2bf4f8
Sep 08 16:45:00.469939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:00.469913    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"]
Sep 08 16:45:01.028186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:01.028138    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw" event={"ID":"31e2161d-a2ea-4f6c-9d48-5a7ba27031d5","Type":"ContainerStarted","Data":"d625e9390e4ef4a98acff34ecb70c0bc589a5aa6457078968f53475acb2bf4f8"}
Sep 08 16:45:04.048737 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:04.048700    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw" event={"ID":"31e2161d-a2ea-4f6c-9d48-5a7ba27031d5","Type":"ContainerStarted","Data":"ccf4601c41ef5ee537822949c1e87c5022f04c38b1482bbfb724d9d4a56d237c"}
Sep 08 16:45:04.067501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:04.067444    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw" podStartSLOduration=1.450847097 podStartE2EDuration="4.067427003s" totalImagesPullingTime="2.616579906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:04.066420191 +0000 UTC m=+872.054856146" watchObservedRunningTime="2026-09-08 16:45:04.067427003 +0000 UTC m=+872.055862958"
Sep 08 16:45:05.055446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:05.055409    2581 generic.go:356] "Generic (PLEG): container finished" podID="31e2161d-a2ea-4f6c-9d48-5a7ba27031d5" containerID="ccf4601c41ef5ee537822949c1e87c5022f04c38b1482bbfb724d9d4a56d237c" exitCode=0
Sep 08 16:45:05.055918 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:05.055501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw" event={"ID":"31e2161d-a2ea-4f6c-9d48-5a7ba27031d5","Type":"ContainerDied","Data":"ccf4601c41ef5ee537822949c1e87c5022f04c38b1482bbfb724d9d4a56d237c"}
Sep 08 16:45:06.211295 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:06.211268    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"
Sep 08 16:45:07.002070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:07.002023    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:45:07.002268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:07.002090    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:45:07.070168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:07.070122    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw" event={"ID":"31e2161d-a2ea-4f6c-9d48-5a7ba27031d5","Type":"ContainerDied","Data":"d625e9390e4ef4a98acff34ecb70c0bc589a5aa6457078968f53475acb2bf4f8"}
Sep 08 16:45:07.070168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:07.070175    2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d625e9390e4ef4a98acff34ecb70c0bc589a5aa6457078968f53475acb2bf4f8"
Sep 08 16:45:07.070420 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:07.070138    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"
Sep 08 16:45:09.082543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:09.082505    2581 generic.go:356] "Generic (PLEG): container finished" podID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerID="237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870" exitCode=0
Sep 08 16:45:09.083023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:09.082574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" event={"ID":"c31b5be8-24fa-4b5c-ab3c-017933f8c160","Type":"ContainerDied","Data":"237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"}
Sep 08 16:45:09.083070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:09.083055    2581 scope.go:117] "RemoveContainer" containerID="237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"
Sep 08 16:45:09.084267 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:09.084240    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:09.084343 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:09.084313    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:09.084390 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:09.084347    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:10.093160 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:10.093118    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" event={"ID":"c31b5be8-24fa-4b5c-ab3c-017933f8c160","Type":"ContainerStarted","Data":"363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54"}
Sep 08 16:45:10.534031 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:10.533568    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:45:10.534031 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:10.533626    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:45:10.534031 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:10.533705    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 08 16:45:11.533941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:11.533894    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:45:11.534343 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:11.533974    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 08 16:45:12.534041 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:12.534001    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:45:12.534437 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:12.534064    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 08 16:45:13.533629 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:13.533590    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:45:13.533866 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:13.533658    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 08 16:45:14.533156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:14.533114    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:45:14.533550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:14.533179    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 08 16:45:15.434337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.434298    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"]
Sep 08 16:45:15.434925 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.434905    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31e2161d-a2ea-4f6c-9d48-5a7ba27031d5" containerName="cleanup"
Sep 08 16:45:15.434925 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.434926    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="31e2161d-a2ea-4f6c-9d48-5a7ba27031d5" containerName="cleanup"
Sep 08 16:45:15.435088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.435024    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="31e2161d-a2ea-4f6c-9d48-5a7ba27031d5" containerName="cleanup"
Sep 08 16:45:15.435088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.435042    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e86f880-33ad-4019-a6f8-fbd69ad3f2d4" containerName="istio-proxy"
Sep 08 16:45:15.439149 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.439120    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.442253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.442059    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c9b098\"/\"openshift-service-ca.crt\""
Sep 08 16:45:15.442253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.442243    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-c9b098\"/\"kube-root-ca.crt\""
Sep 08 16:45:15.443172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.443145    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c9b098\"/\"default-dockercfg-wkxqc\""
Sep 08 16:45:15.443293 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.443232    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-c9b098\"/\"test-model-c9b098-kserve-self-signed-certs\""
Sep 08 16:45:15.451717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.451688    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"]
Sep 08 16:45:15.473080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.473048    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:15.502948 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.502915    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9adef94d-a055-4924-8d00-53f7f375d8ea-tls-certs\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.502948 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.502954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-dshm\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.503166 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.503095    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fztrf\" (UniqueName: \"kubernetes.io/projected/9adef94d-a055-4924-8d00-53f7f375d8ea-kube-api-access-fztrf\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.503166 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.503126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-home\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.503239 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.503184    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-tmp-dir\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.503239 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.503214    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-model-cache\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.533592 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.533561    2581 patch_prober.go:28] interesting pod/e2e-ait-30506528-openshift-default-856bdc489d-f84gp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body=
Sep 08 16:45:15.533961 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.533629    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused"
Sep 08 16:45:15.604856 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.604796    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9adef94d-a055-4924-8d00-53f7f375d8ea-tls-certs\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.605053 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.604888    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-dshm\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.605053 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.605023    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fztrf\" (UniqueName: \"kubernetes.io/projected/9adef94d-a055-4924-8d00-53f7f375d8ea-kube-api-access-fztrf\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.605174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.605053    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-home\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.605174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.605105    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-tmp-dir\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.605174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.605142    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-model-cache\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.605618 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.605592    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-model-cache\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.606286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.606262    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-home\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.606676 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.606655    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-tmp-dir\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.615781 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.615730    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fztrf\" (UniqueName: \"kubernetes.io/projected/9adef94d-a055-4924-8d00-53f7f375d8ea-kube-api-access-fztrf\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.616575 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.616548    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9adef94d-a055-4924-8d00-53f7f375d8ea-tls-certs\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.616807 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.616786    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-dshm\") pod \"test-model-c9b098-kserve-7c76d594f5-svrjz\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") " pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:15.754181 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:15.754083    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:16.025886 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.025860    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"]
Sep 08 16:45:16.027603 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:45:16.027570    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9adef94d_a055_4924_8d00_53f7f375d8ea.slice/crio-0334b7265914a8b7ecbb66ed0e5262fc8be32076b33b5ad0b31b90a7fcb8c781 WatchSource:0}: Error finding container 0334b7265914a8b7ecbb66ed0e5262fc8be32076b33b5ad0b31b90a7fcb8c781: Status 404 returned error can't find the container with id 0334b7265914a8b7ecbb66ed0e5262fc8be32076b33b5ad0b31b90a7fcb8c781
Sep 08 16:45:16.137793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.137750    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz" event={"ID":"9adef94d-a055-4924-8d00-53f7f375d8ea","Type":"ContainerStarted","Data":"26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c"}
Sep 08 16:45:16.137793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.137792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz" event={"ID":"9adef94d-a055-4924-8d00-53f7f375d8ea","Type":"ContainerStarted","Data":"0334b7265914a8b7ecbb66ed0e5262fc8be32076b33b5ad0b31b90a7fcb8c781"}
Sep 08 16:45:16.156206 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.156146    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz" podStartSLOduration=1.156127163 podStartE2EDuration="1.156127163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:16.154462977 +0000 UTC m=+884.142898935" watchObservedRunningTime="2026-09-08 16:45:16.156127163 +0000 UTC m=+884.144563117"
Sep 08 16:45:16.537512 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.537481    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:45:16.537928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.537771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:45:16.538538 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:16.538518    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:45:17.453970 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:17.453931    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:18.743187 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:18.743153    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:18.949515 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:18.949465    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:19.740601 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:19.740523    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:22.835652 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:22.835619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:23.615385 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:23.615313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:23.715159 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:23.715124    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:23.814296 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:23.814263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:23.913950 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:23.913826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:25.114801 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.114765    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"]
Sep 08 16:45:25.115307 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.115041    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy" containerID="cri-o://363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54" gracePeriod=30
Sep 08 16:45:25.147942 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.147909    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:25.589934 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.589895    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:25.754941 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.754908    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:25.755118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.754961    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:25.767572 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.767538    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:25.896168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.896066    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"]
Sep 08 16:45:25.902556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.902525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.904947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.904919    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-773b1848-openshift-default-dockercfg-ktlzg\""
Sep 08 16:45:25.921649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.921612    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"]
Sep 08 16:45:25.922119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922097    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-podinfo\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922283 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxv2l\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-kube-api-access-jxv2l\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922283 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922217    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-socket\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922366 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922281    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-token\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922366 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-envoy\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922445 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922383    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istiod-ca-cert\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922445 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922410    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-credential-socket\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922444    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-data\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.922519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.922489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-certs\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:25.928887 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:25.928821    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:26.023346 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023307    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-envoy\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istiod-ca-cert\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023415    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-credential-socket\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023450    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-data\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023492    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-certs\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023560    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-podinfo\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023629    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxv2l\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-kube-api-access-jxv2l\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023662    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-socket\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.023772 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023700    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-token\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.024020 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-credential-socket\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.024020 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.023985    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-data\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.024254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.024227    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istiod-ca-cert\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.024254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.024237    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-socket\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.024504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.024476    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-certs\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.024890 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.024867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:26.026706 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.026675    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-envoy\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.026871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.026817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-podinfo\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.032537 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.032501    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-token\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.032661 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.032630    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxv2l\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-kube-api-access-jxv2l\") pod \"e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") " pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.209037 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.209007    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:45:26.214168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.214142    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:26.503421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.503393    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"]
Sep 08 16:45:26.505911 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:45:26.505881    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae3c66a6_0042_4351_b4ae_057237a8a0a2.slice/crio-0e7ead4cb3440896f9a8cf885c25214e6b868fe6645deab7c27750422c293e89 WatchSource:0}: Error finding container 0e7ead4cb3440896f9a8cf885c25214e6b868fe6645deab7c27750422c293e89: Status 404 returned error can't find the container with id 0e7ead4cb3440896f9a8cf885c25214e6b868fe6645deab7c27750422c293e89
Sep 08 16:45:26.508124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.508089    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:26.508192 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.508170    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:26.508242 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:26.508197    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:27.205082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:27.205040    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" event={"ID":"ae3c66a6-0042-4351-b4ae-057237a8a0a2","Type":"ContainerStarted","Data":"1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"}
Sep 08 16:45:27.205271 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:27.205102    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" event={"ID":"ae3c66a6-0042-4351-b4ae-057237a8a0a2","Type":"ContainerStarted","Data":"0e7ead4cb3440896f9a8cf885c25214e6b868fe6645deab7c27750422c293e89"}
Sep 08 16:45:27.214729 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:27.214698    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:27.220105 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:27.220078    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:27.230151 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:27.230100    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podStartSLOduration=2.230082533 podStartE2EDuration="2.230082533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:27.226430064 +0000 UTC m=+895.214866017" watchObservedRunningTime="2026-09-08 16:45:27.230082533 +0000 UTC m=+895.218518487"
Sep 08 16:45:28.210729 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:28.210695    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:28.211710 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:28.211690    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:28.494188 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:28.494094    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:28.607373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:28.607325    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:28.695179 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:28.695150    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:29.483806 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:29.483755    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:29.578492 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:29.578455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:29.677009 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:29.676973    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:30.170517 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.170482    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:30.240953 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.240899    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:30.398457 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.398426    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:45:30.479666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479636    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-token\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.479921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479690    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6sgm\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-kube-api-access-n6sgm\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.479921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479782    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-envoy\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.479921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479828    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-socket\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.479921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479871    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istiod-ca-cert\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.480150 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479922    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-credential-socket\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.480150 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.479975    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-podinfo\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.480150 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480037    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-data\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.480150 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480084    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-certs\") pod \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\" (UID: \"c31b5be8-24fa-4b5c-ab3c-017933f8c160\") "
Sep 08 16:45:30.480150 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480125    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:30.480386 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480286    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:45:30.480446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480379    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-data" (OuterVolumeSpecName: "istio-data") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:30.480552 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480527    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:30.480616 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480557    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:30.480682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480663    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.480723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480690    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.480723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480705    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.480723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480718    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.480921 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.480730    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.482243 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.482208    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-token" (OuterVolumeSpecName: "istio-token") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:30.482485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.482462    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-kube-api-access-n6sgm" (OuterVolumeSpecName: "kube-api-access-n6sgm") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "kube-api-access-n6sgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:30.482660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.482628    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:30.482774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.482691    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c31b5be8-24fa-4b5c-ab3c-017933f8c160" (UID: "c31b5be8-24fa-4b5c-ab3c-017933f8c160"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:45:30.581940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.581897    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.581940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.581933    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.581940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.581941    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.581940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.581950    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6sgm\" (UniqueName: \"kubernetes.io/projected/c31b5be8-24fa-4b5c-ab3c-017933f8c160-kube-api-access-n6sgm\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:30.596787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.596728    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:30.714995 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.714959    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:30.813913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.813882    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:30.913827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:30.913781    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:31.230669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.230629    2581 generic.go:356] "Generic (PLEG): container finished" podID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerID="363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54" exitCode=0
Sep 08 16:45:31.230903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.230684    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"
Sep 08 16:45:31.230903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.230716    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" event={"ID":"c31b5be8-24fa-4b5c-ab3c-017933f8c160","Type":"ContainerDied","Data":"363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54"}
Sep 08 16:45:31.230903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.230774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp" event={"ID":"c31b5be8-24fa-4b5c-ab3c-017933f8c160","Type":"ContainerDied","Data":"d4c25faf970064db57bfb191d5da0eaaa48a75406d6aecc2f40068559dffc3c7"}
Sep 08 16:45:31.230903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.230798    2581 scope.go:117] "RemoveContainer" containerID="363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54"
Sep 08 16:45:31.242107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.241906    2581 scope.go:117] "RemoveContainer" containerID="237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"
Sep 08 16:45:31.252024 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.251998    2581 scope.go:117] "RemoveContainer" containerID="363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54"
Sep 08 16:45:31.252402 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:45:31.252382    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54\": container with ID starting with 363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54 not found: ID does not exist" containerID="363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54"
Sep 08 16:45:31.252462 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.252417    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54"} err="failed to get container status \"363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54\": rpc error: code = NotFound desc = could not find container \"363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54\": container with ID starting with 363d4ac8568b4279c5733e462c0146f175d81cb265f102a33eec7a4234e65d54 not found: ID does not exist"
Sep 08 16:45:31.252462 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.252437    2581 scope.go:117] "RemoveContainer" containerID="237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"
Sep 08 16:45:31.252734 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:45:31.252715    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870\": container with ID starting with 237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870 not found: ID does not exist" containerID="237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"
Sep 08 16:45:31.252795 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.252742    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870"} err="failed to get container status \"237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870\": rpc error: code = NotFound desc = could not find container \"237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870\": container with ID starting with 237d6cfcfd8fff39d503e5ec0eae9777fc9c02ff5f12d673bde969536b003870 not found: ID does not exist"
Sep 08 16:45:31.258489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.258457    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"]
Sep 08 16:45:31.266642 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:31.266606    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-30506528-openshift-default-856bdc489d-f84gp"]
Sep 08 16:45:32.457571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:32.457545    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:45:32.458061 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:32.457603    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:45:32.467826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:32.467794    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" path="/var/lib/kubelet/pods/c31b5be8-24fa-4b5c-ab3c-017933f8c160/volumes"
Sep 08 16:45:37.118117 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:37.118079    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:37.255303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:37.255247    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:37.380954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:37.380865    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"]
Sep 08 16:45:37.381156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:37.381132    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy" containerID="cri-o://19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58" gracePeriod=30
Sep 08 16:45:37.392849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:37.392802    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:37.868992 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:37.868947    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:38.245859 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.245438    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"]
Sep 08 16:45:38.246358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.246212    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy"
Sep 08 16:45:38.246358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.246237    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy"
Sep 08 16:45:38.246469 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.246391    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy"
Sep 08 16:45:38.261350 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.260180    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.267347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.267221    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-fae677-openshift-default-dockercfg-q6r7m\""
Sep 08 16:45:38.287676 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.287635    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"]
Sep 08 16:45:38.296516 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.296485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375436    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-token\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375495    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a44dc569-3879-4a4f-b6bd-88f3c3793608-istiod-ca-cert\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-credential-socket\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375603    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-certs\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375694    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-podinfo\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375730    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wphc4\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-kube-api-access-wphc4\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375759    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-envoy\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375789    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-data\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.376898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.375867    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-socket\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477380 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477343    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-envoy\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-data\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477459    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-socket\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477586 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-token\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a44dc569-3879-4a4f-b6bd-88f3c3793608-istiod-ca-cert\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477696    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-credential-socket\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477765    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-certs\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477800    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-data\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.477904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-socket\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.478083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477916    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-podinfo\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.478083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.477963    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wphc4\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-kube-api-access-wphc4\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.478191 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.478096    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-certs\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.478251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.478229    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-credential-socket\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.478438 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.478382    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a44dc569-3879-4a4f-b6bd-88f3c3793608-istiod-ca-cert\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.479057 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.479032    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:38.480203 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.480182    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-envoy\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.480493 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.480477    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-podinfo\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.502388 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.502277    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-token\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.504154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.504089    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wphc4\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-kube-api-access-wphc4\") pod \"e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") " pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.577983 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.577948    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:38.894538 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.894474    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"]
Sep 08 16:45:38.897312 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:45:38.897276    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda44dc569_3879_4a4f_b6bd_88f3c3793608.slice/crio-c18b4fcb707d373c28da67c430102c61e4eac9264a699802efe5b085e2e665c6 WatchSource:0}: Error finding container c18b4fcb707d373c28da67c430102c61e4eac9264a699802efe5b085e2e665c6: Status 404 returned error can't find the container with id c18b4fcb707d373c28da67c430102c61e4eac9264a699802efe5b085e2e665c6
Sep 08 16:45:38.899632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.899598    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:38.899727 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.899687    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:38.899784 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:38.899731    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:39.286756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:39.286721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" event={"ID":"a44dc569-3879-4a4f-b6bd-88f3c3793608","Type":"ContainerStarted","Data":"d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"}
Sep 08 16:45:39.287170 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:39.286774    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" event={"ID":"a44dc569-3879-4a4f-b6bd-88f3c3793608","Type":"ContainerStarted","Data":"c18b4fcb707d373c28da67c430102c61e4eac9264a699802efe5b085e2e665c6"}
Sep 08 16:45:39.318370 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:39.318293    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podStartSLOduration=1.318267787 podStartE2EDuration="1.318267787s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:45:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:45:39.315772357 +0000 UTC m=+907.304208387" watchObservedRunningTime="2026-09-08 16:45:39.318267787 +0000 UTC m=+907.306703743"
Sep 08 16:45:39.578438 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:39.578342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:39.584121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:39.584090    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:40.292799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:40.292762    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:40.293775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:40.293758    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:45:41.445140 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:41.445103    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:41.614167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:41.614128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:42.681947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.681908    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:45:42.827865 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.825765    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:42.833426 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833394    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-credential-socket\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.833638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833460    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-podinfo\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.833638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833495    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-certs\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.833638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833526    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5zlx\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-kube-api-access-h5zlx\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.833638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833582    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-socket\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.833638 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833610    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-envoy\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.833943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833663    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-data\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.834006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833689    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:42.834006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833825    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:42.834006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.833977    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:42.834166 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834004    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:42.834220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834160    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-token\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.834220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834206    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istiod-ca-cert\") pod \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\" (UID: \"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb\") "
Sep 08 16:45:42.834631 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834613    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.834720 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834636    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.834720 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834650    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.834720 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834661    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.834915 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.834897    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:45:42.836103 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.836074    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:45:42.836278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.836260    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-kube-api-access-h5zlx" (OuterVolumeSpecName: "kube-api-access-h5zlx") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "kube-api-access-h5zlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:42.836529 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.836505    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:45:42.836643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.836621    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" (UID: "fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:45:42.908238 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.908125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:42.935540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.935494    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.935540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.935531    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.935540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.935546    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.935788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.935555    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:42.935788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:42.935564    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5zlx\" (UniqueName: \"kubernetes.io/projected/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb-kube-api-access-h5zlx\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:45:43.012615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.012535    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:43.322340 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.322295    2581 generic.go:356] "Generic (PLEG): container finished" podID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerID="19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58" exitCode=0
Sep 08 16:45:43.322678 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.322651    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" event={"ID":"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb","Type":"ContainerDied","Data":"19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58"}
Sep 08 16:45:43.322876 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.322858    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw" event={"ID":"fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb","Type":"ContainerDied","Data":"9346ed285c2397699314cd0bdc6c087f3126e9eec324249f7fb1b2c1d08395f8"}
Sep 08 16:45:43.323004 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.322991    2581 scope.go:117] "RemoveContainer" containerID="19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58"
Sep 08 16:45:43.323302 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.323284    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"
Sep 08 16:45:43.344241 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.344219    2581 scope.go:117] "RemoveContainer" containerID="4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"
Sep 08 16:45:43.350695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.350666    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"]
Sep 08 16:45:43.354885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.354854    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-4cea93-openshift-default-f559bdc44-l62kw"]
Sep 08 16:45:43.355485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.355469    2581 scope.go:117] "RemoveContainer" containerID="19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58"
Sep 08 16:45:43.355828 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:45:43.355802    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58\": container with ID starting with 19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58 not found: ID does not exist" containerID="19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58"
Sep 08 16:45:43.356002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.355855    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58"} err="failed to get container status \"19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58\": rpc error: code = NotFound desc = could not find container \"19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58\": container with ID starting with 19df84f4790da14fb88b71bc57fa5d4ad461d244631691625b301f9c6a39ff58 not found: ID does not exist"
Sep 08 16:45:43.356002 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.355882    2581 scope.go:117] "RemoveContainer" containerID="4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"
Sep 08 16:45:43.356228 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:45:43.356209    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50\": container with ID starting with 4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50 not found: ID does not exist" containerID="4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"
Sep 08 16:45:43.356274 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.356234    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50"} err="failed to get container status \"4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50\": rpc error: code = NotFound desc = could not find container \"4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50\": container with ID starting with 4d2ee08c202a9bade15bf98f867a997fcac397141c2c564bfef847b974abca50 not found: ID does not exist"
Sep 08 16:45:43.463935 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.463886    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:43.557849 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:43.557807    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:44.470914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:44.470869    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" path="/var/lib/kubelet/pods/fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb/volumes"
Sep 08 16:45:47.349135 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:47.349099    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerID="1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d" exitCode=0
Sep 08 16:45:47.349601 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:47.349174    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" event={"ID":"ae3c66a6-0042-4351-b4ae-057237a8a0a2","Type":"ContainerDied","Data":"1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"}
Sep 08 16:45:47.349667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:47.349611    2581 scope.go:117] "RemoveContainer" containerID="1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"
Sep 08 16:45:47.350897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:47.350866    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:47.351024 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:47.350935    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:47.351024 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:47.350964    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:45:48.356979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:48.356946    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" event={"ID":"ae3c66a6-0042-4351-b4ae-057237a8a0a2","Type":"ContainerStarted","Data":"0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597"}
Sep 08 16:45:49.215293 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:49.215252    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:49.215712 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:49.215605    2581 patch_prober.go:28] interesting pod/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 16:45:49.215943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:49.215915    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 16:45:50.214827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:50.214786    2581 patch_prober.go:28] interesting pod/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 16:45:50.215457 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:50.215421    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 16:45:51.192539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:51.192499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:45:51.215280 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:51.215241    2581 patch_prober.go:28] interesting pod/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 16:45:51.215899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:51.215862    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 16:45:52.214803 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:52.214761    2581 patch_prober.go:28] interesting pod/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 16:45:52.215172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:52.215135    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 16:45:53.214821 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:53.214778    2581 patch_prober.go:28] interesting pod/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 08 16:45:53.215473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:53.215439    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 08 16:45:54.218574 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:54.218539    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:54.219072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:54.218846    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:45:54.219632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:45:54.219616    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:46:00.750356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:00.750304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:01.015490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:01.015324    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"]
Sep 08 16:46:01.015667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:01.015577    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy" containerID="cri-o://0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597" gracePeriod=30
Sep 08 16:46:03.521984 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:03.521948    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:04.007625 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.007593    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:04.459498 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.459466    2581 generic.go:356] "Generic (PLEG): container finished" podID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerID="d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347" exitCode=0
Sep 08 16:46:04.459722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.459541    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" event={"ID":"a44dc569-3879-4a4f-b6bd-88f3c3793608","Type":"ContainerDied","Data":"d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"}
Sep 08 16:46:04.460069 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.460054    2581 scope.go:117] "RemoveContainer" containerID="d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"
Sep 08 16:46:04.461300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.461257    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:46:04.461379 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.461352    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:46:04.461415 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:04.461383    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:46:05.467265 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:05.467233    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" event={"ID":"a44dc569-3879-4a4f-b6bd-88f3c3793608","Type":"ContainerStarted","Data":"16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7"}
Sep 08 16:46:05.579074 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:05.579033    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:46:05.580172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:05.580141    2581 patch_prober.go:28] interesting pod/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 16:46:05.580306 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:05.580197    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 16:46:06.295197 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.295125    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:46:06.350012 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.349975    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429272    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-token\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-socket\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429401    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-certs\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429433    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-podinfo\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429483    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxv2l\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-kube-api-access-jxv2l\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429512    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-credential-socket\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429799    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429902    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-data\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429943    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istiod-ca-cert\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.429976    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-envoy\") pod \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\" (UID: \"ae3c66a6-0042-4351-b4ae-057237a8a0a2\") "
Sep 08 16:46:06.430409 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.430158    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:06.431163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.430492    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.431163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.430514    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.431163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.430780    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:46:06.431163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.430953    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:06.431163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.431091    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:06.433860 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.432747    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:06.435677 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.435631    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-kube-api-access-jxv2l" (OuterVolumeSpecName: "kube-api-access-jxv2l") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "kube-api-access-jxv2l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:46:06.436298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.436254    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:46:06.437760 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.437719    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae3c66a6-0042-4351-b4ae-057237a8a0a2" (UID: "ae3c66a6-0042-4351-b4ae-057237a8a0a2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:46:06.474549 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.474513    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerID="0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597" exitCode=0
Sep 08 16:46:06.475003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.474557    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"
Sep 08 16:46:06.475003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.474590    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" event={"ID":"ae3c66a6-0042-4351-b4ae-057237a8a0a2","Type":"ContainerDied","Data":"0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597"}
Sep 08 16:46:06.475003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.474646    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4" event={"ID":"ae3c66a6-0042-4351-b4ae-057237a8a0a2","Type":"ContainerDied","Data":"0e7ead4cb3440896f9a8cf885c25214e6b868fe6645deab7c27750422c293e89"}
Sep 08 16:46:06.475003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.474678    2581 scope.go:117] "RemoveContainer" containerID="0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597"
Sep 08 16:46:06.483969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.483950    2581 scope.go:117] "RemoveContainer" containerID="1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"
Sep 08 16:46:06.493823 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.493795    2581 scope.go:117] "RemoveContainer" containerID="0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597"
Sep 08 16:46:06.494205 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:46:06.494177    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597\": container with ID starting with 0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597 not found: ID does not exist" containerID="0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597"
Sep 08 16:46:06.494303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.494214    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597"} err="failed to get container status \"0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597\": rpc error: code = NotFound desc = could not find container \"0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597\": container with ID starting with 0b2626cf2ec69c0e80a617b1e41d88687393776f381a02f83f3b257c718fe597 not found: ID does not exist"
Sep 08 16:46:06.494303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.494237    2581 scope.go:117] "RemoveContainer" containerID="1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"
Sep 08 16:46:06.494572 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:46:06.494554    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d\": container with ID starting with 1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d not found: ID does not exist" containerID="1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"
Sep 08 16:46:06.494619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.494579    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d"} err="failed to get container status \"1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d\": rpc error: code = NotFound desc = could not find container \"1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d\": container with ID starting with 1490e3d436dc689e42d6164c6c89a838ee1b4e8b48670b7ffc4e1b257e2caf2d not found: ID does not exist"
Sep 08 16:46:06.494908 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.494883    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"]
Sep 08 16:46:06.497814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.497793    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-773b1848-openshift-default-685c6cdf7b-8zsf4"]
Sep 08 16:46:06.531855 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531810    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.531855 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531856    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.531855 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531865    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.532098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531875    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.532098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531884    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxv2l\" (UniqueName: \"kubernetes.io/projected/ae3c66a6-0042-4351-b4ae-057237a8a0a2-kube-api-access-jxv2l\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.532098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531892    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.532098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.531900    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae3c66a6-0042-4351-b4ae-057237a8a0a2-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:46:06.578463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.578362    2581 patch_prober.go:28] interesting pod/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 16:46:06.578463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:06.578419    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 16:46:07.579227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:07.579189    2581 patch_prober.go:28] interesting pod/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 16:46:07.579649 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:07.579247    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 16:46:08.468437 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:08.468402    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" path="/var/lib/kubelet/pods/ae3c66a6-0042-4351-b4ae-057237a8a0a2/volumes"
Sep 08 16:46:08.579149 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:08.579115    2581 patch_prober.go:28] interesting pod/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 16:46:08.579333 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:08.579172    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 16:46:09.384355 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.384315    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:09.450233 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.450193    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:09.534864 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.534798    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:09.578589 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.578551    2581 patch_prober.go:28] interesting pod/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 16:46:09.578771 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.578612    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 16:46:09.643693 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.643600    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:09.798375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.798336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:09.925863 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:09.925624    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:10.105658 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:10.105618    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:10.293462 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:10.293427    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:46:10.579133 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:10.579036    2581 patch_prober.go:28] interesting pod/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 16:46:10.579413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:10.579376    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 16:46:11.582365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:11.582334    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:46:11.583627 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:11.583608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:46:20.204449 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:20.204412    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:36.089507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:36.089466    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:41.996486 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:41.996445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:42.108906 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:42.108871    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:42.197398 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:42.197367    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:46.116388 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:46.116346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:47.180446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:47.180415    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:46:58.054420 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:46:58.054336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:02.657300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:02.657269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:03.000993 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:03.000951    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:04.502023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:04.501983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:04.571501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:04.571469    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:04.656214 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:04.656180    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:04.756455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:04.756375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.344052 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:13.343995    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.415763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:13.415731    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.515375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:13.515342    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.573922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:13.573884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:13.929028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:13.928996    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:15.213775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:15.213741    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:15.999198 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:15.999165    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:19.843005 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:19.842964    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:19.912423 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:19.912390    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:20.081957 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.081914    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"]
Sep 08 16:47:20.082212 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.082185    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy" containerID="cri-o://16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7" gracePeriod=30
Sep 08 16:47:20.097108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.097023    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:20.515727 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.515691    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:20.775137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775051    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"]
Sep 08 16:47:20.775650 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775633    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy"
Sep 08 16:47:20.775698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775653    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy"
Sep 08 16:47:20.775698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775670    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy"
Sep 08 16:47:20.775698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775677    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy"
Sep 08 16:47:20.775698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775686    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy"
Sep 08 16:47:20.775698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775691    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775704    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775710    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775772    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775780    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775786    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31b5be8-24fa-4b5c-ab3c-017933f8c160" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775792    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae3c66a6-0042-4351-b4ae-057237a8a0a2" containerName="istio-proxy"
Sep 08 16:47:20.775878 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.775801    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy"
Sep 08 16:47:20.779459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.779432    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.781969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.781946    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-51b8ca-openshift-default-dockercfg-r4ljc\""
Sep 08 16:47:20.792288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.792259    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"]
Sep 08 16:47:20.822024 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.821984    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-podinfo\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822202 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822038    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-envoy\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822202 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822080    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-token\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822202 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822111    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-socket\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822202 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-certs\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5f5x\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-kube-api-access-z5f5x\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822286    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-credential-socket\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822399 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822384    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istiod-ca-cert\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.822434 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.822417    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-data\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.922987 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.922946    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-envoy\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.922987 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.922989    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-token\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-socket\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923045    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-certs\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923109    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5f5x\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-kube-api-access-z5f5x\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923148    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-credential-socket\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istiod-ca-cert\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923383    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-data\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923465    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-podinfo\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923478    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-certs\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923515    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-credential-socket\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923554    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-socket\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.923954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923748    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-data\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.924072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.923984    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istiod-ca-cert\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.925505 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.925481    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-envoy\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.926270 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.926253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-podinfo\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.932261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.932223    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-token\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:20.932394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:20.932317    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5f5x\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-kube-api-access-z5f5x\") pod \"e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") " pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:21.091481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.091398    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:21.129742 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.129698    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:21.285353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.279332    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:21.371792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.371713    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"]
Sep 08 16:47:21.374405 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:47:21.374359    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5288ff_0e6b_4ec8_b37f_03596dab6e2d.slice/crio-f66fac9e2dbef70d598e5e3636f10360048c0bbb48ebf3c5b7ad9c8bbc800ff8 WatchSource:0}: Error finding container f66fac9e2dbef70d598e5e3636f10360048c0bbb48ebf3c5b7ad9c8bbc800ff8: Status 404 returned error can't find the container with id f66fac9e2dbef70d598e5e3636f10360048c0bbb48ebf3c5b7ad9c8bbc800ff8
Sep 08 16:47:21.377012 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.376973    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:47:21.377139 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.377052    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:47:21.377139 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.377090    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:47:21.914631 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.914593    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" event={"ID":"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d","Type":"ContainerStarted","Data":"7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f"}
Sep 08 16:47:21.914821 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.914690    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" event={"ID":"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d","Type":"ContainerStarted","Data":"f66fac9e2dbef70d598e5e3636f10360048c0bbb48ebf3c5b7ad9c8bbc800ff8"}
Sep 08 16:47:21.935343 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:21.935281    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" podStartSLOduration=1.93525887 podStartE2EDuration="1.93525887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:47:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:47:21.933754234 +0000 UTC m=+1009.922190215" watchObservedRunningTime="2026-09-08 16:47:21.93525887 +0000 UTC m=+1009.923694823"
Sep 08 16:47:22.092041 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.091995    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:22.097347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.097317    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:22.220153 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.220117    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.317792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.317762    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.412937 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.412903    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.561454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.561369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.669393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.669360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.761846 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.761812    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.862014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.861919    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:22.920142 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.920109    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:22.921201 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:22.921179    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:47:23.548258 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:23.548225    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:23.653852 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:23.653805    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:23.753400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:23.753361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:25.151853 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.151804    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:25.347468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.347390    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:47:25.371729 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.371689    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-credential-socket\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.371947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.371778    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-certs\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.371947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.371806    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wphc4\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-kube-api-access-wphc4\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.371947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.371913    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-data\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.372121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.371966    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-token\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.372121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372003    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-envoy\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.372121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372047    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:25.372121 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372061    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a44dc569-3879-4a4f-b6bd-88f3c3793608-istiod-ca-cert\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.372327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372125    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:25.372327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372149    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-socket\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.372327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372167    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-data" (OuterVolumeSpecName: "istio-data") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:25.372327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372208    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-podinfo\") pod \"a44dc569-3879-4a4f-b6bd-88f3c3793608\" (UID: \"a44dc569-3879-4a4f-b6bd-88f3c3793608\") "
Sep 08 16:47:25.372327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372312    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:25.372596 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372341    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a44dc569-3879-4a4f-b6bd-88f3c3793608-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:47:25.372792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372745    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a44dc569-3879-4a4f-b6bd-88f3c3793608-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.372792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372770    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.372792 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372793    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.373056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372809    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.373056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.372821    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.375264 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.375228    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:47:25.375669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.375633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-token" (OuterVolumeSpecName: "istio-token") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:25.375669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.375644    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:47:25.375983 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.375964    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-kube-api-access-wphc4" (OuterVolumeSpecName: "kube-api-access-wphc4") pod "a44dc569-3879-4a4f-b6bd-88f3c3793608" (UID: "a44dc569-3879-4a4f-b6bd-88f3c3793608"). InnerVolumeSpecName "kube-api-access-wphc4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:47:25.473725 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.473681    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.473725 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.473717    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.473725 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.473726    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a44dc569-3879-4a4f-b6bd-88f3c3793608-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.473725 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.473736    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wphc4\" (UniqueName: \"kubernetes.io/projected/a44dc569-3879-4a4f-b6bd-88f3c3793608-kube-api-access-wphc4\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:47:25.937769 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.937730    2581 generic.go:356] "Generic (PLEG): container finished" podID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerID="16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7" exitCode=0
Sep 08 16:47:25.938017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.937784    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"
Sep 08 16:47:25.938017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.937785    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" event={"ID":"a44dc569-3879-4a4f-b6bd-88f3c3793608","Type":"ContainerDied","Data":"16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7"}
Sep 08 16:47:25.938017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.937870    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt" event={"ID":"a44dc569-3879-4a4f-b6bd-88f3c3793608","Type":"ContainerDied","Data":"c18b4fcb707d373c28da67c430102c61e4eac9264a699802efe5b085e2e665c6"}
Sep 08 16:47:25.938017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.937904    2581 scope.go:117] "RemoveContainer" containerID="16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7"
Sep 08 16:47:25.951247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.951221    2581 scope.go:117] "RemoveContainer" containerID="d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"
Sep 08 16:47:25.959794 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.959759    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"]
Sep 08 16:47:25.961076 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.961040    2581 scope.go:117] "RemoveContainer" containerID="16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7"
Sep 08 16:47:25.961713 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:47:25.961587    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7\": container with ID starting with 16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7 not found: ID does not exist" containerID="16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7"
Sep 08 16:47:25.961713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.961636    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7"} err="failed to get container status \"16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7\": rpc error: code = NotFound desc = could not find container \"16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7\": container with ID starting with 16058a5aab37869488148e8dd57ffae994aa3887a041186baa8fad489845b2a7 not found: ID does not exist"
Sep 08 16:47:25.961713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.961661    2581 scope.go:117] "RemoveContainer" containerID="d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"
Sep 08 16:47:25.962373 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:47:25.962353    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347\": container with ID starting with d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347 not found: ID does not exist" containerID="d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"
Sep 08 16:47:25.962453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.962377    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347"} err="failed to get container status \"d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347\": rpc error: code = NotFound desc = could not find container \"d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347\": container with ID starting with d6824e99b49fcf25e0782d26c636bcf16111e1c6c6a08928e02522d013e57347 not found: ID does not exist"
Sep 08 16:47:25.964048 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:25.964027    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-fae677-openshift-default-f89f64fb-cq6vt"]
Sep 08 16:47:26.475288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:26.475253    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" path="/var/lib/kubelet/pods/a44dc569-3879-4a4f-b6bd-88f3c3793608/volumes"
Sep 08 16:47:31.105326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:31.105289    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:31.205713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:31.205682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:31.809249 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:31.809211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:37.936592 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:37.936551    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:38.005444 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.005399    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:38.211063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.210972    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:38.457999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.457966    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"]
Sep 08 16:47:38.458468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458451    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy"
Sep 08 16:47:38.458548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458470    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy"
Sep 08 16:47:38.458548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458489    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy"
Sep 08 16:47:38.458548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458497    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd31b1f3-f6a3-42dc-8496-8b30e1c63ccb" containerName="istio-proxy"
Sep 08 16:47:38.458548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458508    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy"
Sep 08 16:47:38.458548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458517    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy"
Sep 08 16:47:38.458779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458650    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy"
Sep 08 16:47:38.458779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.458662    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a44dc569-3879-4a4f-b6bd-88f3c3793608" containerName="istio-proxy"
Sep 08 16:47:38.473721 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.473626    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.479655 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.479628    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bdae4bb7-openshift-default-dockercfg-xdm7g\""
Sep 08 16:47:38.483180 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.483154    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"]
Sep 08 16:47:38.499208 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.499175    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:38.610404 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610358    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-podinfo\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610423    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-envoy\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610503    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-certs\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610518    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzm4t\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-kube-api-access-wzm4t\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-data\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610579 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610571    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5efa0171-0b71-4cc3-af4e-38866e8015d2-istiod-ca-cert\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610804 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610621    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-token\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610804 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610675    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-credential-socket\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.610804 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.610710    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-socket\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712271 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712232    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-socket\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712288    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-podinfo\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-envoy\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712419    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-certs\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712460 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzm4t\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-kube-api-access-wzm4t\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-data\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5efa0171-0b71-4cc3-af4e-38866e8015d2-istiod-ca-cert\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712551    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-token\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-credential-socket\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712679    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-socket\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712738    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-certs\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.712904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712878    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-data\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.713060 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.712915    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-credential-socket\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.713294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.713238    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5efa0171-0b71-4cc3-af4e-38866e8015d2-istiod-ca-cert\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.714945 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.714917    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-envoy\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.715207 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.715184    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-podinfo\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.721124 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.721093    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-token\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.721244 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.721218    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzm4t\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-kube-api-access-wzm4t\") pod \"e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") " pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:38.787444 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:38.787354    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:39.071170 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:39.071140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"]
Sep 08 16:47:39.073733 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:47:39.073706    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efa0171_0b71_4cc3_af4e_38866e8015d2.slice/crio-03f2e90b5555dc0d15b8e2d009894a14498a86cb4c2744fda3c12ea66d37c1fc WatchSource:0}: Error finding container 03f2e90b5555dc0d15b8e2d009894a14498a86cb4c2744fda3c12ea66d37c1fc: Status 404 returned error can't find the container with id 03f2e90b5555dc0d15b8e2d009894a14498a86cb4c2744fda3c12ea66d37c1fc
Sep 08 16:47:39.076795 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:39.076745    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:47:39.076957 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:39.076885    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:47:39.077023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:39.076962    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:47:39.116338 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:39.116304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:40.022715 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:40.022672    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" event={"ID":"5efa0171-0b71-4cc3-af4e-38866e8015d2","Type":"ContainerStarted","Data":"74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"}
Sep 08 16:47:40.022979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:40.022739    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" event={"ID":"5efa0171-0b71-4cc3-af4e-38866e8015d2","Type":"ContainerStarted","Data":"03f2e90b5555dc0d15b8e2d009894a14498a86cb4c2744fda3c12ea66d37c1fc"}
Sep 08 16:47:40.049013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:40.048953    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podStartSLOduration=2.0489324 podStartE2EDuration="2.0489324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:47:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:47:40.047291397 +0000 UTC m=+1028.035727383" watchObservedRunningTime="2026-09-08 16:47:40.0489324 +0000 UTC m=+1028.037368352"
Sep 08 16:47:40.756281 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:40.756244    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:40.788273 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:40.788241    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:40.793637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:40.793608    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:41.028636 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:41.028553    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:41.029708 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:41.029682    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:47:41.943252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:41.943211    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:42.040439 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:42.040410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:43.197109 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:43.197072    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:43.265920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:43.265881    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:43.592161 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:43.592070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:43.695381 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:43.695349    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:43.791500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:43.791462    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:49.912037 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:49.912002    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:47:50.918248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:47:50.918214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:02.170302 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:02.170265    2581 generic.go:356] "Generic (PLEG): container finished" podID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerID="74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93" exitCode=0
Sep 08 16:48:02.170880 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:02.170343    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" event={"ID":"5efa0171-0b71-4cc3-af4e-38866e8015d2","Type":"ContainerDied","Data":"74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"}
Sep 08 16:48:02.170963 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:02.170931    2581 scope.go:117] "RemoveContainer" containerID="74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"
Sep 08 16:48:02.172158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:02.172124    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:02.172248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:02.172199    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:02.172248 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:02.172228    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:03.178617 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:03.178584    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" event={"ID":"5efa0171-0b71-4cc3-af4e-38866e8015d2","Type":"ContainerStarted","Data":"47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85"}
Sep 08 16:48:03.788089 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:03.788053    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:48:03.788310 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:03.788285    2581 patch_prober.go:28] interesting pod/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 16:48:03.788358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:03.788339    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 16:48:04.788066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:04.788026    2581 patch_prober.go:28] interesting pod/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 16:48:04.788477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:04.788082    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 16:48:05.787808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:05.787769    2581 patch_prober.go:28] interesting pod/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 16:48:05.788028 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:05.787866    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 16:48:05.981643 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:05.981606    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"]
Sep 08 16:48:06.003450 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:06.003418    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:06.788456 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:06.788417    2581 patch_prober.go:28] interesting pod/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 16:48:06.788619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:06.788497    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 16:48:06.915692 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:06.915656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:07.032065 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.032025    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:07.139673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.139551    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"]
Sep 08 16:48:07.140619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.140583    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" podUID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" containerName="istio-proxy" containerID="cri-o://7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f" gracePeriod=30
Sep 08 16:48:07.788178 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.788133    2581 patch_prober.go:28] interesting pod/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 08 16:48:07.788366 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.788210    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 08 16:48:07.926702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.926647    2581 patch_prober.go:28] interesting pod/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:48:07.926928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:07.926728    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" podUID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:48:08.270896 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:08.270858    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:08.330136 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:08.330077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:08.511495 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:08.511456    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:08.793014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:08.792984    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:48:08.793299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:08.793274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:48:08.794047 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:08.794025    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:48:12.399090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.399066    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:48:12.495244 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.495195    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:12.507331 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507287    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-token\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507348    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-envoy\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-podinfo\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507412    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-data\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507459    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5f5x\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-kube-api-access-z5f5x\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507719 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507538    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-certs\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507719 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507591    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-socket\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507719 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507623    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-credential-socket\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507719 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507675    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istiod-ca-cert\") pod \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\" (UID: \"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d\") "
Sep 08 16:48:12.507965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507888    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:12.507965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.507932    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:12.508288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.508264    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.508389 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.508292    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.508389 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.508280    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:12.508504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.508388    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:12.508900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.508878    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:12.509982 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.509959    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:12.509982 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.509971    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:48:12.510295 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.510274    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:12.510380 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.510307    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-kube-api-access-z5f5x" (OuterVolumeSpecName: "kube-api-access-z5f5x") pod "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" (UID: "5e5288ff-0e6b-4ec8-b37f-03596dab6e2d"). InnerVolumeSpecName "kube-api-access-z5f5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:12.608928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608890    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.608928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608921    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.608928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608932    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.608928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608939    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.609190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608947    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.609190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608955    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5f5x\" (UniqueName: \"kubernetes.io/projected/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-kube-api-access-z5f5x\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:12.609190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:12.608963    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:13.240913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.240878    2581 generic.go:356] "Generic (PLEG): container finished" podID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" containerID="7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f" exitCode=0
Sep 08 16:48:13.241094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.240991    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"
Sep 08 16:48:13.241094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.240999    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" event={"ID":"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d","Type":"ContainerDied","Data":"7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f"}
Sep 08 16:48:13.241094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.241061    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb" event={"ID":"5e5288ff-0e6b-4ec8-b37f-03596dab6e2d","Type":"ContainerDied","Data":"f66fac9e2dbef70d598e5e3636f10360048c0bbb48ebf3c5b7ad9c8bbc800ff8"}
Sep 08 16:48:13.241094 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.241084    2581 scope.go:117] "RemoveContainer" containerID="7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f"
Sep 08 16:48:13.251753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.251730    2581 scope.go:117] "RemoveContainer" containerID="7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f"
Sep 08 16:48:13.252165 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:13.252141    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f\": container with ID starting with 7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f not found: ID does not exist" containerID="7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f"
Sep 08 16:48:13.252229 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.252177    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f"} err="failed to get container status \"7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f\": rpc error: code = NotFound desc = could not find container \"7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f\": container with ID starting with 7501e1ee820d2a82a00d3ad42645617bc0b6823ce18f45feac0e5e6da6c3556f not found: ID does not exist"
Sep 08 16:48:13.265673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.265626    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"]
Sep 08 16:48:13.270386 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:13.270347    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-51b8ca-openshift-default-78bc95b5b8-d69hb"]
Sep 08 16:48:14.291740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:14.291702    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:14.396267 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:14.396234    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:14.468325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:14.468286    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" path="/var/lib/kubelet/pods/5e5288ff-0e6b-4ec8-b37f-03596dab6e2d/volumes"
Sep 08 16:48:14.846102 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:14.846067    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:18.381625 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:18.381581    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:18.958047 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:18.958009    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"]
Sep 08 16:48:18.958253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:18.958226    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" podUID="093a6379-5a41-4e74-ab05-b76ced36a856" containerName="maas-api" containerID="cri-o://d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792" gracePeriod=30
Sep 08 16:48:18.978403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:18.978333    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"]
Sep 08 16:48:18.982115 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:18.981826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:18.985668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:18.985642    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c9b098-29814765-jg4kw"]
Sep 08 16:48:19.070108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.070074    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:19.127625 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.127574    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:19.184360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.184326    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:19.223512 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.223439    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:48:19.279599 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.279567    2581 generic.go:356] "Generic (PLEG): container finished" podID="093a6379-5a41-4e74-ab05-b76ced36a856" containerID="d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792" exitCode=0
Sep 08 16:48:19.279809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.279615    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"
Sep 08 16:48:19.279809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.279660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" event={"ID":"093a6379-5a41-4e74-ab05-b76ced36a856","Type":"ContainerDied","Data":"d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792"}
Sep 08 16:48:19.279809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.279718    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr" event={"ID":"093a6379-5a41-4e74-ab05-b76ced36a856","Type":"ContainerDied","Data":"ff362c5759f3411ef065337c188271327de80d0cc228f0473c47f979e5ca41f3"}
Sep 08 16:48:19.279809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.279749    2581 scope.go:117] "RemoveContainer" containerID="d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792"
Sep 08 16:48:19.285226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.285198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9f7hg\" (UniqueName: \"kubernetes.io/projected/093a6379-5a41-4e74-ab05-b76ced36a856-kube-api-access-9f7hg\") pod \"093a6379-5a41-4e74-ab05-b76ced36a856\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") "
Sep 08 16:48:19.285357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.285249    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093a6379-5a41-4e74-ab05-b76ced36a856-openshift-service-ca\") pod \"093a6379-5a41-4e74-ab05-b76ced36a856\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") "
Sep 08 16:48:19.285357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.285280    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-metrics-certs\") pod \"093a6379-5a41-4e74-ab05-b76ced36a856\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") "
Sep 08 16:48:19.285357 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.285332    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls\") pod \"093a6379-5a41-4e74-ab05-b76ced36a856\" (UID: \"093a6379-5a41-4e74-ab05-b76ced36a856\") "
Sep 08 16:48:19.285717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.285676    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/093a6379-5a41-4e74-ab05-b76ced36a856-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "093a6379-5a41-4e74-ab05-b76ced36a856" (UID: "093a6379-5a41-4e74-ab05-b76ced36a856"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:19.287883 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.287811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/093a6379-5a41-4e74-ab05-b76ced36a856-kube-api-access-9f7hg" (OuterVolumeSpecName: "kube-api-access-9f7hg") pod "093a6379-5a41-4e74-ab05-b76ced36a856" (UID: "093a6379-5a41-4e74-ab05-b76ced36a856"). InnerVolumeSpecName "kube-api-access-9f7hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:19.288106 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.288076    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "093a6379-5a41-4e74-ab05-b76ced36a856" (UID: "093a6379-5a41-4e74-ab05-b76ced36a856"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:19.288222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.288172    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "093a6379-5a41-4e74-ab05-b76ced36a856" (UID: "093a6379-5a41-4e74-ab05-b76ced36a856"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:19.290006 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.289987    2581 scope.go:117] "RemoveContainer" containerID="d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792"
Sep 08 16:48:19.290423 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:19.290395    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792\": container with ID starting with d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792 not found: ID does not exist" containerID="d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792"
Sep 08 16:48:19.290523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.290431    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792"} err="failed to get container status \"d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792\": rpc error: code = NotFound desc = could not find container \"d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792\": container with ID starting with d50da823d98410eda10603c35a5bae6499f4cc6575cec7b7826a7f109358c792 not found: ID does not exist"
Sep 08 16:48:19.387286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.387221    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-maas-api-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:19.387286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.387259    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9f7hg\" (UniqueName: \"kubernetes.io/projected/093a6379-5a41-4e74-ab05-b76ced36a856-kube-api-access-9f7hg\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:19.387286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.387279    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/093a6379-5a41-4e74-ab05-b76ced36a856-openshift-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:19.387286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.387292    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/093a6379-5a41-4e74-ab05-b76ced36a856-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:19.540990 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.540896    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:19.602791 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.602756    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"]
Sep 08 16:48:19.605012 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:19.604975    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c9b098-7c7b757c49-cxjzr"]
Sep 08 16:48:20.467947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:20.467908    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="093a6379-5a41-4e74-ab05-b76ced36a856" path="/var/lib/kubelet/pods/093a6379-5a41-4e74-ab05-b76ced36a856/volumes"
Sep 08 16:48:20.468433 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:20.468372    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31e2161d-a2ea-4f6c-9d48-5a7ba27031d5" path="/var/lib/kubelet/pods/31e2161d-a2ea-4f6c-9d48-5a7ba27031d5/volumes"
Sep 08 16:48:21.004507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.004455    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz" podUID="9adef94d-a055-4924-8d00-53f7f375d8ea" containerName="main" containerID="cri-o://26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c" gracePeriod=45
Sep 08 16:48:21.262104 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.262037    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:48:21.294588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.294549    2581 generic.go:356] "Generic (PLEG): container finished" podID="9adef94d-a055-4924-8d00-53f7f375d8ea" containerID="26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c" exitCode=0
Sep 08 16:48:21.294588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.294595    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"
Sep 08 16:48:21.294882 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.294636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz" event={"ID":"9adef94d-a055-4924-8d00-53f7f375d8ea","Type":"ContainerDied","Data":"26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c"}
Sep 08 16:48:21.294882 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.294681    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz" event={"ID":"9adef94d-a055-4924-8d00-53f7f375d8ea","Type":"ContainerDied","Data":"0334b7265914a8b7ecbb66ed0e5262fc8be32076b33b5ad0b31b90a7fcb8c781"}
Sep 08 16:48:21.294882 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.294701    2581 scope.go:117] "RemoveContainer" containerID="26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c"
Sep 08 16:48:21.304905 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.304882    2581 scope.go:117] "RemoveContainer" containerID="26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c"
Sep 08 16:48:21.305308 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:21.305279    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c\": container with ID starting with 26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c not found: ID does not exist" containerID="26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c"
Sep 08 16:48:21.305395 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.305314    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c"} err="failed to get container status \"26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c\": rpc error: code = NotFound desc = could not find container \"26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c\": container with ID starting with 26c7575cc95c495ca71bfda2c182af6ca1827ce1bd8570e3f4213b9620b56d3c not found: ID does not exist"
Sep 08 16:48:21.409769 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.409731    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-tmp-dir\") pod \"9adef94d-a055-4924-8d00-53f7f375d8ea\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") "
Sep 08 16:48:21.409998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.409792    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fztrf\" (UniqueName: \"kubernetes.io/projected/9adef94d-a055-4924-8d00-53f7f375d8ea-kube-api-access-fztrf\") pod \"9adef94d-a055-4924-8d00-53f7f375d8ea\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") "
Sep 08 16:48:21.409998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.409858    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9adef94d-a055-4924-8d00-53f7f375d8ea-tls-certs\") pod \"9adef94d-a055-4924-8d00-53f7f375d8ea\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") "
Sep 08 16:48:21.409998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.409921    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-model-cache\") pod \"9adef94d-a055-4924-8d00-53f7f375d8ea\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") "
Sep 08 16:48:21.410156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410057    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9adef94d-a055-4924-8d00-53f7f375d8ea" (UID: "9adef94d-a055-4924-8d00-53f7f375d8ea"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:21.410156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410117    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-dshm\") pod \"9adef94d-a055-4924-8d00-53f7f375d8ea\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") "
Sep 08 16:48:21.410263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410202    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-model-cache" (OuterVolumeSpecName: "model-cache") pod "9adef94d-a055-4924-8d00-53f7f375d8ea" (UID: "9adef94d-a055-4924-8d00-53f7f375d8ea"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:21.410263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410222    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-home\") pod \"9adef94d-a055-4924-8d00-53f7f375d8ea\" (UID: \"9adef94d-a055-4924-8d00-53f7f375d8ea\") "
Sep 08 16:48:21.410618 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410595    2581 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-model-cache\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:21.410618 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410616    2581 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-tmp-dir\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:21.410891 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.410811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-home" (OuterVolumeSpecName: "home") pod "9adef94d-a055-4924-8d00-53f7f375d8ea" (UID: "9adef94d-a055-4924-8d00-53f7f375d8ea"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:21.412851 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.412808    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9adef94d-a055-4924-8d00-53f7f375d8ea-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9adef94d-a055-4924-8d00-53f7f375d8ea" (UID: "9adef94d-a055-4924-8d00-53f7f375d8ea"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:48:21.412851 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.412811    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-dshm" (OuterVolumeSpecName: "dshm") pod "9adef94d-a055-4924-8d00-53f7f375d8ea" (UID: "9adef94d-a055-4924-8d00-53f7f375d8ea"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:21.413025 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.412889    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adef94d-a055-4924-8d00-53f7f375d8ea-kube-api-access-fztrf" (OuterVolumeSpecName: "kube-api-access-fztrf") pod "9adef94d-a055-4924-8d00-53f7f375d8ea" (UID: "9adef94d-a055-4924-8d00-53f7f375d8ea"). InnerVolumeSpecName "kube-api-access-fztrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:21.511605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.511562    2581 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-home\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:21.511605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.511597    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fztrf\" (UniqueName: \"kubernetes.io/projected/9adef94d-a055-4924-8d00-53f7f375d8ea-kube-api-access-fztrf\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:21.511605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.511607    2581 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9adef94d-a055-4924-8d00-53f7f375d8ea-tls-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:21.511605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.511616    2581 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9adef94d-a055-4924-8d00-53f7f375d8ea-dshm\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:21.617282 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.617241    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"]
Sep 08 16:48:21.620727 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:21.620687    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-c9b098/test-model-c9b098-kserve-7c76d594f5-svrjz"]
Sep 08 16:48:22.468493 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:22.468457    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9adef94d-a055-4924-8d00-53f7f375d8ea" path="/var/lib/kubelet/pods/9adef94d-a055-4924-8d00-53f7f375d8ea/volumes"
Sep 08 16:48:25.006191 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:25.006104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:25.618490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:25.618396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:25.746185 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:25.746123    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:25.886356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:25.886261    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:25.951257 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:25.951214    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:26.259252 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:26.259213    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:26.325546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:26.325491    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:26.508516 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:26.508475    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"]
Sep 08 16:48:26.508743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:26.508697    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy" containerID="cri-o://ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75" gracePeriod=30
Sep 08 16:48:26.532131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:26.532030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:27.070133 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:27.070070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:31.772712 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.772633    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:48:31.926190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926135    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-certs\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926194    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-envoy\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926236    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-socket\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926254    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-data\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926278    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz6tp\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-kube-api-access-vz6tp\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926341    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-token\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926368    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istiod-ca-cert\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926392    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926434    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-podinfo\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926457    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-credential-socket\") pod \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\" (UID: \"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28\") "
Sep 08 16:48:31.926903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926517    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-data" (OuterVolumeSpecName: "istio-data") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:31.926903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926556    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:31.926903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926685    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:31.926903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926712    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:31.927288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926922    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:31.927288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926941    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:31.927288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926955    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:31.927288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926967    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:31.927288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.926980    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:31.928720 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.928690    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-token" (OuterVolumeSpecName: "istio-token") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:31.928888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.928749    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:31.928888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.928767    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:48:31.928888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:31.928776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-kube-api-access-vz6tp" (OuterVolumeSpecName: "kube-api-access-vz6tp") pod "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" (UID: "dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28"). InnerVolumeSpecName "kube-api-access-vz6tp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:32.028247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.028133    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz6tp\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-kube-api-access-vz6tp\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:32.028247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.028177    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:32.028247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.028191    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:32.028247 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.028201    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:32.233873 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.233795    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:32.309211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.309116    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:32.361885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.361820    2581 generic.go:356] "Generic (PLEG): container finished" podID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerID="ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75" exitCode=0
Sep 08 16:48:32.362096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.361892    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" event={"ID":"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28","Type":"ContainerDied","Data":"ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75"}
Sep 08 16:48:32.362096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.361899    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"
Sep 08 16:48:32.362096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.361953    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96" event={"ID":"dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28","Type":"ContainerDied","Data":"126b23baebeac91e8d442af7e567c976fe2715fa6dc1d6c39c738e2a29424ff1"}
Sep 08 16:48:32.362096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.361983    2581 scope.go:117] "RemoveContainer" containerID="ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75"
Sep 08 16:48:32.372147 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.372124    2581 scope.go:117] "RemoveContainer" containerID="28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"
Sep 08 16:48:32.381570 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.381547    2581 scope.go:117] "RemoveContainer" containerID="ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75"
Sep 08 16:48:32.382004 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:32.381983    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75\": container with ID starting with ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75 not found: ID does not exist" containerID="ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75"
Sep 08 16:48:32.382085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.382012    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75"} err="failed to get container status \"ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75\": rpc error: code = NotFound desc = could not find container \"ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75\": container with ID starting with ee3f5aa07f423b0a1867220f64298fd192e51317148609597e701222d51aad75 not found: ID does not exist"
Sep 08 16:48:32.382085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.382030    2581 scope.go:117] "RemoveContainer" containerID="28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"
Sep 08 16:48:32.382337 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:32.382304    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90\": container with ID starting with 28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90 not found: ID does not exist" containerID="28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"
Sep 08 16:48:32.382402 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.382348    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90"} err="failed to get container status \"28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90\": rpc error: code = NotFound desc = could not find container \"28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90\": container with ID starting with 28a27306d90ddec86510dbabc489c80e08f44f8ffb337dca46681a350806ee90 not found: ID does not exist"
Sep 08 16:48:32.388092 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.388048    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"]
Sep 08 16:48:32.394231 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.394193    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-c9b098-openshift-default-bc84b699b-n2b96"]
Sep 08 16:48:32.476639 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.476553    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" path="/var/lib/kubelet/pods/dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28/volumes"
Sep 08 16:48:32.477013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.476991    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"]
Sep 08 16:48:32.477315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.477287    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy" containerID="cri-o://47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85" gracePeriod=30
Sep 08 16:48:32.487126 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.487078    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:32.908421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:32.908331    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:33.088646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:33.088608    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:34.438969 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:34.438922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:37.356127 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.356088    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:37.426720 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.426673    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:37.491159 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.491127    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:37.564485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.564450    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:37.637590 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.637486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:37.747711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.747683    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:48:37.788559 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.788516    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5efa0171-0b71-4cc3-af4e-38866e8015d2-istiod-ca-cert\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.788721 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.788601    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wzm4t\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-kube-api-access-wzm4t\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.788721 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.788676    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-token\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.788914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.788880    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-data\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.789054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.788944    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-envoy\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.789054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.788999    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5efa0171-0b71-4cc3-af4e-38866e8015d2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:37.789054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.789007    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-certs\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.789240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.789095    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-podinfo\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.789240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.789197    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-data" (OuterVolumeSpecName: "istio-data") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:37.789240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.789237    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-socket\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.789400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.789243    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.791231    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-kube-api-access-wzm4t" (OuterVolumeSpecName: "kube-api-access-wzm4t") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "kube-api-access-wzm4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.791289    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-credential-socket\") pod \"5efa0171-0b71-4cc3-af4e-38866e8015d2\" (UID: \"5efa0171-0b71-4cc3-af4e-38866e8015d2\") "
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.791485    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.791528    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-token" (OuterVolumeSpecName: "istio-token") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.791765    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792020    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5efa0171-0b71-4cc3-af4e-38866e8015d2-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792051    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wzm4t\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-kube-api-access-wzm4t\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792065    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792079    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792092    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792110    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.792122    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.799602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.793149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:37.800317 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.800245    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5efa0171-0b71-4cc3-af4e-38866e8015d2" (UID: "5efa0171-0b71-4cc3-af4e-38866e8015d2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:48:37.893177 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.893054    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5efa0171-0b71-4cc3-af4e-38866e8015d2-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.893177 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.893098    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5efa0171-0b71-4cc3-af4e-38866e8015d2-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:37.919359 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:37.919323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:38.396066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.396029    2581 generic.go:356] "Generic (PLEG): container finished" podID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerID="47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85" exitCode=0
Sep 08 16:48:38.396066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.396070    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" event={"ID":"5efa0171-0b71-4cc3-af4e-38866e8015d2","Type":"ContainerDied","Data":"47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85"}
Sep 08 16:48:38.396568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.396098    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"
Sep 08 16:48:38.396568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.396136    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h" event={"ID":"5efa0171-0b71-4cc3-af4e-38866e8015d2","Type":"ContainerDied","Data":"03f2e90b5555dc0d15b8e2d009894a14498a86cb4c2744fda3c12ea66d37c1fc"}
Sep 08 16:48:38.396568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.396161    2581 scope.go:117] "RemoveContainer" containerID="47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85"
Sep 08 16:48:38.406534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.406508    2581 scope.go:117] "RemoveContainer" containerID="74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"
Sep 08 16:48:38.417161 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.417123    2581 scope.go:117] "RemoveContainer" containerID="47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85"
Sep 08 16:48:38.417534 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:38.417512    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85\": container with ID starting with 47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85 not found: ID does not exist" containerID="47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85"
Sep 08 16:48:38.417602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.417545    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85"} err="failed to get container status \"47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85\": rpc error: code = NotFound desc = could not find container \"47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85\": container with ID starting with 47c396d374fde8f1d4d25f9d64e9217a56fb66a34a8bebb2390e7f8e78f09b85 not found: ID does not exist"
Sep 08 16:48:38.417602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.417565    2581 scope.go:117] "RemoveContainer" containerID="74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"
Sep 08 16:48:38.417922 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:38.417903    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93\": container with ID starting with 74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93 not found: ID does not exist" containerID="74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"
Sep 08 16:48:38.417988 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.417929    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93"} err="failed to get container status \"74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93\": rpc error: code = NotFound desc = could not find container \"74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93\": container with ID starting with 74a1fa1acfdbc9e414d7fbff55b84cbc95addee2b2e595b898b9242a4f611b93 not found: ID does not exist"
Sep 08 16:48:38.419017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.418994    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"]
Sep 08 16:48:38.423547 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.423509    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bdae4bb7-openshift-default-6d8f9dfd56-9r52h"]
Sep 08 16:48:38.470720 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:38.470682    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" path="/var/lib/kubelet/pods/5efa0171-0b71-4cc3-af4e-38866e8015d2/volumes"
Sep 08 16:48:39.336239 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:39.336198    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:39.442420 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:39.442380    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:39.536286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:39.536255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:39.684673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:39.684637    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:44.079605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:44.079569    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:44.146735 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:44.146702    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:44.354251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:44.354156    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"]
Sep 08 16:48:44.354472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:44.354442    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" containerID="cri-o://13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2" gracePeriod=30
Sep 08 16:48:44.409057 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:44.409022    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:44.926032 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:44.925995    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:45.218066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218031    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"]
Sep 08 16:48:45.218509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218478    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="093a6379-5a41-4e74-ab05-b76ced36a856" containerName="maas-api"
Sep 08 16:48:45.218509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218490    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="093a6379-5a41-4e74-ab05-b76ced36a856" containerName="maas-api"
Sep 08 16:48:45.218509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218499    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy"
Sep 08 16:48:45.218509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218505    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218523    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9adef94d-a055-4924-8d00-53f7f375d8ea" containerName="main"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218530    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="9adef94d-a055-4924-8d00-53f7f375d8ea" containerName="main"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218538    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218543    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218552    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218557    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218568    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218573    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218633    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="9adef94d-a055-4924-8d00-53f7f375d8ea" containerName="main"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218645    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218650    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218656    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="093a6379-5a41-4e74-ab05-b76ced36a856" containerName="maas-api"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218661    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5288ff-0e6b-4ec8-b37f-03596dab6e2d" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218667    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcd7fc1c-8ea0-4bc1-852f-57ee754b4b28" containerName="istio-proxy"
Sep 08 16:48:45.218667 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.218673    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy"
Sep 08 16:48:45.223588 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.223557    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.226393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.226371    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-608268-openshift-default-dockercfg-49f8m\""
Sep 08 16:48:45.233722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.233690    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"]
Sep 08 16:48:45.244370 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.244338    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:45.271943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.271899    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-credential-socket\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.271943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.271947    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-data\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-socket\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272103    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-podinfo\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272141    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-certs\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-envoy\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272233    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqxzh\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-kube-api-access-mqxzh\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4b1b95-aca7-4c80-9688-323337d58ac8-istiod-ca-cert\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.272356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.272271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-token\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373124    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-certs\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-envoy\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373391 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373206    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqxzh\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-kube-api-access-mqxzh\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373391 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373323    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4b1b95-aca7-4c80-9688-323337d58ac8-istiod-ca-cert\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373391 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373371    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-token\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373454    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-credential-socket\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373507 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373485    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-data\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373582    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-certs\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373593    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-socket\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373731 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373648    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-podinfo\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.373882 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.373817    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-credential-socket\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.374039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.374020    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-socket\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.374162 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.374091    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-data\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.374329 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.374303    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4b1b95-aca7-4c80-9688-323337d58ac8-istiod-ca-cert\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.375827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.375799    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-envoy\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.376118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.376098    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-podinfo\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.381943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.381913    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-token\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.382062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.382005    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqxzh\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-kube-api-access-mqxzh\") pod \"e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") " pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.536112 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.536004    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:45.827735 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.827703    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"]
Sep 08 16:48:45.830411 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:48:45.830369    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae4b1b95_aca7_4c80_9688_323337d58ac8.slice/crio-d34fa4dbb437a6d2fa64745b6fc0b31f6bc505d238257e2d18a4e1a455e9bcca WatchSource:0}: Error finding container d34fa4dbb437a6d2fa64745b6fc0b31f6bc505d238257e2d18a4e1a455e9bcca: Status 404 returned error can't find the container with id d34fa4dbb437a6d2fa64745b6fc0b31f6bc505d238257e2d18a4e1a455e9bcca
Sep 08 16:48:45.832819 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.832775    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:45.832965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.832884    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:45.832965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:45.832916    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:46.028955 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.028911    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:46.439472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.439437    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" event={"ID":"ae4b1b95-aca7-4c80-9688-323337d58ac8","Type":"ContainerStarted","Data":"b7a23589296c17b361f1a1b76f74ca7cc114d99e5c0bbb8fc49d866a17cffac0"}
Sep 08 16:48:46.439905 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.439494    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" event={"ID":"ae4b1b95-aca7-4c80-9688-323337d58ac8","Type":"ContainerStarted","Data":"d34fa4dbb437a6d2fa64745b6fc0b31f6bc505d238257e2d18a4e1a455e9bcca"}
Sep 08 16:48:46.464036 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.463964    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podStartSLOduration=1.4639418960000001 podStartE2EDuration="1.463941896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:48:46.460512552 +0000 UTC m=+1094.448948507" watchObservedRunningTime="2026-09-08 16:48:46.463941896 +0000 UTC m=+1094.452377851"
Sep 08 16:48:46.536394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.536353    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:46.538390 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.538355    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 16:48:46.538527 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:46.538413    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 16:48:47.089216 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.089173    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:47.205680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.205640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:47.343928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.343804    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"]
Sep 08 16:48:47.344774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.344741    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy"
Sep 08 16:48:47.344774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.344774    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efa0171-0b71-4cc3-af4e-38866e8015d2" containerName="istio-proxy"
Sep 08 16:48:47.348637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.348607    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.351245 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.351218    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-1df9f8-openshift-default-dockercfg-vq7z5\""
Sep 08 16:48:47.360172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.360140    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"]
Sep 08 16:48:47.375030 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.375003    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:47.497356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497291    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-data\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497385    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-envoy\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497494    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-socket\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497532    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-podinfo\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497642    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eae15cd0-c21f-4547-b7a7-f495577d7b38-istiod-ca-cert\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497688    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-token\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497748    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkdhp\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-kube-api-access-wkdhp\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-certs\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.497894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.497820    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-credential-socket\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.541743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.541708    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:47.599055 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.598947    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-certs\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599055 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599004    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-credential-socket\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599055 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599042    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-data\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-envoy\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-socket\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599241    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-podinfo\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599298    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eae15cd0-c21f-4547-b7a7-f495577d7b38-istiod-ca-cert\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599338    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-token\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599407    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkdhp\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-kube-api-access-wkdhp\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599448    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-certs\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599493    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-data\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599519    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-credential-socket\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.599897 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.599870    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-socket\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.600332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.600313    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eae15cd0-c21f-4547-b7a7-f495577d7b38-istiod-ca-cert\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.601962 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.601929    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-envoy\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.602155 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.602136    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-podinfo\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.607786 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.607756    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-token\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.607986 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.607967    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkdhp\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-kube-api-access-wkdhp\") pod \"e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") " pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.663104 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.663062    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:47.945375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.945343    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"]
Sep 08 16:48:47.950104 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:48:47.950047    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae15cd0_c21f_4547_b7a7_f495577d7b38.slice/crio-857fbaec61a73b50a0fa31dade4d56bea4abe3343d2bca7e3151fb7abe9561b7 WatchSource:0}: Error finding container 857fbaec61a73b50a0fa31dade4d56bea4abe3343d2bca7e3151fb7abe9561b7: Status 404 returned error can't find the container with id 857fbaec61a73b50a0fa31dade4d56bea4abe3343d2bca7e3151fb7abe9561b7
Sep 08 16:48:47.957001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.956958    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:47.957131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.957055    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:47.957131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:47.957116    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:48:48.064278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.064237    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:48.457543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.457499    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" event={"ID":"eae15cd0-c21f-4547-b7a7-f495577d7b38","Type":"ContainerStarted","Data":"f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"}
Sep 08 16:48:48.457780 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.457600    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" event={"ID":"eae15cd0-c21f-4547-b7a7-f495577d7b38","Type":"ContainerStarted","Data":"857fbaec61a73b50a0fa31dade4d56bea4abe3343d2bca7e3151fb7abe9561b7"}
Sep 08 16:48:48.457900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.457775    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:48.458756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.458737    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:48:48.479556 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.479500    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podStartSLOduration=1.479481359 podStartE2EDuration="1.479481359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:48:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:48:48.477112582 +0000 UTC m=+1096.465548558" watchObservedRunningTime="2026-09-08 16:48:48.479481359 +0000 UTC m=+1096.467917725"
Sep 08 16:48:48.597206 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.597163    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:48.663903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.663857    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:48.701605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:48.701498    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:49.299959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.299920    2581 patch_prober.go:28] interesting pod/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:48:49.300155 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.299985    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:48:49.633336 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.633304    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:48:49.669325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.669279    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:49.722738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722707    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-socket\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.722738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722744    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-866rj\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-kube-api-access-866rj\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722781    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-envoy\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722809    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-podinfo\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722897    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-data\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722925    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-token\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.722967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-credential-socket\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723050 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.723011    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istiod-ca-cert\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.723126    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-certs\") pod \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\" (UID: \"11b3fdc8-5498-43fa-b3af-aa0329d128c0\") "
Sep 08 16:48:49.723356 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.723171    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:49.723602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.723578    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.723769 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.723715    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:49.723990 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.723931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:49.724082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.724058    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:49.724153 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.724097    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:48:49.725540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.725509    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:48:49.725970 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.725943    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:49.726079 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.726032    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:48:49.726341 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.726324    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-kube-api-access-866rj" (OuterVolumeSpecName: "kube-api-access-866rj") pod "11b3fdc8-5498-43fa-b3af-aa0329d128c0" (UID: "11b3fdc8-5498-43fa-b3af-aa0329d128c0"). InnerVolumeSpecName "kube-api-access-866rj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:48:49.732322 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.732286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:49.824940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824899    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.824940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824936    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.824940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824947    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.825190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824955    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.825190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824965    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.825190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824973    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.825190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824981    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-866rj\" (UniqueName: \"kubernetes.io/projected/11b3fdc8-5498-43fa-b3af-aa0329d128c0-kube-api-access-866rj\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.825190 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.824989    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11b3fdc8-5498-43fa-b3af-aa0329d128c0-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:48:49.832406 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.832375    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:49.936453 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:49.936421    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:50.281257 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.281162    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:50.375901 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.375856    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:50.470767 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.470736    2581 generic.go:356] "Generic (PLEG): container finished" podID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerID="13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2" exitCode=0
Sep 08 16:48:50.470998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.470814    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"
Sep 08 16:48:50.470998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.470814    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" event={"ID":"11b3fdc8-5498-43fa-b3af-aa0329d128c0","Type":"ContainerDied","Data":"13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2"}
Sep 08 16:48:50.470998 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.470967    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx" event={"ID":"11b3fdc8-5498-43fa-b3af-aa0329d128c0","Type":"ContainerDied","Data":"411d4b7dd9cbf4d3339203d642218f89e377a4af47eddd6ea3e910a01e78a453"}
Sep 08 16:48:50.471178 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.471003    2581 scope.go:117] "RemoveContainer" containerID="13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2"
Sep 08 16:48:50.471793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.471772    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:50.472895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.472878    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:48:50.483808 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.483679    2581 scope.go:117] "RemoveContainer" containerID="ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"
Sep 08 16:48:50.494753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.494665    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:50.494753 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.494694    2581 scope.go:117] "RemoveContainer" containerID="13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2"
Sep 08 16:48:50.495115 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:50.495093    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2\": container with ID starting with 13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2 not found: ID does not exist" containerID="13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2"
Sep 08 16:48:50.495174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.495125    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2"} err="failed to get container status \"13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2\": rpc error: code = NotFound desc = could not find container \"13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2\": container with ID starting with 13b5457fc35a2fc89eea3cdd9df9acf82d8b5d612e2b19318df8db76974bdfe2 not found: ID does not exist"
Sep 08 16:48:50.495174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.495144    2581 scope.go:117] "RemoveContainer" containerID="ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"
Sep 08 16:48:50.495436 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:50.495415    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6\": container with ID starting with ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6 not found: ID does not exist" containerID="ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"
Sep 08 16:48:50.495523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.495442    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6"} err="failed to get container status \"ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6\": rpc error: code = NotFound desc = could not find container \"ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6\": container with ID starting with ce837a8c1e018b4dd8e89090fb4f58384895be79b1782c5afffe90515a337ea6 not found: ID does not exist"
Sep 08 16:48:50.533157 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.533033    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"]
Sep 08 16:48:50.538405 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.538368    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-43a905-openshift-default-55866f7b6d-jcxdx"]
Sep 08 16:48:50.594420 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.594389    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:50.695065 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:50.695030    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:51.759665 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.759623    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"]
Sep 08 16:48:51.760417 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.760397    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy"
Sep 08 16:48:51.760465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.760422    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy"
Sep 08 16:48:51.760465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.760436    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy"
Sep 08 16:48:51.760465 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.760446    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy"
Sep 08 16:48:51.760561 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.760536    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy"
Sep 08 16:48:51.764096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.764075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.766403 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.766377    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-1df9f8-serving-cert\""
Sep 08 16:48:51.771901 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.771868    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"]
Sep 08 16:48:51.789600 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.789562    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:51.847103 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.847061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm5l6\" (UniqueName: \"kubernetes.io/projected/6c1aefe8-8cf4-4978-adcb-1be132241d52-kube-api-access-tm5l6\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.847299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.847143    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1aefe8-8cf4-4978-adcb-1be132241d52-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.847299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.847245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.847377 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.847312    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.852307 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.852276    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:51.948567 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.948523    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1aefe8-8cf4-4978-adcb-1be132241d52-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.948567 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.948572    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.948803 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.948627    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.948803 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.948684    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm5l6\" (UniqueName: \"kubernetes.io/projected/6c1aefe8-8cf4-4978-adcb-1be132241d52-kube-api-access-tm5l6\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.948803 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:51.948746    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-serving-cert: secret "maas-api-e2e-shared-a-w2-1df9f8-serving-cert" not found
Sep 08 16:48:51.948991 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:48:51.948824    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls podName:6c1aefe8-8cf4-4978-adcb-1be132241d52 nodeName:}" failed. No retries permitted until 2026-09-08 16:48:52.448805936 +0000 UTC m=+1100.437241886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls") pod "maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" (UID: "6c1aefe8-8cf4-4978-adcb-1be132241d52") : secret "maas-api-e2e-shared-a-w2-1df9f8-serving-cert" not found
Sep 08 16:48:51.949347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.949327    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1aefe8-8cf4-4978-adcb-1be132241d52-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.951286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.951253    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:51.960171 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:51.960136    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm5l6\" (UniqueName: \"kubernetes.io/projected/6c1aefe8-8cf4-4978-adcb-1be132241d52-kube-api-access-tm5l6\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:52.095432 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.095336    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:52.316353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.316304    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:52.407351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.407262    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:48:52.455449 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.455405    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:52.458431 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.458391    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:52.469543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.469493    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" path="/var/lib/kubelet/pods/11b3fdc8-5498-43fa-b3af-aa0329d128c0/volumes"
Sep 08 16:48:52.678437 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.678400    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:52.962489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.962463    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"]
Sep 08 16:48:52.964384 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:48:52.964349    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c1aefe8_8cf4_4978_adcb_1be132241d52.slice/crio-9b0fa8968dec5f816f1256fbe0f5118381192a5e67072a324396030ac939bf7a WatchSource:0}: Error finding container 9b0fa8968dec5f816f1256fbe0f5118381192a5e67072a324396030ac939bf7a: Status 404 returned error can't find the container with id 9b0fa8968dec5f816f1256fbe0f5118381192a5e67072a324396030ac939bf7a
Sep 08 16:48:52.966183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:52.966160    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:48:53.490621 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:53.490574    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" event={"ID":"6c1aefe8-8cf4-4978-adcb-1be132241d52","Type":"ContainerStarted","Data":"d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702"}
Sep 08 16:48:53.490813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:53.490636    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" event={"ID":"6c1aefe8-8cf4-4978-adcb-1be132241d52","Type":"ContainerStarted","Data":"9b0fa8968dec5f816f1256fbe0f5118381192a5e67072a324396030ac939bf7a"}
Sep 08 16:48:53.490813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:53.490664    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:48:53.510239 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:53.510183    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" podStartSLOduration=2.197501264 podStartE2EDuration="2.510161156s" totalImagesPullingTime="312.659892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:48:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:48:53.506899168 +0000 UTC m=+1101.495335146" watchObservedRunningTime="2026-09-08 16:48:53.510161156 +0000 UTC m=+1101.498597114"
Sep 08 16:48:59.503672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:48:59.503641    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:49:04.500037 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:04.499997    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:49:04.500472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:04.500066    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:49:05.692431 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:05.692388    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:51180->10.134.0.52:15021: read: connection reset by peer" start-of-body=
Sep 08 16:49:05.692913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:05.692479    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": read tcp 10.134.0.2:51180->10.134.0.52:15021: read: connection reset by peer"
Sep 08 16:49:06.582850 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.582806    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerID="b7a23589296c17b361f1a1b76f74ca7cc114d99e5c0bbb8fc49d866a17cffac0" exitCode=0
Sep 08 16:49:06.583051 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.582872    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" event={"ID":"ae4b1b95-aca7-4c80-9688-323337d58ac8","Type":"ContainerDied","Data":"b7a23589296c17b361f1a1b76f74ca7cc114d99e5c0bbb8fc49d866a17cffac0"}
Sep 08 16:49:06.583358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.583332    2581 scope.go:117] "RemoveContainer" containerID="b7a23589296c17b361f1a1b76f74ca7cc114d99e5c0bbb8fc49d866a17cffac0"
Sep 08 16:49:06.584634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.584614    2581 generic.go:356] "Generic (PLEG): container finished" podID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerID="f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c" exitCode=0
Sep 08 16:49:06.584716 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.584631    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:06.584716 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.584685    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" event={"ID":"eae15cd0-c21f-4547-b7a7-f495577d7b38","Type":"ContainerDied","Data":"f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"}
Sep 08 16:49:06.584799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.584717    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:06.584799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.584759    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:06.585109 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.585094    2581 scope.go:117] "RemoveContainer" containerID="f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"
Sep 08 16:49:06.586156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.586131    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:06.586232 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.586195    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:06.586274 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:06.586259    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:07.592219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:07.592173    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" event={"ID":"ae4b1b95-aca7-4c80-9688-323337d58ac8","Type":"ContainerStarted","Data":"b02c9523648d9498db43a99d57e3cae3f2c5fc1e6d59bf474c35f55387ca3773"}
Sep 08 16:49:07.594109 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:07.594082    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" event={"ID":"eae15cd0-c21f-4547-b7a7-f495577d7b38","Type":"ContainerStarted","Data":"8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74"}
Sep 08 16:49:07.664260 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:07.664218    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:49:07.664509 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:07.664474    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:49:07.664561 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:07.664545    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 16:49:08.536501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:08.536455    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:49:08.536965 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:08.536927    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 16:49:08.537099 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:08.536995    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 16:49:08.663997 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:08.663957    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:49:08.664410 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:08.664018    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 16:49:09.537204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:09.537162    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 16:49:09.537528 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:09.537488    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 16:49:09.663770 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:09.663722    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:49:09.663989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:09.663778    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 16:49:10.537543 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:10.537491    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 16:49:10.538089 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:10.537568    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 16:49:10.663974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:10.663876    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:49:10.663974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:10.663955    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 16:49:10.826218 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:10.826112    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:11.537533 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:11.537482    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 16:49:11.537756 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:11.537573    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 16:49:11.664423 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:11.664384    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:49:11.664616 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:11.664464    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 16:49:12.537410 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:12.537365    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 16:49:12.537732 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:12.537702    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 16:49:12.664192 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:12.664159    2581 patch_prober.go:28] interesting pod/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 16:49:12.664567 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:12.664210    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 16:49:13.294433 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.294395    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:13.417548 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.417512    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:13.540303 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.540274    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:49:13.540589 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.540565    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:49:13.541213 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.541195    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:49:13.667315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.667227    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:49:13.667821 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.667591    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:49:13.668295 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.668279    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:49:13.805299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:13.805263    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:14.045984 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.045946    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"]
Sep 08 16:49:14.046983 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.046958    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b3fdc8-5498-43fa-b3af-aa0329d128c0" containerName="istio-proxy"
Sep 08 16:49:14.049612 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.049588    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.052473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.052447    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-6b15ca-openshift-default-dockercfg-djh54\""
Sep 08 16:49:14.062258 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.062224    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"]
Sep 08 16:49:14.077527 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.077494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:14.107165 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107124    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-certs\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107165 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107167    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pbhd\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-kube-api-access-8pbhd\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107266    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe5510-63ea-4cd4-b2b7-b794659006da-istiod-ca-cert\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107316    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-envoy\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107351    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-token\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107375    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-podinfo\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107418    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-credential-socket\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-socket\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.107523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.107496    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-data\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.186315 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.186269    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:14.208560 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208520    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-token\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208560 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-podinfo\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208626    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-credential-socket\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208656    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-socket\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-data\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208722    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-certs\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pbhd\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-kube-api-access-8pbhd\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.208895 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.208852    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe5510-63ea-4cd4-b2b7-b794659006da-istiod-ca-cert\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.209219 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.209048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-envoy\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.209518 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.209487    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-credential-socket\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.209654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.209544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-socket\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.209654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.209612    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-data\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.209654 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.209638    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-certs\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.209959 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.209932    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe5510-63ea-4cd4-b2b7-b794659006da-istiod-ca-cert\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.211798 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.211776    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-envoy\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.212037 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.212016    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-podinfo\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.217591 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.217559    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-token\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.217724 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.217633    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pbhd\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-kube-api-access-8pbhd\") pod \"e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") " pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.364046 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.363949    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:14.643149 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.643121    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"]
Sep 08 16:49:14.644902 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:49:14.644871    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cfe5510_63ea_4cd4_b2b7_b794659006da.slice/crio-affec6345186c126ccb93f26a2858bc16af3eb90a37d78ae5dad3144b795edd3 WatchSource:0}: Error finding container affec6345186c126ccb93f26a2858bc16af3eb90a37d78ae5dad3144b795edd3: Status 404 returned error can't find the container with id affec6345186c126ccb93f26a2858bc16af3eb90a37d78ae5dad3144b795edd3
Sep 08 16:49:14.647486 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.647441    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:14.647599 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.647514    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:14.647599 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.647547    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:14.678269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:14.678240    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" event={"ID":"6cfe5510-63ea-4cd4-b2b7-b794659006da","Type":"ContainerStarted","Data":"affec6345186c126ccb93f26a2858bc16af3eb90a37d78ae5dad3144b795edd3"}
Sep 08 16:49:15.428529 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:15.428474    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:15.686446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:15.686349    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" event={"ID":"6cfe5510-63ea-4cd4-b2b7-b794659006da","Type":"ContainerStarted","Data":"9240f3ecef838f50d8142abb4162c5e2b56c8f7d18bd5929e46833b5dd574d8c"}
Sep 08 16:49:15.708413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:15.708333    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podStartSLOduration=1.7083102110000001 podStartE2EDuration="1.708310211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:49:15.704591194 +0000 UTC m=+1123.693027186" watchObservedRunningTime="2026-09-08 16:49:15.708310211 +0000 UTC m=+1123.696746166"
Sep 08 16:49:15.764468 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:15.764435    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:16.132035 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:16.131954    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:16.288990 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:16.288949    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:16.364382 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:16.364342    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:16.369525 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:16.369491    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:16.691414 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:16.691387    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:16.692885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:16.692866    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:17.634216 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:17.634166    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:17.729485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:17.729453    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:18.811009 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:18.810958    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:18.911717 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:18.911685    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:19.085385 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:19.085242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:19.380628 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:19.380516    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:19.483920 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:19.483884    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:22.804694 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:22.804663    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:22.891404 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:22.891360    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:23.966416 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:23.966366    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"]
Sep 08 16:49:23.969541 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:23.969523    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:23.972084 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:23.972059    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-6e5401-serving-cert\""
Sep 08 16:49:23.983327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:23.983292    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"]
Sep 08 16:49:24.006430 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.006396    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:24.109410 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.109377    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:24.121906 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.121866    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.122063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.121958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7sdj\" (UniqueName: \"kubernetes.io/projected/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-kube-api-access-z7sdj\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.122063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.121985    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.122063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.122022    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.223297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.223191    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.223297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.223280    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.223551 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:49:24.223349    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-serving-cert: secret "maas-api-e2e-shared-b-w2-6e5401-serving-cert" not found
Sep 08 16:49:24.223551 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.223388    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7sdj\" (UniqueName: \"kubernetes.io/projected/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-kube-api-access-z7sdj\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.223551 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:49:24.223427    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls podName:f6f82f01-4080-4f32-bf51-2864c7e7c6a3 nodeName:}" failed. No retries permitted until 2026-09-08 16:49:24.723408756 +0000 UTC m=+1132.711844719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls") pod "maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" (UID: "f6f82f01-4080-4f32-bf51-2864c7e7c6a3") : secret "maas-api-e2e-shared-b-w2-6e5401-serving-cert" not found
Sep 08 16:49:24.223551 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.223445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.224034 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.224015    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.226047 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.226030    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.238005 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.237978    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7sdj\" (UniqueName: \"kubernetes.io/projected/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-kube-api-access-z7sdj\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.287542 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.287496    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:24.513521 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.513447    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:24.618813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.618773    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:24.731097 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.731048    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.737809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.737773    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:24.883910 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:24.883787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:25.162767 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:25.162736    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"]
Sep 08 16:49:25.164578 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:49:25.164552    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f82f01_4080_4f32_bf51_2864c7e7c6a3.slice/crio-af67a1e0a3cb816ac91e09bc6c94142fb813da1cce228c98c2f1367e5b9179ac WatchSource:0}: Error finding container af67a1e0a3cb816ac91e09bc6c94142fb813da1cce228c98c2f1367e5b9179ac: Status 404 returned error can't find the container with id af67a1e0a3cb816ac91e09bc6c94142fb813da1cce228c98c2f1367e5b9179ac
Sep 08 16:49:25.746740 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:25.746707    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" event={"ID":"f6f82f01-4080-4f32-bf51-2864c7e7c6a3","Type":"ContainerStarted","Data":"b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1"}
Sep 08 16:49:25.746975 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:25.746767    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" event={"ID":"f6f82f01-4080-4f32-bf51-2864c7e7c6a3","Type":"ContainerStarted","Data":"af67a1e0a3cb816ac91e09bc6c94142fb813da1cce228c98c2f1367e5b9179ac"}
Sep 08 16:49:25.746975 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:25.746863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:25.764461 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:25.764400    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" podStartSLOduration=2.281699855 podStartE2EDuration="2.764381489s" totalImagesPullingTime="482.681634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:49:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:49:25.762386339 +0000 UTC m=+1133.750822294" watchObservedRunningTime="2026-09-08 16:49:25.764381489 +0000 UTC m=+1133.752817487"
Sep 08 16:49:31.759127 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:31.759091    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:49:32.733049 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:32.733007    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 16:49:32.733223 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:32.733081    2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 16:49:34.801300 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:34.801259    2581 generic.go:356] "Generic (PLEG): container finished" podID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerID="9240f3ecef838f50d8142abb4162c5e2b56c8f7d18bd5929e46833b5dd574d8c" exitCode=0
Sep 08 16:49:34.801721 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:34.801335    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" event={"ID":"6cfe5510-63ea-4cd4-b2b7-b794659006da","Type":"ContainerDied","Data":"9240f3ecef838f50d8142abb4162c5e2b56c8f7d18bd5929e46833b5dd574d8c"}
Sep 08 16:49:34.801875 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:34.801824    2581 scope.go:117] "RemoveContainer" containerID="9240f3ecef838f50d8142abb4162c5e2b56c8f7d18bd5929e46833b5dd574d8c"
Sep 08 16:49:34.803126 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:34.803097    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:34.803197 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:34.803176    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:34.803234 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:34.803209    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:49:35.814199 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:35.814165    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" event={"ID":"6cfe5510-63ea-4cd4-b2b7-b794659006da","Type":"ContainerStarted","Data":"a993a6cf87abe7a16d690c3a74f06a3d6da2a6b83e88ce7224a6115ce9e030f5"}
Sep 08 16:49:36.365130 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:36.365084    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:36.365328 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:36.365305    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:49:36.365379 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:36.365355    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 16:49:37.364467 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:37.364431    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:49:37.364908 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:37.364488    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 16:49:38.364707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:38.364668    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:49:38.365154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:38.364732    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 16:49:39.364704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:39.364662    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:49:39.364947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:39.364738    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 16:49:39.804116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:39.804044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:40.364539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:40.364499    2581 patch_prober.go:28] interesting pod/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body=
Sep 08 16:49:40.364735 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:40.364560    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused"
Sep 08 16:49:41.368660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:41.368629    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:41.369089 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:41.368927    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:41.369689 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:41.369672    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 16:49:42.623017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:42.622988    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:44.539080 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:44.539039    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:45.082915 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:45.082872    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:47.453681 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:47.453619    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:47.764898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:47.764749    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:49.008669 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:49.008636    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:49:49.109394 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:49:49.109361    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:01.909054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:01.908967    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:02.201196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.201162    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"]
Sep 08 16:50:02.203767 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.203748    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.206750 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.206725    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e43c7719-openshift-default-dockercfg-25rxg\""
Sep 08 16:50:02.220685 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.220652    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"]
Sep 08 16:50:02.228382 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.228313    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:02.246044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246007    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-credential-socket\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246060    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-certs\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246156    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efd0e215-edcd-496a-8f1d-484d19017fb0-istiod-ca-cert\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246202    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-token\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-podinfo\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246301    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-envoy\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246343    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-data\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246405    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-socket\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.246499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.246438    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fxjf\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-kube-api-access-2fxjf\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347299    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efd0e215-edcd-496a-8f1d-484d19017fb0-istiod-ca-cert\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-token\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347580 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347481    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-podinfo\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347580 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347565    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-envoy\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347664 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-data\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347664 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347646    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-socket\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347677    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fxjf\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-kube-api-access-2fxjf\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347729    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-credential-socket\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.347905 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.347776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-certs\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.348134 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.348086    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-socket\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.348253 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.348142    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efd0e215-edcd-496a-8f1d-484d19017fb0-istiod-ca-cert\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.348858 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.348813    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-data\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.348966 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.348863    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-credential-socket\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.349016 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.348992    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-certs\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.350211 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.350194    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-envoy\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.350494 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.350475    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-podinfo\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.355597 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.355567    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-token\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.355728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.355614    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fxjf\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-kube-api-access-2fxjf\") pod \"e2e-mt-e43c7719-openshift-default-669477d46d-8bd26\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") " pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.373937 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.373905    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:02.515653 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.515535    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:02.802633 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.802598    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"]
Sep 08 16:50:02.804681 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:50:02.804646    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd0e215_edcd_496a_8f1d_484d19017fb0.slice/crio-016f5d5c1f9755ad6d0569211ffe4e4e38a045d2a098d47dd428b807a15b9a41 WatchSource:0}: Error finding container 016f5d5c1f9755ad6d0569211ffe4e4e38a045d2a098d47dd428b807a15b9a41: Status 404 returned error can't find the container with id 016f5d5c1f9755ad6d0569211ffe4e4e38a045d2a098d47dd428b807a15b9a41
Sep 08 16:50:02.807229 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.807190    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:50:02.807347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.807280    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:50:02.807347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.807323    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:50:02.977154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.977114    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" event={"ID":"efd0e215-edcd-496a-8f1d-484d19017fb0","Type":"ContainerStarted","Data":"5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"}
Sep 08 16:50:02.977641 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:02.977202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" event={"ID":"efd0e215-edcd-496a-8f1d-484d19017fb0","Type":"ContainerStarted","Data":"016f5d5c1f9755ad6d0569211ffe4e4e38a045d2a098d47dd428b807a15b9a41"}
Sep 08 16:50:03.001128 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:03.001072    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podStartSLOduration=1.001052432 podStartE2EDuration="1.001052432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:50:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:50:02.997936795 +0000 UTC m=+1170.986372771" watchObservedRunningTime="2026-09-08 16:50:03.001052432 +0000 UTC m=+1170.989488443"
Sep 08 16:50:03.516287 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:03.516240    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:03.522326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:03.522295    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:03.982775 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:03.982742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:03.983919 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:03.983895    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:05.086922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:05.086892    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:05.186994 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:05.186962    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:06.067962 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:06.067933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:06.163185 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:06.163147    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:06.430861 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:06.430794    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:06.614344 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:06.614307    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:06.710871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:06.710716    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:08.321118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:08.321077    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:26.114008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:26.113910    2581 generic.go:356] "Generic (PLEG): container finished" podID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerID="5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4" exitCode=0
Sep 08 16:50:26.114008 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:26.113983    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" event={"ID":"efd0e215-edcd-496a-8f1d-484d19017fb0","Type":"ContainerDied","Data":"5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"}
Sep 08 16:50:26.114466 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:26.114433    2581 scope.go:117] "RemoveContainer" containerID="5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"
Sep 08 16:50:26.115674 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:26.115648    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:50:26.115751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:26.115717    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:50:26.115788 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:26.115749    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:50:27.126017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:27.125965    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" event={"ID":"efd0e215-edcd-496a-8f1d-484d19017fb0","Type":"ContainerStarted","Data":"ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538"}
Sep 08 16:50:27.516564 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:27.516528    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:27.517014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:27.516916    2581 patch_prober.go:28] interesting pod/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 16:50:27.517218 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:27.517195    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 16:50:28.516278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:28.516235    2581 patch_prober.go:28] interesting pod/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 16:50:28.516946 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:28.516906    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 16:50:29.516873 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:29.516792    2581 patch_prober.go:28] interesting pod/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 16:50:29.517346 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:29.516920    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 16:50:30.054063 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:30.054024    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:50:30.517115 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:30.516578    2581 patch_prober.go:28] interesting pod/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 16:50:30.517115 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:30.516665    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 16:50:31.516246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:31.516203    2581 patch_prober.go:28] interesting pod/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Sep 08 16:50:31.516473 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:31.516277    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Sep 08 16:50:32.516291 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:32.516263    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:50:32.518783 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:32.518761    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:50:32.533587 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:32.533562    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:32.533890 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:32.533863    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:32.534637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:32.534619    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:50:44.452334 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:50:44.452296    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:20.969338 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:20.969281    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:25.192951 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:25.192829    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:25.306671 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:25.306638    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:25.406774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:25.406724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:25.491546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:25.491458    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:28.681223 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:28.681178    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:31.651422 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:31.651388    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:32.622332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:32.622299    2581 scope.go:117] "RemoveContainer" containerID="ccf4601c41ef5ee537822949c1e87c5022f04c38b1482bbfb724d9d4a56d237c"
Sep 08 16:51:33.733162 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:33.733091    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:59.695162 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:59.695089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:51:59.757662 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:51:59.757622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:11.717131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:11.717089    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:11.817779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:11.817725    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:16.080425 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:16.080353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:16.509967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:16.509922    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:18.129101 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:18.129065    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"]
Sep 08 16:52:18.129583 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:18.129275    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy" containerID="cri-o://ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538" gracePeriod=30
Sep 08 16:52:18.181391 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:18.181350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:18.284888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:18.284826    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:19.478156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:19.478119    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:19.577784 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:19.577732    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:20.312814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:20.312780    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:20.430226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:20.430186    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:21.836323 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:21.836283    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:23.338499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.338416    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:23.407817 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.407785    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:52:23.501285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501252    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-data\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501312    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-envoy\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efd0e215-edcd-496a-8f1d-484d19017fb0-istiod-ca-cert\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501382    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-token\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2fxjf\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-kube-api-access-2fxjf\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501443    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-credential-socket\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501748 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501489    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-podinfo\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501748 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501547    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-socket\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501748 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501596    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-data" (OuterVolumeSpecName: "istio-data") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:52:23.501748 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501643    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-certs\") pod \"efd0e215-edcd-496a-8f1d-484d19017fb0\" (UID: \"efd0e215-edcd-496a-8f1d-484d19017fb0\") "
Sep 08 16:52:23.501974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501876    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:52:23.501974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.501929    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efd0e215-edcd-496a-8f1d-484d19017fb0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:52:23.502174 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.502149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:52:23.502280 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.502249    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.502280 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.502268    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efd0e215-edcd-496a-8f1d-484d19017fb0-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.502385 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.502281    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.502679 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.502638    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:52:23.505332 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.505240    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-token" (OuterVolumeSpecName: "istio-token") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:52:23.505466 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.505238    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:52:23.505466 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.505261    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-kube-api-access-2fxjf" (OuterVolumeSpecName: "kube-api-access-2fxjf") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "kube-api-access-2fxjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:52:23.505466 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.505288    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "efd0e215-edcd-496a-8f1d-484d19017fb0" (UID: "efd0e215-edcd-496a-8f1d-484d19017fb0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:52:23.603349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.603310    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.603349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.603343    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.603349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.603352    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.603349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.603360    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.603637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.603368    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2fxjf\" (UniqueName: \"kubernetes.io/projected/efd0e215-edcd-496a-8f1d-484d19017fb0-kube-api-access-2fxjf\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.603637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.603379    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efd0e215-edcd-496a-8f1d-484d19017fb0-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:52:23.790301 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.790262    2581 generic.go:356] "Generic (PLEG): container finished" podID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerID="ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538" exitCode=0
Sep 08 16:52:23.790490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.790308    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"
Sep 08 16:52:23.790490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.790352    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" event={"ID":"efd0e215-edcd-496a-8f1d-484d19017fb0","Type":"ContainerDied","Data":"ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538"}
Sep 08 16:52:23.790490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.790415    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26" event={"ID":"efd0e215-edcd-496a-8f1d-484d19017fb0","Type":"ContainerDied","Data":"016f5d5c1f9755ad6d0569211ffe4e4e38a045d2a098d47dd428b807a15b9a41"}
Sep 08 16:52:23.790490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.790438    2581 scope.go:117] "RemoveContainer" containerID="ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538"
Sep 08 16:52:23.800599 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.800579    2581 scope.go:117] "RemoveContainer" containerID="5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"
Sep 08 16:52:23.814109 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.813814    2581 scope.go:117] "RemoveContainer" containerID="ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538"
Sep 08 16:52:23.814622 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:52:23.814589    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538\": container with ID starting with ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538 not found: ID does not exist" containerID="ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538"
Sep 08 16:52:23.814749 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.814635    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538"} err="failed to get container status \"ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538\": rpc error: code = NotFound desc = could not find container \"ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538\": container with ID starting with ae9453f08e25a98c87b768e7b0f6ef3a2e540503530d13e1b8b6438ba4587538 not found: ID does not exist"
Sep 08 16:52:23.814749 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.814663    2581 scope.go:117] "RemoveContainer" containerID="5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"
Sep 08 16:52:23.815410 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:52:23.815145    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4\": container with ID starting with 5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4 not found: ID does not exist" containerID="5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"
Sep 08 16:52:23.815410 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.815185    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4"} err="failed to get container status \"5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4\": rpc error: code = NotFound desc = could not find container \"5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4\": container with ID starting with 5dd074bbe24e91decc597d007b2c46aa8bd58d5e13dee9c58292e90fd3646fc4 not found: ID does not exist"
Sep 08 16:52:23.818497 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.818473    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"]
Sep 08 16:52:23.826503 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:23.826468    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e43c7719-openshift-default-669477d46d-8bd26"]
Sep 08 16:52:24.469269 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:24.469234    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" path="/var/lib/kubelet/pods/efd0e215-edcd-496a-8f1d-484d19017fb0/volumes"
Sep 08 16:52:28.336320 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:28.336280    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:28.432090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:28.432046    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:29.056421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:29.056382    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:35.772215 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:35.772182    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:35.929812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:35.929778    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:36.041459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:36.041346    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:45.687700 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:45.687666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:46.527888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:46.527797    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:46.767393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:46.767350    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:52:59.975032 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:52:59.974946    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:07.774477 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:07.774433    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:15.099438 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.099397    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:15.274088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.274044    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:15.484353 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.484318    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:15.797022 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.796927    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"]
Sep 08 16:53:15.797432 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.797417    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy"
Sep 08 16:53:15.797484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.797435    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy"
Sep 08 16:53:15.797484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.797456    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy"
Sep 08 16:53:15.797484 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.797462    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy"
Sep 08 16:53:15.797594 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.797525    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy"
Sep 08 16:53:15.797594 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.797536    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="efd0e215-edcd-496a-8f1d-484d19017fb0" containerName="istio-proxy"
Sep 08 16:53:15.801001 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.800976    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.804205 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.804185    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-246729-openshift-default-dockercfg-n7gj4\""
Sep 08 16:53:15.824052 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.824012    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"]
Sep 08 16:53:15.836366 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.836329    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:15.873056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.872954    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-certs\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.873613 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.873566    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-data\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.873809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.873788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t882\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-kube-api-access-5t882\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.874020 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.873991    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-credential-socket\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.874281 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.874247    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-socket\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.874489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.874471    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-envoy\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.875924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.875900    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d44a00d-bab1-4775-aeca-29a69ec9863e-istiod-ca-cert\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.876145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.876126    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-podinfo\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.876289 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.876275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-token\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978035    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-socket\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978262 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978112    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-envoy\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978262 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d44a00d-bab1-4775-aeca-29a69ec9863e-istiod-ca-cert\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978262 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-podinfo\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978262 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978244    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-token\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978302    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-certs\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978328    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-data\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978490    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t882\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-kube-api-access-5t882\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.978534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978521    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-socket\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.979019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978574    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-credential-socket\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.979019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978608    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-data\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.979019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978726    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-certs\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.979019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978887    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-credential-socket\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.979019 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.978910    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d44a00d-bab1-4775-aeca-29a69ec9863e-istiod-ca-cert\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.981419 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.981383    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-envoy\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.981639 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.981620    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-podinfo\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.990458 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.990423    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-token\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:15.990893 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:15.990819    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t882\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-kube-api-access-5t882\") pod \"e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") " pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:16.112293 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:16.112171    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:16.409596 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:16.409496    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"]
Sep 08 16:53:16.413139 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:53:16.413104    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d44a00d_bab1_4775_aeca_29a69ec9863e.slice/crio-1594e1eaeaf5a7879e611f5bddb5e898931c38a2cc8c553eb3db8d12408791c7 WatchSource:0}: Error finding container 1594e1eaeaf5a7879e611f5bddb5e898931c38a2cc8c553eb3db8d12408791c7: Status 404 returned error can't find the container with id 1594e1eaeaf5a7879e611f5bddb5e898931c38a2cc8c553eb3db8d12408791c7
Sep 08 16:53:16.415814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:16.415779    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:16.415926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:16.415880    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:16.415972 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:16.415933    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:16.535286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:16.535239    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:17.093405 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:17.093366    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" event={"ID":"6d44a00d-bab1-4775-aeca-29a69ec9863e","Type":"ContainerStarted","Data":"2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"}
Sep 08 16:53:17.093602 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:17.093430    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" event={"ID":"6d44a00d-bab1-4775-aeca-29a69ec9863e","Type":"ContainerStarted","Data":"1594e1eaeaf5a7879e611f5bddb5e898931c38a2cc8c553eb3db8d12408791c7"}
Sep 08 16:53:17.112500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:17.112466    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:17.118537 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:17.118505    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:17.145530 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:17.145468    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podStartSLOduration=2.14544942 podStartE2EDuration="2.14544942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:53:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:53:17.144108531 +0000 UTC m=+1365.132544500" watchObservedRunningTime="2026-09-08 16:53:17.14544942 +0000 UTC m=+1365.133885374"
Sep 08 16:53:18.098898 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:18.098869    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:18.099888 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:18.099870    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:19.335164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:19.335125    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:19.459530 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:19.459494    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:20.525469 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:20.525422    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:20.653759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:20.653730    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:20.809083 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:20.809001    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:21.297026 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:21.296993    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:21.437439 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:21.437405    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:34.129828 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:34.129788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:35.178606 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:35.178573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:42.258557 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:42.258521    2581 generic.go:356] "Generic (PLEG): container finished" podID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerID="2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b" exitCode=0
Sep 08 16:53:42.259024 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:42.258596    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" event={"ID":"6d44a00d-bab1-4775-aeca-29a69ec9863e","Type":"ContainerDied","Data":"2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"}
Sep 08 16:53:42.259086 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:42.259071    2581 scope.go:117] "RemoveContainer" containerID="2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"
Sep 08 16:53:42.260261 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:42.260233    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:42.260322 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:42.260301    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:42.260358 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:42.260335    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:43.272956 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:43.272920    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" event={"ID":"6d44a00d-bab1-4775-aeca-29a69ec9863e","Type":"ContainerStarted","Data":"def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c"}
Sep 08 16:53:44.112912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:44.112867    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:44.114443 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:44.114407    2581 patch_prober.go:28] interesting pod/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 16:53:44.114704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:44.114673    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 16:53:45.113646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:45.113605    2581 patch_prober.go:28] interesting pod/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 16:53:45.114309 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:45.114273    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 16:53:46.113268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:46.113211    2581 patch_prober.go:28] interesting pod/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 16:53:46.113512 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:46.113314    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 16:53:47.039540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:47.039499    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:47.112939 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:47.112899    2581 patch_prober.go:28] interesting pod/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 16:53:47.113258 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:47.113230    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 16:53:48.099168 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:48.099125    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:48.113145 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:48.113099    2581 patch_prober.go:28] interesting pod/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body=
Sep 08 16:53:48.113375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:48.113175    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused"
Sep 08 16:53:49.117260 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:49.117232    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:49.118446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:49.118422    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:53:49.272156 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:49.272114    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:49.744922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:49.744883    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:50.125180 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.125079    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"]
Sep 08 16:53:50.128013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.127994    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.130424 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.130398    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-7818c2-openshift-default-dockercfg-56xnb\""
Sep 08 16:53:50.146293 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.146265    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"]
Sep 08 16:53:50.166713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.166667    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhphs\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-kube-api-access-rhphs\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.166924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.166745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-socket\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.166924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.166778    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istiod-ca-cert\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.166924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.166903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-podinfo\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.167062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.166965    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-credential-socket\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.167062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.166997    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-envoy\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.167062 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.167017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-token\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.167158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.167087    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-certs\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.167158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.167110    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-data\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.189568 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.189529    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:50.268039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268000    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-podinfo\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268065    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-credential-socket\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268097    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-envoy\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-token\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268300    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-certs\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-data\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268373 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268363    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhphs\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-kube-api-access-rhphs\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268581 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268433    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-socket\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268581 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istiod-ca-cert\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268596    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-credential-socket\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268660    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-data\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.268881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.268820    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-certs\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.269088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.269064    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-socket\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.269544 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.269524    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istiod-ca-cert\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.270715 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.270696    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-envoy\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.271021 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.271006    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-podinfo\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.283243 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.283217    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-token\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.285566 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.285544    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhphs\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-kube-api-access-rhphs\") pod \"e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") " pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.439434 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.439397    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:50.500057 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.500017    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:50.732347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.732316    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"]
Sep 08 16:53:50.736580 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:53:50.736542    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef3b4df_f7d3_47c9_98e3_ce5a989caeaa.slice/crio-bf8b1c636c370528a0e9841f32ab67b54bab4cd92d79bb68e126212253f9a278 WatchSource:0}: Error finding container bf8b1c636c370528a0e9841f32ab67b54bab4cd92d79bb68e126212253f9a278: Status 404 returned error can't find the container with id bf8b1c636c370528a0e9841f32ab67b54bab4cd92d79bb68e126212253f9a278
Sep 08 16:53:50.739413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.739368    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:50.739545 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.739470    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:50.739545 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:50.739509    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:53:51.322033 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:51.321996    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" event={"ID":"def3b4df-f7d3-47c9-98e3-ce5a989caeaa","Type":"ContainerStarted","Data":"ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"}
Sep 08 16:53:51.322469 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:51.322054    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" event={"ID":"def3b4df-f7d3-47c9-98e3-ce5a989caeaa","Type":"ContainerStarted","Data":"bf8b1c636c370528a0e9841f32ab67b54bab4cd92d79bb68e126212253f9a278"}
Sep 08 16:53:51.361036 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:51.360983    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podStartSLOduration=1.360964832 podStartE2EDuration="1.360964832s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:53:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:53:51.359672708 +0000 UTC m=+1399.348108661" watchObservedRunningTime="2026-09-08 16:53:51.360964832 +0000 UTC m=+1399.349400786"
Sep 08 16:53:51.439615 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:51.439575    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:51.445209 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:51.445180    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:52.328270 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:52.328238    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:52.329431 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:52.329408    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:53:53.414090 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:53.414053    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:53.583325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:53.583286    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:54.772312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:54.772245    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:54.925423 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:54.925381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:55.228088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:55.228051    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:55.461196 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:55.461154    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:53:55.572018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:53:55.571928    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:06.798745 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:06.798703    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:11.937377 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:11.937340    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:13.458210 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:13.458180    2581 generic.go:356] "Generic (PLEG): container finished" podID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerID="ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec" exitCode=0
Sep 08 16:54:13.458642 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:13.458261    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" event={"ID":"def3b4df-f7d3-47c9-98e3-ce5a989caeaa","Type":"ContainerDied","Data":"ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"}
Sep 08 16:54:13.458733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:13.458717    2581 scope.go:117] "RemoveContainer" containerID="ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"
Sep 08 16:54:13.460040 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:13.460011    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:54:13.460113 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:13.460082    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:54:13.460150 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:13.460114    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:54:14.127523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:14.127485    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:14.467595 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:14.467558    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" event={"ID":"def3b4df-f7d3-47c9-98e3-ce5a989caeaa","Type":"ContainerStarted","Data":"b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b"}
Sep 08 16:54:15.439787 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:15.439744    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:54:15.440085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:15.440058    2581 patch_prober.go:28] interesting pod/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:54:15.440186 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:15.440134    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 16:54:16.440265 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:16.440220    2581 patch_prober.go:28] interesting pod/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:54:16.440663 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:16.440295    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 16:54:17.440712 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:17.440662    2581 patch_prober.go:28] interesting pod/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:54:17.441260 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:17.440752    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 16:54:17.858894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:17.858760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:18.440203 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:18.440160    2581 patch_prober.go:28] interesting pod/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:54:18.440405 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:18.440230    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 16:54:19.067900 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:19.067867    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:19.440711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:19.440670    2581 patch_prober.go:28] interesting pod/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:54:19.440934 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:19.440729    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 16:54:20.440747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:20.440703    2581 patch_prober.go:28] interesting pod/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 16:54:20.441218 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:20.440763    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 16:54:21.444270 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:21.444234    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:54:21.444668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:21.444554    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:54:21.445343 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:21.445323    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:54:23.501630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:23.501517    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:26.865240 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:26.865206    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:39.803699 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:39.803668    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:40.787194 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:40.787156    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:42.424480 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:42.424438    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:42.541382 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:42.541323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:42.643850 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:42.643809    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:42.741506 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:42.741460    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:42.825780 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:42.824901    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:43.246017 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:43.245985    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:47.297222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:47.297184    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:51.516694 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:51.516642    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:51.729213 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:51.729176    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:51.839827 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:51.839736    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"]
Sep 08 16:54:51.840022 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:51.839979    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy" containerID="cri-o://def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c" gracePeriod=30
Sep 08 16:54:52.021056 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:52.020998    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:52.506773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:52.506724    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:54:57.107134 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.107063    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:54:57.227232 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227198    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-socket\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227430 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227274    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-podinfo\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227430 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227305    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d44a00d-bab1-4775-aeca-29a69ec9863e-istiod-ca-cert\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227430 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227356    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-data\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227430 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227388    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-certs\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227440    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t882\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-kube-api-access-5t882\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227480    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-envoy\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.227722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227517    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:54:57.227722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227694    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:54:57.227722 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227713    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:54:57.228013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227533    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-credential-socket\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.228013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227782    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:54:57.228013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227809    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d44a00d-bab1-4775-aeca-29a69ec9863e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:54:57.228013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.227865    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-token\") pod \"6d44a00d-bab1-4775-aeca-29a69ec9863e\" (UID: \"6d44a00d-bab1-4775-aeca-29a69ec9863e\") "
Sep 08 16:54:57.228630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.228225    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.228630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.228241    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.228630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.228254    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d44a00d-bab1-4775-aeca-29a69ec9863e-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.228630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.228268    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.228630 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.228275    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.229660 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.229633    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:54:57.230067 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.230046    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:54:57.230285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.230264    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-kube-api-access-5t882" (OuterVolumeSpecName: "kube-api-access-5t882") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "kube-api-access-5t882". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:54:57.230285 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.230271    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d44a00d-bab1-4775-aeca-29a69ec9863e" (UID: "6d44a00d-bab1-4775-aeca-29a69ec9863e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:54:57.329442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.329396    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.329442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.329435    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t882\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-kube-api-access-5t882\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.329442 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.329450    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.329694 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.329465    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d44a00d-bab1-4775-aeca-29a69ec9863e-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:54:57.713132 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.713100    2581 generic.go:356] "Generic (PLEG): container finished" podID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerID="def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c" exitCode=0
Sep 08 16:54:57.713365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.713148    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"
Sep 08 16:54:57.713365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.713192    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" event={"ID":"6d44a00d-bab1-4775-aeca-29a69ec9863e","Type":"ContainerDied","Data":"def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c"}
Sep 08 16:54:57.713365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.713259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj" event={"ID":"6d44a00d-bab1-4775-aeca-29a69ec9863e","Type":"ContainerDied","Data":"1594e1eaeaf5a7879e611f5bddb5e898931c38a2cc8c553eb3db8d12408791c7"}
Sep 08 16:54:57.713365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.713291    2581 scope.go:117] "RemoveContainer" containerID="def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c"
Sep 08 16:54:57.723744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.723722    2581 scope.go:117] "RemoveContainer" containerID="2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"
Sep 08 16:54:57.732891 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.732870    2581 scope.go:117] "RemoveContainer" containerID="def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c"
Sep 08 16:54:57.733233 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:54:57.733213    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c\": container with ID starting with def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c not found: ID does not exist" containerID="def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c"
Sep 08 16:54:57.733296 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.733249    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c"} err="failed to get container status \"def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c\": rpc error: code = NotFound desc = could not find container \"def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c\": container with ID starting with def03f09a846cc09d5372429d96aeb9cdb579c0d12b72798a7207848ceda2a8c not found: ID does not exist"
Sep 08 16:54:57.733296 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.733271    2581 scope.go:117] "RemoveContainer" containerID="2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"
Sep 08 16:54:57.733497 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:54:57.733480    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b\": container with ID starting with 2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b not found: ID does not exist" containerID="2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"
Sep 08 16:54:57.733547 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.733503    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b"} err="failed to get container status \"2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b\": rpc error: code = NotFound desc = could not find container \"2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b\": container with ID starting with 2cde91f1e6426d6dc84c79a76c2f14060a4b2b96f2dd9c1e2fc16345453d0f2b not found: ID does not exist"
Sep 08 16:54:57.740728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.740696    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"]
Sep 08 16:54:57.748813 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:57.748723    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-246729-openshift-default-7dd86cc77b-6tpmj"]
Sep 08 16:54:58.467803 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:54:58.467754    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" path="/var/lib/kubelet/pods/6d44a00d-bab1-4775-aeca-29a69ec9863e/volumes"
Sep 08 16:55:08.116825 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:08.116788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:08.213122 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:08.213085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:08.335637 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:08.335596    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:08.506791 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:08.506760    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:08.642251 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:08.642217    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:08.813412 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:08.813323    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:14.181254 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:14.181216    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:15.097481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.097445    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:15.558163 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.558128    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:15.838499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.838409    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:15.895947 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.895906    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"]
Sep 08 16:55:15.896406 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.896392    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy"
Sep 08 16:55:15.896459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.896408    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy"
Sep 08 16:55:15.896459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.896416    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy"
Sep 08 16:55:15.896459 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.896422    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy"
Sep 08 16:55:15.896557 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.896487    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy"
Sep 08 16:55:15.900040 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.900019    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:15.905172 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.905147    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d2b1cc-openshift-default-dockercfg-9q97z\""
Sep 08 16:55:15.927074 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.927027    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"]
Sep 08 16:55:15.973519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:15.973486    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:16.024767 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.024714    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-data\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.024792    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-credential-socket\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.024823    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istiod-ca-cert\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.024903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-envoy\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.024937    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-token\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025044 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.025027    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-certs\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.025105    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-podinfo\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.025139    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-socket\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.025326 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.025271    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dd7\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-kube-api-access-h9dd7\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.101393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.101287    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:16.126777 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.126740    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-envoy\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.126777 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.126785    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-token\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.126876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-certs\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.126921    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-podinfo\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.126949    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-socket\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127093 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127063    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dd7\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-kube-api-access-h9dd7\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127111    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-data\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127151    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-credential-socket\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127312 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127175    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istiod-ca-cert\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127672    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-socket\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127877 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127827    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-certs\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.127986 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.127963    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istiod-ca-cert\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.128095 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.128074    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-data\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.128446 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.128422    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-credential-socket\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.128794 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.128775    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"]
Sep 08 16:55:16.129045 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.129016    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy" containerID="cri-o://b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b" gracePeriod=30
Sep 08 16:55:16.130390 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.130360    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-envoy\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.130642 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.130619    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-podinfo\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.137074 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.137047    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-token\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.141657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.141622    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dd7\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-kube-api-access-h9dd7\") pod \"e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") " pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.202458 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.202417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:16.212299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.212259    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:16.543438 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.543399    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"]
Sep 08 16:55:16.545255 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:55:16.545227    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1c7f542_2e70_48bb_86b3_9e326ea5074c.slice/crio-fcc4da8893e8ad7063f09831d05e5af465a4fb75267b17663f7d3b87e299f924 WatchSource:0}: Error finding container fcc4da8893e8ad7063f09831d05e5af465a4fb75267b17663f7d3b87e299f924: Status 404 returned error can't find the container with id fcc4da8893e8ad7063f09831d05e5af465a4fb75267b17663f7d3b87e299f924
Sep 08 16:55:16.547645 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.547610    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:16.547759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.547687    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:16.547759 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.547714    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:16.673768 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.673733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:16.826656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.826556    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" event={"ID":"b1c7f542-2e70-48bb-86b3-9e326ea5074c","Type":"ContainerStarted","Data":"f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"}
Sep 08 16:55:16.826656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.826620    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" event={"ID":"b1c7f542-2e70-48bb-86b3-9e326ea5074c","Type":"ContainerStarted","Data":"fcc4da8893e8ad7063f09831d05e5af465a4fb75267b17663f7d3b87e299f924"}
Sep 08 16:55:16.851322 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:16.851252    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podStartSLOduration=1.8512230619999999 podStartE2EDuration="1.851223062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:55:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:55:16.848584792 +0000 UTC m=+1484.837020755" watchObservedRunningTime="2026-09-08 16:55:16.851223062 +0000 UTC m=+1484.839659018"
Sep 08 16:55:17.213009 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:17.212968    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:17.218325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:17.218295    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:17.832538 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:17.832501    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:17.833500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:17.833480    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:18.889158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:18.889126    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:19.038872 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:19.038820    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:20.404457 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:20.404420    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:20.521522 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:20.521492    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:21.256784 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.256745    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:21.395007 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.394901    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:55:21.395158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.395062    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:21.502440 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502398    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhphs\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-kube-api-access-rhphs\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.502958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502450    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-podinfo\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.502958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502501    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-data\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.502958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502564    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-envoy\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.502958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-token\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.502958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istiod-ca-cert\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.502958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.502713    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-certs\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.505004 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.504259    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-data" (OuterVolumeSpecName: "istio-data") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:21.512369 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512327    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-token" (OuterVolumeSpecName: "istio-token") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:21.512659 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512494    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-kube-api-access-rhphs" (OuterVolumeSpecName: "kube-api-access-rhphs") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "kube-api-access-rhphs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:21.512763 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512518    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:21.512918 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512893    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:55:21.513082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512795    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:21.513082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512594    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-credential-socket\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.513082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.512989    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-socket\") pod \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\" (UID: \"def3b4df-f7d3-47c9-98e3-ce5a989caeaa\") "
Sep 08 16:55:21.513678 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.513656    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.513758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.513684    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhphs\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-kube-api-access-rhphs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.513758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.513699    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.513758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.513715    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.513758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.513734    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.513758 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.513747    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.514113 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.514025    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:21.514561 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.514526    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:21.520122 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.519427    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "def3b4df-f7d3-47c9-98e3-ce5a989caeaa" (UID: "def3b4df-f7d3-47c9-98e3-ce5a989caeaa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:55:21.614800 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.614759    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.614800 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.614802    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.615036 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.614819    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/def3b4df-f7d3-47c9-98e3-ce5a989caeaa-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:21.855697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.855659    2581 generic.go:356] "Generic (PLEG): container finished" podID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerID="b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b" exitCode=0
Sep 08 16:55:21.855940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.855721    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" event={"ID":"def3b4df-f7d3-47c9-98e3-ce5a989caeaa","Type":"ContainerDied","Data":"b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b"}
Sep 08 16:55:21.855940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.855723    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"
Sep 08 16:55:21.855940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.855819    2581 scope.go:117] "RemoveContainer" containerID="b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b"
Sep 08 16:55:21.855940 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.855806    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l" event={"ID":"def3b4df-f7d3-47c9-98e3-ce5a989caeaa","Type":"ContainerDied","Data":"bf8b1c636c370528a0e9841f32ab67b54bab4cd92d79bb68e126212253f9a278"}
Sep 08 16:55:21.866687 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.866665    2581 scope.go:117] "RemoveContainer" containerID="ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"
Sep 08 16:55:21.875668 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.875648    2581 scope.go:117] "RemoveContainer" containerID="b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b"
Sep 08 16:55:21.876090 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:21.876071    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b\": container with ID starting with b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b not found: ID does not exist" containerID="b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b"
Sep 08 16:55:21.876152 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.876100    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b"} err="failed to get container status \"b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b\": rpc error: code = NotFound desc = could not find container \"b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b\": container with ID starting with b09b4dad1289ea1dafe6c85f0ca3203cf6f246ae9f3bd9bebefdcb3d3f2e4b4b not found: ID does not exist"
Sep 08 16:55:21.876152 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.876120    2581 scope.go:117] "RemoveContainer" containerID="ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"
Sep 08 16:55:21.876348 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:21.876332    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec\": container with ID starting with ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec not found: ID does not exist" containerID="ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"
Sep 08 16:55:21.876384 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.876352    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec"} err="failed to get container status \"ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec\": rpc error: code = NotFound desc = could not find container \"ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec\": container with ID starting with ce161a8bb9c084254efe25294fa7971904ce6a9a8c54acca0cce8bf822bc04ec not found: ID does not exist"
Sep 08 16:55:21.886152 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.886119    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"]
Sep 08 16:55:21.892912 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:21.892884    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-7818c2-openshift-default-7b5c99f788-v2q8l"]
Sep 08 16:55:22.468491 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:22.468456    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" path="/var/lib/kubelet/pods/def3b4df-f7d3-47c9-98e3-ce5a989caeaa/volumes"
Sep 08 16:55:26.764455 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:26.764417    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:27.552913 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.552875    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"]
Sep 08 16:55:27.553154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.553132    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" podUID="6c1aefe8-8cf4-4978-adcb-1be132241d52" containerName="maas-api" containerID="cri-o://d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702" gracePeriod=30
Sep 08 16:55:27.596456 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.596424    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:27.832454 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.832298    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:27.882779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.882745    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:55:27.894926 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.894891    2581 generic.go:356] "Generic (PLEG): container finished" podID="6c1aefe8-8cf4-4978-adcb-1be132241d52" containerID="d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702" exitCode=0
Sep 08 16:55:27.895082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.894937    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"
Sep 08 16:55:27.895082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.894974    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" event={"ID":"6c1aefe8-8cf4-4978-adcb-1be132241d52","Type":"ContainerDied","Data":"d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702"}
Sep 08 16:55:27.895082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.895029    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l" event={"ID":"6c1aefe8-8cf4-4978-adcb-1be132241d52","Type":"ContainerDied","Data":"9b0fa8968dec5f816f1256fbe0f5118381192a5e67072a324396030ac939bf7a"}
Sep 08 16:55:27.895082 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.895053    2581 scope.go:117] "RemoveContainer" containerID="d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702"
Sep 08 16:55:27.930335 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.929755    2581 scope.go:117] "RemoveContainer" containerID="d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702"
Sep 08 16:55:27.931108 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:27.931032    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702\": container with ID starting with d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702 not found: ID does not exist" containerID="d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702"
Sep 08 16:55:27.931108 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.931075    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702"} err="failed to get container status \"d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702\": rpc error: code = NotFound desc = could not find container \"d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702\": container with ID starting with d0d38e7f607f8bcee9612a4f2e77ee73dd9eaf91616afaa5d0b7c6565efe6702 not found: ID does not exist"
Sep 08 16:55:27.935279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.935096    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:27.987535 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.987495    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls\") pod \"6c1aefe8-8cf4-4978-adcb-1be132241d52\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") "
Sep 08 16:55:27.987728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.987544    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-metrics-certs\") pod \"6c1aefe8-8cf4-4978-adcb-1be132241d52\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") "
Sep 08 16:55:27.987728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.987583    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1aefe8-8cf4-4978-adcb-1be132241d52-openshift-service-ca\") pod \"6c1aefe8-8cf4-4978-adcb-1be132241d52\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") "
Sep 08 16:55:27.987728 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.987696    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm5l6\" (UniqueName: \"kubernetes.io/projected/6c1aefe8-8cf4-4978-adcb-1be132241d52-kube-api-access-tm5l6\") pod \"6c1aefe8-8cf4-4978-adcb-1be132241d52\" (UID: \"6c1aefe8-8cf4-4978-adcb-1be132241d52\") "
Sep 08 16:55:27.988014 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.987988    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6c1aefe8-8cf4-4978-adcb-1be132241d52-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6c1aefe8-8cf4-4978-adcb-1be132241d52" (UID: "6c1aefe8-8cf4-4978-adcb-1be132241d52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:55:27.988182 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.988170    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6c1aefe8-8cf4-4978-adcb-1be132241d52-openshift-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:27.989892 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.989861    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6c1aefe8-8cf4-4978-adcb-1be132241d52" (UID: "6c1aefe8-8cf4-4978-adcb-1be132241d52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:55:27.990435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.990411    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6c1aefe8-8cf4-4978-adcb-1be132241d52" (UID: "6c1aefe8-8cf4-4978-adcb-1be132241d52"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:55:27.990435 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:27.990428    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c1aefe8-8cf4-4978-adcb-1be132241d52-kube-api-access-tm5l6" (OuterVolumeSpecName: "kube-api-access-tm5l6") pod "6c1aefe8-8cf4-4978-adcb-1be132241d52" (UID: "6c1aefe8-8cf4-4978-adcb-1be132241d52"). InnerVolumeSpecName "kube-api-access-tm5l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:28.089688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.089587    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-maas-api-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:28.089688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.089635    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c1aefe8-8cf4-4978-adcb-1be132241d52-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:28.089688 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.089651    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm5l6\" (UniqueName: \"kubernetes.io/projected/6c1aefe8-8cf4-4978-adcb-1be132241d52-kube-api-access-tm5l6\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:28.129862 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.116171    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:28.249173 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.249138    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"]
Sep 08 16:55:28.264828 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.264785    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-1df9f8-6b9bd64c64-zwn6l"]
Sep 08 16:55:28.282510 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.282477    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:28.468116 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.468078    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6c1aefe8-8cf4-4978-adcb-1be132241d52" path="/var/lib/kubelet/pods/6c1aefe8-8cf4-4978-adcb-1be132241d52/volumes"
Sep 08 16:55:28.495711 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:28.495682    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:32.562779 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:32.562753    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:55:32.566057 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:32.566032    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 16:55:36.303986 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.303937    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:36.405416 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.405335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:36.517070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.516983    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:36.574696 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.574662    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"]
Sep 08 16:55:36.574960 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.574920    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy" containerID="cri-o://8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74" gracePeriod=30
Sep 08 16:55:36.719494 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.719455    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:36.958747 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.958711    2581 generic.go:356] "Generic (PLEG): container finished" podID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerID="f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36" exitCode=0
Sep 08 16:55:36.958996 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.958791    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" event={"ID":"b1c7f542-2e70-48bb-86b3-9e326ea5074c","Type":"ContainerDied","Data":"f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"}
Sep 08 16:55:36.959363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.959343    2581 scope.go:117] "RemoveContainer" containerID="f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"
Sep 08 16:55:36.960809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.960765    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:36.960956 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.960913    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:36.961003 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:36.960989    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:37.285563 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:37.285472    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:37.966341 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:37.966300    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" event={"ID":"b1c7f542-2e70-48bb-86b3-9e326ea5074c","Type":"ContainerStarted","Data":"da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097"}
Sep 08 16:55:38.212774 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:38.212742    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:38.213154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:38.213133    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 16:55:38.213319 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:38.213296    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 16:55:39.213286 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:39.213240    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 16:55:39.213943 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:39.213905    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 16:55:40.213275 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:40.213224    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 16:55:40.213499 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:40.213301    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 16:55:41.213200 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.213149    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 16:55:41.213423 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.213233    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 16:55:41.887072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.887046    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:55:41.957047 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957010    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-envoy\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957198 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-credential-socket\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957198 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957130    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-socket\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957198 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957182    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkdhp\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-kube-api-access-wkdhp\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957216    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-token\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957274    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-data\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957303    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eae15cd0-c21f-4547-b7a7-f495577d7b38-istiod-ca-cert\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957340    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-certs\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957378 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957375    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-podinfo\") pod \"eae15cd0-c21f-4547-b7a7-f495577d7b38\" (UID: \"eae15cd0-c21f-4547-b7a7-f495577d7b38\") "
Sep 08 16:55:41.957636 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957416    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:41.957636 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957495    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:41.957750 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957629    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-data" (OuterVolumeSpecName: "istio-data") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:41.957809 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957767    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:41.957894 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957828    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eae15cd0-c21f-4547-b7a7-f495577d7b38-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:55:41.957958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957897    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:41.957958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957920    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:41.957958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957934    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:41.957958 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.957946    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:41.960220 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.960182    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-token" (OuterVolumeSpecName: "istio-token") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:41.960365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.960210    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:55:41.960365 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.960300    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-kube-api-access-wkdhp" (OuterVolumeSpecName: "kube-api-access-wkdhp") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "kube-api-access-wkdhp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:41.960523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.960506    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eae15cd0-c21f-4547-b7a7-f495577d7b38" (UID: "eae15cd0-c21f-4547-b7a7-f495577d7b38"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:55:41.990054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.990015    2581 generic.go:356] "Generic (PLEG): container finished" podID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerID="8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74" exitCode=0
Sep 08 16:55:41.990222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.990088    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"
Sep 08 16:55:41.990222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.990106    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" event={"ID":"eae15cd0-c21f-4547-b7a7-f495577d7b38","Type":"ContainerDied","Data":"8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74"}
Sep 08 16:55:41.990222 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.990202    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd" event={"ID":"eae15cd0-c21f-4547-b7a7-f495577d7b38","Type":"ContainerDied","Data":"857fbaec61a73b50a0fa31dade4d56bea4abe3343d2bca7e3151fb7abe9561b7"}
Sep 08 16:55:41.990363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:41.990226    2581 scope.go:117] "RemoveContainer" containerID="8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74"
Sep 08 16:55:42.000225 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.000201    2581 scope.go:117] "RemoveContainer" containerID="f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"
Sep 08 16:55:42.034091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.034068    2581 scope.go:117] "RemoveContainer" containerID="8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74"
Sep 08 16:55:42.034498 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:42.034476    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74\": container with ID starting with 8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74 not found: ID does not exist" containerID="8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74"
Sep 08 16:55:42.034583 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.034509    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74"} err="failed to get container status \"8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74\": rpc error: code = NotFound desc = could not find container \"8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74\": container with ID starting with 8d6c075683555282ba27c773eef20b5915d28dc4178b6e65b8b04647f8440e74 not found: ID does not exist"
Sep 08 16:55:42.034583 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.034527    2581 scope.go:117] "RemoveContainer" containerID="f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"
Sep 08 16:55:42.034813 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:42.034791    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c\": container with ID starting with f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c not found: ID does not exist" containerID="f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"
Sep 08 16:55:42.034885 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.034818    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c"} err="failed to get container status \"f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c\": rpc error: code = NotFound desc = could not find container \"f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c\": container with ID starting with f389dcbd0e922e504c0b7365e20b8967b5cd8ec68b605dd5c2c569396963a31c not found: ID does not exist"
Sep 08 16:55:42.056974 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.056936    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"]
Sep 08 16:55:42.058828 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.058808    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:42.058922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.058864    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkdhp\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-kube-api-access-wkdhp\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:42.058922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.058876    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:42.058922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.058885    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eae15cd0-c21f-4547-b7a7-f495577d7b38-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:42.058922 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.058894    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eae15cd0-c21f-4547-b7a7-f495577d7b38-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:42.067383 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.067353    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-1df9f8-openshift-default-694fd9c674-wt7qd"]
Sep 08 16:55:42.213395 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.213349    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 16:55:42.213619 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.213450    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 16:55:42.467601 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:42.467523    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" path="/var/lib/kubelet/pods/eae15cd0-c21f-4547-b7a7-f495577d7b38/volumes"
Sep 08 16:55:43.213204 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:43.213158    2581 patch_prober.go:28] interesting pod/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 16:55:43.213710 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:43.213230    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 16:55:43.715736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:43.715699    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:44.216670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:44.216640    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:44.217137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:44.217064    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:44.217748 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:44.217732    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:55:47.279558 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:47.279522    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:48.233504 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.233467    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"]
Sep 08 16:55:48.233739 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.233711    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" podUID="f6f82f01-4080-4f32-bf51-2864c7e7c6a3" containerName="maas-api" containerID="cri-o://b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1" gracePeriod=30
Sep 08 16:55:48.340294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.340260    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:48.495224 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.495152    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:55:48.586451 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.586383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:48.629951 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.629915    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-openshift-service-ca\") pod \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") "
Sep 08 16:55:48.630164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.630021    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls\") pod \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") "
Sep 08 16:55:48.630164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.630063    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7sdj\" (UniqueName: \"kubernetes.io/projected/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-kube-api-access-z7sdj\") pod \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") "
Sep 08 16:55:48.630164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.630093    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-metrics-certs\") pod \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\" (UID: \"f6f82f01-4080-4f32-bf51-2864c7e7c6a3\") "
Sep 08 16:55:48.630360 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.630339    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6f82f01-4080-4f32-bf51-2864c7e7c6a3" (UID: "f6f82f01-4080-4f32-bf51-2864c7e7c6a3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:55:48.630550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.630529    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-openshift-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:48.632402 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.632373    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6f82f01-4080-4f32-bf51-2864c7e7c6a3" (UID: "f6f82f01-4080-4f32-bf51-2864c7e7c6a3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:55:48.632518 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.632500    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6f82f01-4080-4f32-bf51-2864c7e7c6a3" (UID: "f6f82f01-4080-4f32-bf51-2864c7e7c6a3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:55:48.632571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.632526    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-kube-api-access-z7sdj" (OuterVolumeSpecName: "kube-api-access-z7sdj") pod "f6f82f01-4080-4f32-bf51-2864c7e7c6a3" (UID: "f6f82f01-4080-4f32-bf51-2864c7e7c6a3"). InnerVolumeSpecName "kube-api-access-z7sdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:55:48.733864 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.733796    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-maas-api-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:48.734125 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.733877    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7sdj\" (UniqueName: \"kubernetes.io/projected/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-kube-api-access-z7sdj\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:48.734125 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.733893    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6f82f01-4080-4f32-bf51-2864c7e7c6a3-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:55:48.959291 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:48.959255    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:49.029482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.029443    2581 generic.go:356] "Generic (PLEG): container finished" podID="f6f82f01-4080-4f32-bf51-2864c7e7c6a3" containerID="b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1" exitCode=0
Sep 08 16:55:49.029482 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.029477    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" event={"ID":"f6f82f01-4080-4f32-bf51-2864c7e7c6a3","Type":"ContainerDied","Data":"b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1"}
Sep 08 16:55:49.029744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.029526    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"
Sep 08 16:55:49.029744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.029541    2581 scope.go:117] "RemoveContainer" containerID="b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1"
Sep 08 16:55:49.029744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.029530    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2" event={"ID":"f6f82f01-4080-4f32-bf51-2864c7e7c6a3","Type":"ContainerDied","Data":"af67a1e0a3cb816ac91e09bc6c94142fb813da1cce228c98c2f1367e5b9179ac"}
Sep 08 16:55:49.043670 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.043638    2581 scope.go:117] "RemoveContainer" containerID="b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1"
Sep 08 16:55:49.044037 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:49.044009    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1\": container with ID starting with b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1 not found: ID does not exist" containerID="b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1"
Sep 08 16:55:49.044146 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.044045    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1"} err="failed to get container status \"b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1\": rpc error: code = NotFound desc = could not find container \"b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1\": container with ID starting with b72399419124bc8357d4ade908dc7add57e3643def8a6894918de3bb8d50edd1 not found: ID does not exist"
Sep 08 16:55:49.071129 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.071092    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"]
Sep 08 16:55:49.094210 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.094166    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-6e5401-6ccdf57d64-dh7t2"]
Sep 08 16:55:49.096597 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.096573    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:49.362490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.362403    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:49.728164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:49.728136    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:50.184305 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184268    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"]
Sep 08 16:55:50.184707 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184694    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f82f01-4080-4f32-bf51-2864c7e7c6a3" containerName="maas-api"
Sep 08 16:55:50.184751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184708    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f82f01-4080-4f32-bf51-2864c7e7c6a3" containerName="maas-api"
Sep 08 16:55:50.184751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184727    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy"
Sep 08 16:55:50.184751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184733    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy"
Sep 08 16:55:50.184751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184740    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c1aefe8-8cf4-4978-adcb-1be132241d52" containerName="maas-api"
Sep 08 16:55:50.184751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184745    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c1aefe8-8cf4-4978-adcb-1be132241d52" containerName="maas-api"
Sep 08 16:55:50.184751 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184752    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184757    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184775    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184782    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184789    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184794    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184881    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184890    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f82f01-4080-4f32-bf51-2864c7e7c6a3" containerName="maas-api"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184896    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d44a00d-bab1-4775-aeca-29a69ec9863e" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184903    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184910    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="eae15cd0-c21f-4547-b7a7-f495577d7b38" containerName="istio-proxy"
Sep 08 16:55:50.184989 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.184915    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c1aefe8-8cf4-4978-adcb-1be132241d52" containerName="maas-api"
Sep 08 16:55:50.189245 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.189227    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.202216 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.202191    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-84ba67-openshift-default-dockercfg-z2p8w\""
Sep 08 16:55:50.225481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.225448    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"]
Sep 08 16:55:50.232678 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.232640    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:50.351223 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351186    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-token\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-data\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351355    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8gh9\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-kube-api-access-q8gh9\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351463 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351408    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-certs\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351578 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351465    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-socket\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351578 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-podinfo\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351578 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-credential-socket\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351585    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-envoy\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.351680 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.351607    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istiod-ca-cert\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.452666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452567    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-envoy\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.452666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452611    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istiod-ca-cert\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.452666 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452658    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-token\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-data\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452781    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8gh9\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-kube-api-access-q8gh9\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-certs\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-socket\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452923    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-podinfo\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.452952    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-credential-socket\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.453155    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-data\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453279 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.453225    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-certs\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.453443    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istiod-ca-cert\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453704 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.453676    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-credential-socket\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.453799 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.453715    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-socket\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.455021 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.455001    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-envoy\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.455723 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.455701    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-podinfo\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.468039 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.468004    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8gh9\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-kube-api-access-q8gh9\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.469621 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.469590    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f82f01-4080-4f32-bf51-2864c7e7c6a3" path="/var/lib/kubelet/pods/f6f82f01-4080-4f32-bf51-2864c7e7c6a3/volumes"
Sep 08 16:55:50.471072 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.471052    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-token\") pod \"e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") " pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.486000 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.485968    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:50.499683 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.499646    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:50.789434 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.789353    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"]
Sep 08 16:55:50.792438 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:55:50.792406    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce9eeca_9f3d_4bdf_83d9_ed58299c8940.slice/crio-3c2b301c32bc165c2fb0ccc1e2c05fb4942d3ad97b37c52f261a9baab17ac461 WatchSource:0}: Error finding container 3c2b301c32bc165c2fb0ccc1e2c05fb4942d3ad97b37c52f261a9baab17ac461: Status 404 returned error can't find the container with id 3c2b301c32bc165c2fb0ccc1e2c05fb4942d3ad97b37c52f261a9baab17ac461
Sep 08 16:55:50.794966 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.794933    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:50.795085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.795017    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:50.795085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:50.795061    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:55:51.043697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:51.043606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" event={"ID":"fce9eeca-9f3d-4bdf-83d9-ed58299c8940","Type":"ContainerStarted","Data":"05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"}
Sep 08 16:55:51.043697 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:51.043671    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" event={"ID":"fce9eeca-9f3d-4bdf-83d9-ed58299c8940","Type":"ContainerStarted","Data":"3c2b301c32bc165c2fb0ccc1e2c05fb4942d3ad97b37c52f261a9baab17ac461"}
Sep 08 16:55:51.076481 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:51.076423    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podStartSLOduration=1.076404775 podStartE2EDuration="1.076404775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:55:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:55:51.075690418 +0000 UTC m=+1519.064126372" watchObservedRunningTime="2026-09-08 16:55:51.076404775 +0000 UTC m=+1519.064840728"
Sep 08 16:55:51.500690 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:51.500643    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:51.505972 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:51.505942    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:52.049703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:52.049667    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:52.050663 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:52.050642    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:55:53.172542 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:53.172503    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:53.424364 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:53.424246    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:53.757443 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:53.757407    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:54.406306 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.406264    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"]
Sep 08 16:55:54.406823 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.406807    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="def3b4df-f7d3-47c9-98e3-ce5a989caeaa" containerName="istio-proxy"
Sep 08 16:55:54.410490 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.410461    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.416852 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.416789    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-84ba67-serving-cert\""
Sep 08 16:55:54.430420 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.430385    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"]
Sep 08 16:55:54.484903 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.484870    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:54.491672 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.491626    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e17238-cb3d-49ab-95d7-df2e7b6cea16-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.491899 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.491785    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-metrics-certs\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.492298 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.492270    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.492425 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.492379    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dczj7\" (UniqueName: \"kubernetes.io/projected/06e17238-cb3d-49ab-95d7-df2e7b6cea16-kube-api-access-dczj7\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.593901 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.593862    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-metrics-certs\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.594118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.593964    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.594118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.594005    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dczj7\" (UniqueName: \"kubernetes.io/projected/06e17238-cb3d-49ab-95d7-df2e7b6cea16-kube-api-access-dczj7\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.594118 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.594099    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e17238-cb3d-49ab-95d7-df2e7b6cea16-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.594277 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:54.594120    2581 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-serving-cert: secret "maas-api-e2e-ipp-b-84ba67-serving-cert" not found
Sep 08 16:55:54.594277 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:55:54.594197    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls podName:06e17238-cb3d-49ab-95d7-df2e7b6cea16 nodeName:}" failed. No retries permitted until 2026-09-08 16:55:55.09417964 +0000 UTC m=+1523.082615588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls") pod "maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" (UID: "06e17238-cb3d-49ab-95d7-df2e7b6cea16") : secret "maas-api-e2e-ipp-b-84ba67-serving-cert" not found
Sep 08 16:55:54.595096 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.595069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e17238-cb3d-49ab-95d7-df2e7b6cea16-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.596632 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.596609    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-metrics-certs\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.607773 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.607746    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dczj7\" (UniqueName: \"kubernetes.io/projected/06e17238-cb3d-49ab-95d7-df2e7b6cea16-kube-api-access-dczj7\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:54.634349 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.634312    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:54.805671 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:54.805631    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:55.099972 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.099764    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:55.102561 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.102529    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls\") pod \"maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:55.275691 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.275656    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:55.323005 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.322958    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:55.618794 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.618754    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:55.665167 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.665141    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"]
Sep 08 16:55:55.667215 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:55:55.667182    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06e17238_cb3d_49ab_95d7_df2e7b6cea16.slice/crio-96e165a550cc6e240c5798b56f8f9a260139db8157d38a06d2f7fbc64fa93b7c WatchSource:0}: Error finding container 96e165a550cc6e240c5798b56f8f9a260139db8157d38a06d2f7fbc64fa93b7c: Status 404 returned error can't find the container with id 96e165a550cc6e240c5798b56f8f9a260139db8157d38a06d2f7fbc64fa93b7c
Sep 08 16:55:55.668736 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:55.668716    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:55:56.073871 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:56.073800    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" event={"ID":"06e17238-cb3d-49ab-95d7-df2e7b6cea16","Type":"ContainerStarted","Data":"96e165a550cc6e240c5798b56f8f9a260139db8157d38a06d2f7fbc64fa93b7c"}
Sep 08 16:55:57.080738 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:57.080697    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" event={"ID":"06e17238-cb3d-49ab-95d7-df2e7b6cea16","Type":"ContainerStarted","Data":"fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca"}
Sep 08 16:55:57.081173 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:57.080773    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:55:57.117413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:57.117353    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" podStartSLOduration=2.66293725 podStartE2EDuration="3.11733395s" totalImagesPullingTime="454.3967ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:55:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:55:57.116966246 +0000 UTC m=+1525.105402201" watchObservedRunningTime="2026-09-08 16:55:57.11733395 +0000 UTC m=+1525.105769906"
Sep 08 16:55:59.323268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:59.323230    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:59.499539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:59.499495    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:55:59.709130 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:55:59.709070    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:03.092976 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:03.092941    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:56:11.170376 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:11.170336    2581 generic.go:356] "Generic (PLEG): container finished" podID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerID="05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf" exitCode=0
Sep 08 16:56:11.170822 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:11.170408    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" event={"ID":"fce9eeca-9f3d-4bdf-83d9-ed58299c8940","Type":"ContainerDied","Data":"05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"}
Sep 08 16:56:11.170917 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:11.170900    2581 scope.go:117] "RemoveContainer" containerID="05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"
Sep 08 16:56:11.172136 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:11.172094    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:56:11.172235 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:11.172174    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:56:11.172235 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:11.172210    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:56:12.178071 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:12.178032    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" event={"ID":"fce9eeca-9f3d-4bdf-83d9-ed58299c8940","Type":"ContainerStarted","Data":"0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1"}
Sep 08 16:56:12.500299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:12.500211    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:56:12.500498 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:12.500476    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:56:12.500554 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:12.500525    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 08 16:56:13.500180 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:13.500142    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:56:13.500590 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:13.500202    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 08 16:56:14.500193 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:14.500154    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:56:14.500692 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:14.500225    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 08 16:56:15.500575 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:15.500530    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:56:15.501011 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:15.500599    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 08 16:56:16.500665 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:16.500626    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:56:16.501107 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:16.500683    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 08 16:56:17.500361 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:17.500324    2581 patch_prober.go:28] interesting pod/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 08 16:56:17.500596 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:17.500383    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 08 16:56:18.139489 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:18.139452    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:18.504270 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:18.504235    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:56:18.504546 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:18.504524    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:56:18.505445 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:18.505420    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:56:21.787826 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:21.787788    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:27.631577 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:27.631536    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:49.393771 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.393735    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:49.707043 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.707009    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"]
Sep 08 16:56:49.712339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.712222    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.714928 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.714899    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-a0a70f-openshift-default-dockercfg-zjnph\""
Sep 08 16:56:49.736383 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.736347    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"]
Sep 08 16:56:49.760706 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.760666    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:49.812472 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.812435    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-data\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.812877 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.812852    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x82kx\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-kube-api-access-x82kx\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813037 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813023    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-certs\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813150    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-envoy\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813293 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813280    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-credential-socket\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813402 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813390    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-podinfo\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813555 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813531    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-socket\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813691 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-token\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.813824 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.813810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915007 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.914968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-credential-socket\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915007 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915011    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-podinfo\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915051    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-socket\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915088    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-token\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915122    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915167    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-data\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915258    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x82kx\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-kube-api-access-x82kx\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-certs\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915626 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915327    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-envoy\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915626 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915471    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-socket\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915626 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915607    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-data\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915757 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915727    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-credential-socket\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915825 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915804    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-certs\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.915991 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.915968    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.917768 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.917744    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-envoy\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.917904 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.917856    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-podinfo\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.928692 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.928664    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x82kx\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-kube-api-access-x82kx\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.929802 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.929779    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-token\") pod \"e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") " pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:49.942418 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:49.942381    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:50.023305 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:50.023199    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:50.310288 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:50.310253    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"]
Sep 08 16:56:50.312800 ip-10-0-131-47 kubenswrapper[2581]: W0908 16:56:50.312773    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cbeeb0d_f432_4e62_b589_b0ed220c4ceb.slice/crio-408b9c539ca3f0d0d1c9207c50f9b625008bbee01deb6b3b923faddf232d85cf WatchSource:0}: Error finding container 408b9c539ca3f0d0d1c9207c50f9b625008bbee01deb6b3b923faddf232d85cf: Status 404 returned error can't find the container with id 408b9c539ca3f0d0d1c9207c50f9b625008bbee01deb6b3b923faddf232d85cf
Sep 08 16:56:50.315235 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:50.315203    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:56:50.315319 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:50.315272    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:56:50.315319 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:50.315302    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:56:50.385673 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:50.385642    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" event={"ID":"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb","Type":"ContainerStarted","Data":"408b9c539ca3f0d0d1c9207c50f9b625008bbee01deb6b3b923faddf232d85cf"}
Sep 08 16:56:51.393646 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:51.393610    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" event={"ID":"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb","Type":"ContainerStarted","Data":"dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"}
Sep 08 16:56:51.421730 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:51.421668    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podStartSLOduration=2.421649639 podStartE2EDuration="2.421649639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:56:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:56:51.418696124 +0000 UTC m=+1579.407132077" watchObservedRunningTime="2026-09-08 16:56:51.421649639 +0000 UTC m=+1579.410085593"
Sep 08 16:56:52.024066 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:52.024023    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:52.029698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:52.029669    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:52.399280 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:52.399194    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:52.400363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:52.400343    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:56:53.501048 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:53.501009    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:53.676166 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:53.676131    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:54.851131 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:54.851085    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:54.939413 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:54.939383    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:55.041088 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:55.041054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:55.502968 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:55.502936    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:56:55.607023 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:56:55.606992    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:11.506268 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:11.506184    2581 generic.go:356] "Generic (PLEG): container finished" podID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerID="dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b" exitCode=0
Sep 08 16:57:11.506684 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:11.506259    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" event={"ID":"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb","Type":"ContainerDied","Data":"dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"}
Sep 08 16:57:11.506803 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:11.506786    2581 scope.go:117] "RemoveContainer" containerID="dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"
Sep 08 16:57:11.508183 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:11.508150    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:57:11.508295 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:11.508242    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:57:11.508295 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:11.508290    2581 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Sep 08 16:57:12.517737 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:12.517688    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" event={"ID":"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb","Type":"ContainerStarted","Data":"b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97"}
Sep 08 16:57:13.024263 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:13.024218    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:57:13.024589 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:13.024551    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:57:13.024692 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:13.024625    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 08 16:57:14.023914 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:14.023868    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:57:14.024441 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:14.023942    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 08 16:57:15.024444 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:15.024404    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:57:15.025105 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:15.025069    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 08 16:57:16.024077 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:16.024025    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:57:16.024310 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:16.024105    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 08 16:57:17.024013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:17.023961    2581 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 08 16:57:17.024534 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:17.024038    2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 08 16:57:18.028426 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:18.028393    2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:57:18.028793 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:18.028771    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:57:18.029501 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:18.029486    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:57:18.477881 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:18.477825    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:19.115496 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:19.115464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:25.835458 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:25.835410    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:26.408397 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:26.408356    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:26.574372 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:26.574335    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:26.902120 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:26.902090    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:34.611703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:34.611657    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:34.870030 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:34.869937    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"]
Sep 08 16:57:34.870187 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:34.870150    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy" containerID="cri-o://b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97" gracePeriod=30
Sep 08 16:57:34.935749 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:34.935715    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:38.962682 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:38.962649    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:40.119523 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.119492    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:57:40.167451 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167354    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x82kx\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-kube-api-access-x82kx\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167451 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167400    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-socket\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167451 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-envoy\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167457    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-credential-socket\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167488    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-certs\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167527    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-token\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167579    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-data\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167602    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-podinfo\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167633    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istiod-ca-cert\") pod \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\" (UID: \"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb\") "
Sep 08 16:57:40.167744 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:57:40.168119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167879    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:57:40.168119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.167905    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:57:40.168119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.168041    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.168119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.168061    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.168119 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.168075    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.168539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.168173    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:57:40.168539 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.168301    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:57:40.169880 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.169854    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-kube-api-access-x82kx" (OuterVolumeSpecName: "kube-api-access-x82kx") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "kube-api-access-x82kx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:57:40.170164 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.170143    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:57:40.170337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.170319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:57:40.170337 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.170318    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" (UID: "4cbeeb0d-f432-4e62-b589-b0ed220c4ceb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:57:40.269339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.269294    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.269339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.269332    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.269339 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.269344    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.269595 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.269354    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x82kx\" (UniqueName: \"kubernetes.io/projected/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-kube-api-access-x82kx\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.269595 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.269367    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.269595 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.269378    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:57:40.684696 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.684657    2581 generic.go:356] "Generic (PLEG): container finished" podID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerID="b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97" exitCode=0
Sep 08 16:57:40.684924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.684718    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"
Sep 08 16:57:40.684924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.684736    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" event={"ID":"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb","Type":"ContainerDied","Data":"b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97"}
Sep 08 16:57:40.684924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.684792    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw" event={"ID":"4cbeeb0d-f432-4e62-b589-b0ed220c4ceb","Type":"ContainerDied","Data":"408b9c539ca3f0d0d1c9207c50f9b625008bbee01deb6b3b923faddf232d85cf"}
Sep 08 16:57:40.684924 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.684815    2581 scope.go:117] "RemoveContainer" containerID="b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97"
Sep 08 16:57:40.694713 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.694690    2581 scope.go:117] "RemoveContainer" containerID="dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"
Sep 08 16:57:40.703754 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.703726    2581 scope.go:117] "RemoveContainer" containerID="b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97"
Sep 08 16:57:40.704180 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:57:40.704161    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97\": container with ID starting with b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97 not found: ID does not exist" containerID="b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97"
Sep 08 16:57:40.704230 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.704191    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97"} err="failed to get container status \"b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97\": rpc error: code = NotFound desc = could not find container \"b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97\": container with ID starting with b5333f6b46b7638a4a7684ad98526181809af7eca9f9e9257819e8a8e9e02c97 not found: ID does not exist"
Sep 08 16:57:40.704230 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.704211    2581 scope.go:117] "RemoveContainer" containerID="dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"
Sep 08 16:57:40.704473 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:57:40.704440    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b\": container with ID starting with dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b not found: ID does not exist" containerID="dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"
Sep 08 16:57:40.704516 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.704477    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b"} err="failed to get container status \"dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b\": rpc error: code = NotFound desc = could not find container \"dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b\": container with ID starting with dcb172ccc92f115dbfdeac8c5552fc9bf2f90e2bf06c6d5419ba2c74db2cb19b not found: ID does not exist"
Sep 08 16:57:40.712051 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.712020    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"]
Sep 08 16:57:40.718297 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:40.718266    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a0a70f-openshift-default-6785774cd6-tblfw"]
Sep 08 16:57:42.468508 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:42.468472    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" path="/var/lib/kubelet/pods/4cbeeb0d-f432-4e62-b589-b0ed220c4ceb/volumes"
Sep 08 16:57:54.625351 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:54.625310    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:54.876766 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:54.876655    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:54.998966 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:54.998933    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:55.091400 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:55.091369    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:57:55.400690 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:57:55.400660    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:58:00.526595 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:58:00.526532    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:58:36.854401 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:58:36.854366    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:58:38.353009 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:58:38.352976    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:58:42.510733 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:58:42.510697    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:58:44.326399 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:58:44.326364    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:08.690999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:08.690916    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"]
Sep 08 16:59:08.691535 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:08.691198    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy" containerID="cri-o://da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097" gracePeriod=30
Sep 08 16:59:09.063215 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:09.063113    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:09.129635 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:09.129589    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:09.235428 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:09.235392    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:12.931278 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:12.931243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:13.960703 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:13.960614    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:59:14.069013 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.068973    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-podinfo\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069205 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069040    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-data\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069205 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069067    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istiod-ca-cert\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069205 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069110    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-certs\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069205 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069187    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-credential-socket\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069212    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-token\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069302    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-envoy\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069305    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:14.069421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069336    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9dd7\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-kube-api-access-h9dd7\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069421 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069381    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-socket\") pod \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\" (UID: \"b1c7f542-2e70-48bb-86b3-9e326ea5074c\") "
Sep 08 16:59:14.069656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069442    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:14.069656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069492    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:14.069656 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069529    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:59:14.069814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069743    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.069814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069765    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.069814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069783    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.069814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069798    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.070246 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.069776    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:14.071500 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.071471    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:59:14.071652 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.071637    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:14.071698 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.071641    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:14.071734 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.071700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-kube-api-access-h9dd7" (OuterVolumeSpecName: "kube-api-access-h9dd7") pod "b1c7f542-2e70-48bb-86b3-9e326ea5074c" (UID: "b1c7f542-2e70-48bb-86b3-9e326ea5074c"). InnerVolumeSpecName "kube-api-access-h9dd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:14.171182 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.171138    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.171182 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.171172    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.171182 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.171181    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9dd7\" (UniqueName: \"kubernetes.io/projected/b1c7f542-2e70-48bb-86b3-9e326ea5074c-kube-api-access-h9dd7\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.171182 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.171191    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b1c7f542-2e70-48bb-86b3-9e326ea5074c-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.171464 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.171199    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1c7f542-2e70-48bb-86b3-9e326ea5074c-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:14.198325 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.198283    2581 generic.go:356] "Generic (PLEG): container finished" podID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerID="da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097" exitCode=0
Sep 08 16:59:14.198485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.198335    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"
Sep 08 16:59:14.198485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.198370    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" event={"ID":"b1c7f542-2e70-48bb-86b3-9e326ea5074c","Type":"ContainerDied","Data":"da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097"}
Sep 08 16:59:14.198485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.198432    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq" event={"ID":"b1c7f542-2e70-48bb-86b3-9e326ea5074c","Type":"ContainerDied","Data":"fcc4da8893e8ad7063f09831d05e5af465a4fb75267b17663f7d3b87e299f924"}
Sep 08 16:59:14.198485 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.198461    2581 scope.go:117] "RemoveContainer" containerID="da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097"
Sep 08 16:59:14.208806 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.208774    2581 scope.go:117] "RemoveContainer" containerID="f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"
Sep 08 16:59:14.217540 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.217519    2581 scope.go:117] "RemoveContainer" containerID="da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097"
Sep 08 16:59:14.217905 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:59:14.217882    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097\": container with ID starting with da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097 not found: ID does not exist" containerID="da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097"
Sep 08 16:59:14.217967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.217919    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097"} err="failed to get container status \"da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097\": rpc error: code = NotFound desc = could not find container \"da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097\": container with ID starting with da3e302c184668a51f8fc9d51653cf1503afc4aaa55f756fdbe52b30aff20097 not found: ID does not exist"
Sep 08 16:59:14.217967 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.217937    2581 scope.go:117] "RemoveContainer" containerID="f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"
Sep 08 16:59:14.218223 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:59:14.218203    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36\": container with ID starting with f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36 not found: ID does not exist" containerID="f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"
Sep 08 16:59:14.218327 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.218231    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36"} err="failed to get container status \"f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36\": rpc error: code = NotFound desc = could not find container \"f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36\": container with ID starting with f2a950c63f73e2da79b64e642b0a023fa613f3bee9febf5db1e257a52c885e36 not found: ID does not exist"
Sep 08 16:59:14.221571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.221545    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"]
Sep 08 16:59:14.226036 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.226008    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d2b1cc-openshift-default-777987bb44-gdswq"]
Sep 08 16:59:14.467584 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:14.467500    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" path="/var/lib/kubelet/pods/b1c7f542-2e70-48bb-86b3-9e326ea5074c/volumes"
Sep 08 16:59:19.190347 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:19.190291    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:19.826294 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:19.826253    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"]
Sep 08 16:59:19.826552 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:19.826526    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" podUID="06e17238-cb3d-49ab-95d7-df2e7b6cea16" containerName="maas-api" containerID="cri-o://fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca" gracePeriod=30
Sep 08 16:59:19.882605 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:19.882557    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:19.983067 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:19.983037    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:20.084314 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.084243    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:20.084655 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.084636    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:59:20.185299 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.185264    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:20.239860 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.239035    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-metrics-certs\") pod \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") "
Sep 08 16:59:20.239860 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.239580    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dczj7\" (UniqueName: \"kubernetes.io/projected/06e17238-cb3d-49ab-95d7-df2e7b6cea16-kube-api-access-dczj7\") pod \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") "
Sep 08 16:59:20.240382 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.240065    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls\") pod \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") "
Sep 08 16:59:20.240382 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.240224    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e17238-cb3d-49ab-95d7-df2e7b6cea16-openshift-service-ca\") pod \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\" (UID: \"06e17238-cb3d-49ab-95d7-df2e7b6cea16\") "
Sep 08 16:59:20.252175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.241567    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06e17238-cb3d-49ab-95d7-df2e7b6cea16-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06e17238-cb3d-49ab-95d7-df2e7b6cea16" (UID: "06e17238-cb3d-49ab-95d7-df2e7b6cea16"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:59:20.252175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.248368    2581 generic.go:356] "Generic (PLEG): container finished" podID="06e17238-cb3d-49ab-95d7-df2e7b6cea16" containerID="fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca" exitCode=0
Sep 08 16:59:20.252175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.248450    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" event={"ID":"06e17238-cb3d-49ab-95d7-df2e7b6cea16","Type":"ContainerDied","Data":"fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca"}
Sep 08 16:59:20.252175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.248501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n" event={"ID":"06e17238-cb3d-49ab-95d7-df2e7b6cea16","Type":"ContainerDied","Data":"96e165a550cc6e240c5798b56f8f9a260139db8157d38a06d2f7fbc64fa93b7c"}
Sep 08 16:59:20.252175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.248532    2581 scope.go:117] "RemoveContainer" containerID="fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca"
Sep 08 16:59:20.252175 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.248684    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"
Sep 08 16:59:20.253208 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.253149    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06e17238-cb3d-49ab-95d7-df2e7b6cea16-kube-api-access-dczj7" (OuterVolumeSpecName: "kube-api-access-dczj7") pod "06e17238-cb3d-49ab-95d7-df2e7b6cea16" (UID: "06e17238-cb3d-49ab-95d7-df2e7b6cea16"). InnerVolumeSpecName "kube-api-access-dczj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:20.256583 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.256518    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "06e17238-cb3d-49ab-95d7-df2e7b6cea16" (UID: "06e17238-cb3d-49ab-95d7-df2e7b6cea16"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:59:20.258719 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.258627    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06e17238-cb3d-49ab-95d7-df2e7b6cea16" (UID: "06e17238-cb3d-49ab-95d7-df2e7b6cea16"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:59:20.273095 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.273064    2581 scope.go:117] "RemoveContainer" containerID="fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca"
Sep 08 16:59:20.273490 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:59:20.273468    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca\": container with ID starting with fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca not found: ID does not exist" containerID="fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca"
Sep 08 16:59:20.273571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.273503    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca"} err="failed to get container status \"fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca\": rpc error: code = NotFound desc = could not find container \"fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca\": container with ID starting with fcbc61161f8060b409a76ea65009a8c9cb6fd5a37b32cc9c9990f903392e40ca not found: ID does not exist"
Sep 08 16:59:20.342702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.342606    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06e17238-cb3d-49ab-95d7-df2e7b6cea16-openshift-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:20.342702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.342642    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:20.342702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.342654    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dczj7\" (UniqueName: \"kubernetes.io/projected/06e17238-cb3d-49ab-95d7-df2e7b6cea16-kube-api-access-dczj7\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:20.342702 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.342662    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06e17238-cb3d-49ab-95d7-df2e7b6cea16-maas-api-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:20.487428 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.487393    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:20.566571 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.566537    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"]
Sep 08 16:59:20.572038 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:20.572006    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-84ba67-65857dbf47-xtg9n"]
Sep 08 16:59:22.468470 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:22.468429    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06e17238-cb3d-49ab-95d7-df2e7b6cea16" path="/var/lib/kubelet/pods/06e17238-cb3d-49ab-95d7-df2e7b6cea16/volumes"
Sep 08 16:59:26.772137 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:26.772104    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:26.875519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:26.875487    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:27.019354 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:27.019317    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"]
Sep 08 16:59:27.019647 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:27.019581    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy" containerID="cri-o://0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1" gracePeriod=30
Sep 08 16:59:27.058070 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:27.057979    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:27.672856 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:27.672796    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:32.272574 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.272539    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:59:32.314098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.314001    2581 generic.go:356] "Generic (PLEG): container finished" podID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerID="0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1" exitCode=0
Sep 08 16:59:32.314098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.314064    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"
Sep 08 16:59:32.314098 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.314086    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" event={"ID":"fce9eeca-9f3d-4bdf-83d9-ed58299c8940","Type":"ContainerDied","Data":"0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1"}
Sep 08 16:59:32.314395 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.314147    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh" event={"ID":"fce9eeca-9f3d-4bdf-83d9-ed58299c8940","Type":"ContainerDied","Data":"3c2b301c32bc165c2fb0ccc1e2c05fb4942d3ad97b37c52f261a9baab17ac461"}
Sep 08 16:59:32.314395 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.314172    2581 scope.go:117] "RemoveContainer" containerID="0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1"
Sep 08 16:59:32.323693 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.323672    2581 scope.go:117] "RemoveContainer" containerID="05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"
Sep 08 16:59:32.333135 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.333112    2581 scope.go:117] "RemoveContainer" containerID="0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1"
Sep 08 16:59:32.333451 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:59:32.333429    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1\": container with ID starting with 0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1 not found: ID does not exist" containerID="0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1"
Sep 08 16:59:32.333519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.333462    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1"} err="failed to get container status \"0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1\": rpc error: code = NotFound desc = could not find container \"0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1\": container with ID starting with 0f47c9c49f06f640b23208f8bbf5ab5ab838909a90e841c1be3838babff0cef1 not found: ID does not exist"
Sep 08 16:59:32.333519 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.333482    2581 scope.go:117] "RemoveContainer" containerID="05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"
Sep 08 16:59:32.333790 ip-10-0-131-47 kubenswrapper[2581]: E0908 16:59:32.333772    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf\": container with ID starting with 05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf not found: ID does not exist" containerID="05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"
Sep 08 16:59:32.333868 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.333797    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf"} err="failed to get container status \"05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf\": rpc error: code = NotFound desc = could not find container \"05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf\": container with ID starting with 05c39c1ec9402b60911dd26cfa55b8af5acfe774f3c4c4f91162fde0889f1fcf not found: ID does not exist"
Sep 08 16:59:32.369812 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.369772    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-credential-socket\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.369999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.369826    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-token\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.369999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.369894    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-envoy\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.369999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.369927    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-data\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.369999 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.369967    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-podinfo\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.370226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370036    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8gh9\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-kube-api-access-q8gh9\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.370226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370083    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-certs\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.370226 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370096    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:32.370375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370226    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istiod-ca-cert\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.370375 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370357    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-socket\") pod \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\" (UID: \"fce9eeca-9f3d-4bdf-83d9-ed58299c8940\") "
Sep 08 16:59:32.370657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370360    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-data" (OuterVolumeSpecName: "istio-data") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:32.370657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370376    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:32.370657 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370559    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:32.370873 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.370652    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:59:32.371127 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.371108    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.371162 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.371135    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.371162 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.371148    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.371227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.371162    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.371227 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.371178    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.372302 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.372273    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:32.372526 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.372505    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-kube-api-access-q8gh9" (OuterVolumeSpecName: "kube-api-access-q8gh9") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "kube-api-access-q8gh9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:32.372695 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.372670    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-token" (OuterVolumeSpecName: "istio-token") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:32.372814 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.372666    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fce9eeca-9f3d-4bdf-83d9-ed58299c8940" (UID: "fce9eeca-9f3d-4bdf-83d9-ed58299c8940"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:59:32.471843 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.471801    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.471843 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.471829    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.471843 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.471851    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.472085 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.471859    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8gh9\" (UniqueName: \"kubernetes.io/projected/fce9eeca-9f3d-4bdf-83d9-ed58299c8940-kube-api-access-q8gh9\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:32.631115 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.631023    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"]
Sep 08 16:59:32.638158 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:32.638127    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-84ba67-openshift-default-5f66458cbd-bv4kh"]
Sep 08 16:59:34.468061 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:34.468025    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" path="/var/lib/kubelet/pods/fce9eeca-9f3d-4bdf-83d9-ed58299c8940/volumes"
Sep 08 16:59:37.946852 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:37.946803    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:38.023987 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:38.023952    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:38.094412 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:38.094379    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:38.179091 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:38.179054    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:38.246823 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:38.246733    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:38.544819 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:38.544709    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:41.742957 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:41.742916    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:44.885949 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:44.885910    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:44.967954 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:44.967908    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:45.185752 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:45.185711    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"]
Sep 08 16:59:45.185979 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:45.185941    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy" containerID="cri-o://b02c9523648d9498db43a99d57e3cae3f2c5fc1e6d59bf474c35f55387ca3773" gracePeriod=30
Sep 08 16:59:45.227718 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:45.227684    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:50.412207 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.412170    2581 generic.go:356] "Generic (PLEG): container finished" podID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerID="b02c9523648d9498db43a99d57e3cae3f2c5fc1e6d59bf474c35f55387ca3773" exitCode=0
Sep 08 16:59:50.412644 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.412234    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" event={"ID":"ae4b1b95-aca7-4c80-9688-323337d58ac8","Type":"ContainerDied","Data":"b02c9523648d9498db43a99d57e3cae3f2c5fc1e6d59bf474c35f55387ca3773"}
Sep 08 16:59:50.412644 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.412316    2581 scope.go:117] "RemoveContainer" containerID="b7a23589296c17b361f1a1b76f74ca7cc114d99e5c0bbb8fc49d866a17cffac0"
Sep 08 16:59:50.450154 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.450122    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:59:50.569363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569265    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-token\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569335    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-podinfo\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569363 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569366    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-credential-socket\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569411    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4b1b95-aca7-4c80-9688-323337d58ac8-istiod-ca-cert\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569441    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-envoy\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569491    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-data\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569527    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqxzh\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-kube-api-access-mqxzh\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569634 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569573    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-socket\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.569931 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569700    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:50.569931 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569809    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-data" (OuterVolumeSpecName: "istio-data") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:50.570054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569668    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-certs\") pod \"ae4b1b95-aca7-4c80-9688-323337d58ac8\" (UID: \"ae4b1b95-aca7-4c80-9688-323337d58ac8\") "
Sep 08 16:59:50.570054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569948    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae4b1b95-aca7-4c80-9688-323337d58ac8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:59:50.570054 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.569967    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:50.570202 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.570144    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:50.570550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.570523    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.570550 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.570551    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ae4b1b95-aca7-4c80-9688-323337d58ac8-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.570743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.570566    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.570743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.570580    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.570743 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.570593    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.571890 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.571854    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-token" (OuterVolumeSpecName: "istio-token") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:50.572000 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.571907    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:59:50.572000 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.571931    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:59:50.572111 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.572086    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-kube-api-access-mqxzh" (OuterVolumeSpecName: "kube-api-access-mqxzh") pod "ae4b1b95-aca7-4c80-9688-323337d58ac8" (UID: "ae4b1b95-aca7-4c80-9688-323337d58ac8"). InnerVolumeSpecName "kube-api-access-mqxzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:59:50.671393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.671326    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqxzh\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-kube-api-access-mqxzh\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.671393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.671383    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.671393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.671398    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:50.671393 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:50.671408    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ae4b1b95-aca7-4c80-9688-323337d58ac8-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 16:59:51.420143 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:51.420114    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"
Sep 08 16:59:51.420569 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:51.420162    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48" event={"ID":"ae4b1b95-aca7-4c80-9688-323337d58ac8","Type":"ContainerDied","Data":"d34fa4dbb437a6d2fa64745b6fc0b31f6bc505d238257e2d18a4e1a455e9bcca"}
Sep 08 16:59:51.420569 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:51.420222    2581 scope.go:117] "RemoveContainer" containerID="b02c9523648d9498db43a99d57e3cae3f2c5fc1e6d59bf474c35f55387ca3773"
Sep 08 16:59:51.443105 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:51.443064    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"]
Sep 08 16:59:51.449132 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:51.449101    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-608268-openshift-default-6d58995456-xwp48"]
Sep 08 16:59:52.468971 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:52.468931    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" path="/var/lib/kubelet/pods/ae4b1b95-aca7-4c80-9688-323337d58ac8/volumes"
Sep 08 16:59:56.099402 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:56.099353    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:56.643018 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:56.642984    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 16:59:56.741563 ip-10-0-131-47 kubenswrapper[2581]: I0908 16:59:56.741531    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:00:03.295661 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:03.295622    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:00:03.384744 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:03.384708    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"]
Sep 08 17:00:03.385064 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:03.385032    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy" containerID="cri-o://a993a6cf87abe7a16d690c3a74f06a3d6da2a6b83e88ce7224a6115ce9e030f5" gracePeriod=30
Sep 08 17:00:03.488506 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:03.488464    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:00:03.593047 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:03.592961    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:00:06.034775 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.034726    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-flk9p"]
Sep 08 17:00:06.035295 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.035008    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-784b94fdd6-flk9p" podUID="7033024b-7ab9-4117-92f7-e1ccb272d30f" containerName="manager" containerID="cri-o://ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb" gracePeriod=30
Sep 08 17:00:06.291161 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.291072    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 17:00:06.328535 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.327252    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgwnz\" (UniqueName: \"kubernetes.io/projected/7033024b-7ab9-4117-92f7-e1ccb272d30f-kube-api-access-sgwnz\") pod \"7033024b-7ab9-4117-92f7-e1ccb272d30f\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") "
Sep 08 17:00:06.328535 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.327386    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-webhook-cert\") pod \"7033024b-7ab9-4117-92f7-e1ccb272d30f\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") "
Sep 08 17:00:06.328535 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.327424    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-metrics-certs\") pod \"7033024b-7ab9-4117-92f7-e1ccb272d30f\" (UID: \"7033024b-7ab9-4117-92f7-e1ccb272d30f\") "
Sep 08 17:00:06.332168 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.332122    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7033024b-7ab9-4117-92f7-e1ccb272d30f-kube-api-access-sgwnz" (OuterVolumeSpecName: "kube-api-access-sgwnz") pod "7033024b-7ab9-4117-92f7-e1ccb272d30f" (UID: "7033024b-7ab9-4117-92f7-e1ccb272d30f"). InnerVolumeSpecName "kube-api-access-sgwnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 17:00:06.337783 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.337742    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7033024b-7ab9-4117-92f7-e1ccb272d30f" (UID: "7033024b-7ab9-4117-92f7-e1ccb272d30f"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:00:06.339133 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.339101    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7033024b-7ab9-4117-92f7-e1ccb272d30f" (UID: "7033024b-7ab9-4117-92f7-e1ccb272d30f"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:00:06.428655 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.428613    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-webhook-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:06.428655 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.428650    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7033024b-7ab9-4117-92f7-e1ccb272d30f-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:06.428655 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.428661    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgwnz\" (UniqueName: \"kubernetes.io/projected/7033024b-7ab9-4117-92f7-e1ccb272d30f-kube-api-access-sgwnz\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:06.507028 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.506989    2581 generic.go:356] "Generic (PLEG): container finished" podID="7033024b-7ab9-4117-92f7-e1ccb272d30f" containerID="ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb" exitCode=0
Sep 08 17:00:06.507231 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.507059    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-flk9p"
Sep 08 17:00:06.507231 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.507072    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-flk9p" event={"ID":"7033024b-7ab9-4117-92f7-e1ccb272d30f","Type":"ContainerDied","Data":"ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb"}
Sep 08 17:00:06.507231 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.507142    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-flk9p" event={"ID":"7033024b-7ab9-4117-92f7-e1ccb272d30f","Type":"ContainerDied","Data":"7f27597b1e81ad11b568406469388cb67e243d3bda349de76ad6b510a82bf6ca"}
Sep 08 17:00:06.507231 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.507172    2581 scope.go:117] "RemoveContainer" containerID="ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb"
Sep 08 17:00:06.516956 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.516932    2581 scope.go:117] "RemoveContainer" containerID="ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb"
Sep 08 17:00:06.517317 ip-10-0-131-47 kubenswrapper[2581]: E0908 17:00:06.517296    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb\": container with ID starting with ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb not found: ID does not exist" containerID="ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb"
Sep 08 17:00:06.517382 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.517331    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb"} err="failed to get container status \"ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb\": rpc error: code = NotFound desc = could not find container \"ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb\": container with ID starting with ecb4d3b9216ac589cccf4aa2188fd7a5bc9d6b944ee33ceded5a77564fd8adfb not found: ID does not exist"
Sep 08 17:00:06.524659 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.524622    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-flk9p"]
Sep 08 17:00:06.530775 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:06.530744    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-flk9p"]
Sep 08 17:00:08.467718 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.467679    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7033024b-7ab9-4117-92f7-e1ccb272d30f" path="/var/lib/kubelet/pods/7033024b-7ab9-4117-92f7-e1ccb272d30f/volumes"
Sep 08 17:00:08.521770 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.521736    2581 generic.go:356] "Generic (PLEG): container finished" podID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerID="a993a6cf87abe7a16d690c3a74f06a3d6da2a6b83e88ce7224a6115ce9e030f5" exitCode=0
Sep 08 17:00:08.522000 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.521769    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" event={"ID":"6cfe5510-63ea-4cd4-b2b7-b794659006da","Type":"ContainerDied","Data":"a993a6cf87abe7a16d690c3a74f06a3d6da2a6b83e88ce7224a6115ce9e030f5"}
Sep 08 17:00:08.522000 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.521871    2581 scope.go:117] "RemoveContainer" containerID="9240f3ecef838f50d8142abb4162c5e2b56c8f7d18bd5929e46833b5dd574d8c"
Sep 08 17:00:08.660152 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.660077    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 17:00:08.751628 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751581    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-data\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.751804 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751645    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-token\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.751804 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751678    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-podinfo\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.751804 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751723    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-socket\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.751804 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751769    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-certs\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.751804 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751801    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-envoy\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.752116 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751906    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8pbhd\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-kube-api-access-8pbhd\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.752116 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751912    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 17:00:08.752116 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751948    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-credential-socket\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.752116 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.751995    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe5510-63ea-4cd4-b2b7-b794659006da-istiod-ca-cert\") pod \"6cfe5510-63ea-4cd4-b2b7-b794659006da\" (UID: \"6cfe5510-63ea-4cd4-b2b7-b794659006da\") "
Sep 08 17:00:08.752116 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752081    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 17:00:08.752116 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752093    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 17:00:08.752597 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752381    2581 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-data\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.752597 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752403    2581 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.752597 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752406    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cfe5510-63ea-4cd4-b2b7-b794659006da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 17:00:08.752597 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752417    2581 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-workload-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.752597 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.752470    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 17:00:08.754148 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.754123    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 17:00:08.754257 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.754164    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 17:00:08.754866 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.754821    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 17:00:08.754947 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.754860    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-kube-api-access-8pbhd" (OuterVolumeSpecName: "kube-api-access-8pbhd") pod "6cfe5510-63ea-4cd4-b2b7-b794659006da" (UID: "6cfe5510-63ea-4cd4-b2b7-b794659006da"). InnerVolumeSpecName "kube-api-access-8pbhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 17:00:08.853629 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.853581    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8pbhd\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-kube-api-access-8pbhd\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.853629 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.853619    2581 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-credential-socket\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.853629 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.853635    2581 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cfe5510-63ea-4cd4-b2b7-b794659006da-istiod-ca-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.853937 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.853648    2581 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-token\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.853937 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.853658    2581 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-podinfo\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:08.853937 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:08.853669    2581 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cfe5510-63ea-4cd4-b2b7-b794659006da-istio-envoy\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:00:09.528405 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:09.528373    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"
Sep 08 17:00:09.528799 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:09.528377    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb" event={"ID":"6cfe5510-63ea-4cd4-b2b7-b794659006da","Type":"ContainerDied","Data":"affec6345186c126ccb93f26a2858bc16af3eb90a37d78ae5dad3144b795edd3"}
Sep 08 17:00:09.528799 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:09.528511    2581 scope.go:117] "RemoveContainer" containerID="a993a6cf87abe7a16d690c3a74f06a3d6da2a6b83e88ce7224a6115ce9e030f5"
Sep 08 17:00:09.552042 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:09.552003    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"]
Sep 08 17:00:09.553858 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:09.553818    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-6b15ca-openshift-default-cc8cc6b-ndvdb"]
Sep 08 17:00:10.467916 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:10.467885    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" path="/var/lib/kubelet/pods/6cfe5510-63ea-4cd4-b2b7-b794659006da/volumes"
Sep 08 17:00:32.595653 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:32.595625    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 17:00:32.599607 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:32.599584    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 17:00:51.417633 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:51.417587    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:00:51.517844 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:00:51.517792    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:01:07.354741 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.354690    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-784b94fdd6-4n4jh"]
Sep 08 17:01:07.355823 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355783    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy"
Sep 08 17:01:07.355823 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355825    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355877    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355888    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355898    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355907    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355929    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7033024b-7ab9-4117-92f7-e1ccb272d30f" containerName="manager"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355938    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="7033024b-7ab9-4117-92f7-e1ccb272d30f" containerName="manager"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355957    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355966    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.355994    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356003    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356023    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356033    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy"
Sep 08 17:01:07.356061 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356060    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06e17238-cb3d-49ab-95d7-df2e7b6cea16" containerName="maas-api"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356069    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="06e17238-cb3d-49ab-95d7-df2e7b6cea16" containerName="maas-api"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356079    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356088    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356111    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356121    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356342    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356359    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356370    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="06e17238-cb3d-49ab-95d7-df2e7b6cea16" containerName="maas-api"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356387    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356397    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356406    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="7033024b-7ab9-4117-92f7-e1ccb272d30f" containerName="manager"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356424    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356434    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356451    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae4b1b95-aca7-4c80-9688-323337d58ac8" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356469    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cfe5510-63ea-4cd4-b2b7-b794659006da" containerName="istio-proxy"
Sep 08 17:01:07.356673 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.356477    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy"
Sep 08 17:01:07.361710 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.361659    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.365912 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.365882    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 17:01:07.366945 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.365893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 17:01:07.366945 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.365893    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8sc6g\""
Sep 08 17:01:07.366945 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.365942    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 17:01:07.369767 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.369737    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-4n4jh"]
Sep 08 17:01:07.450888 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.450810    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btjgt\" (UniqueName: \"kubernetes.io/projected/531f718e-75cc-4cc4-a69c-e63e0c204091-kube-api-access-btjgt\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.451106 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.451061    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-metrics-certs\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.451167 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.451106    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-webhook-cert\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.551937 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.551889    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-metrics-certs\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.551937 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.551940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-webhook-cert\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.552188 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.551972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btjgt\" (UniqueName: \"kubernetes.io/projected/531f718e-75cc-4cc4-a69c-e63e0c204091-kube-api-access-btjgt\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.554895 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.554860    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-metrics-certs\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.554895 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.554889    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-webhook-cert\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.561912 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.561876    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btjgt\" (UniqueName: \"kubernetes.io/projected/531f718e-75cc-4cc4-a69c-e63e0c204091-kube-api-access-btjgt\") pod \"maas-controller-784b94fdd6-4n4jh\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") " pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.676251 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.676133    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:07.957600 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.957570    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-4n4jh"]
Sep 08 17:01:07.959641 ip-10-0-131-47 kubenswrapper[2581]: W0908 17:01:07.959611    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531f718e_75cc_4cc4_a69c_e63e0c204091.slice/crio-39d33096d66c189359706a01f99ec18caec20e34bb270af148a5292f591c649f WatchSource:0}: Error finding container 39d33096d66c189359706a01f99ec18caec20e34bb270af148a5292f591c649f: Status 404 returned error can't find the container with id 39d33096d66c189359706a01f99ec18caec20e34bb270af148a5292f591c649f
Sep 08 17:01:07.961199 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:07.961174    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 17:01:08.853546 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:08.853504    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-4n4jh" event={"ID":"531f718e-75cc-4cc4-a69c-e63e0c204091","Type":"ContainerStarted","Data":"39d33096d66c189359706a01f99ec18caec20e34bb270af148a5292f591c649f"}
Sep 08 17:01:09.861052 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:09.861006    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-4n4jh" event={"ID":"531f718e-75cc-4cc4-a69c-e63e0c204091","Type":"ContainerStarted","Data":"4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae"}
Sep 08 17:01:09.861585 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:09.861135    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:09.882152 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:09.882084    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-784b94fdd6-4n4jh" podStartSLOduration=1.183669088 podStartE2EDuration="2.882063605s" totalImagesPullingTime="1.698394517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 17:01:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:01:09.880020008 +0000 UTC m=+1837.868455963" watchObservedRunningTime="2026-09-08 17:01:09.882063605 +0000 UTC m=+1837.870499559"
Sep 08 17:01:20.868999 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:20.868964    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:27.645877 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:27.645799    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:01:28.036657 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.036616    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:01:28.157363 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.157322    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-4n4jh"]
Sep 08 17:01:28.157603 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.157556    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-784b94fdd6-4n4jh" podUID="531f718e-75cc-4cc4-a69c-e63e0c204091" containerName="manager" containerID="cri-o://4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae" gracePeriod=30
Sep 08 17:01:28.409196 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.409163    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:28.469184 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.469137    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-metrics-certs\") pod \"531f718e-75cc-4cc4-a69c-e63e0c204091\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") "
Sep 08 17:01:28.469387 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.469211    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-webhook-cert\") pod \"531f718e-75cc-4cc4-a69c-e63e0c204091\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") "
Sep 08 17:01:28.469387 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.469296    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btjgt\" (UniqueName: \"kubernetes.io/projected/531f718e-75cc-4cc4-a69c-e63e0c204091-kube-api-access-btjgt\") pod \"531f718e-75cc-4cc4-a69c-e63e0c204091\" (UID: \"531f718e-75cc-4cc4-a69c-e63e0c204091\") "
Sep 08 17:01:28.471937 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.471894    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "531f718e-75cc-4cc4-a69c-e63e0c204091" (UID: "531f718e-75cc-4cc4-a69c-e63e0c204091"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:01:28.472095 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.472022    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "531f718e-75cc-4cc4-a69c-e63e0c204091" (UID: "531f718e-75cc-4cc4-a69c-e63e0c204091"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:01:28.472095 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.472071    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531f718e-75cc-4cc4-a69c-e63e0c204091-kube-api-access-btjgt" (OuterVolumeSpecName: "kube-api-access-btjgt") pod "531f718e-75cc-4cc4-a69c-e63e0c204091" (UID: "531f718e-75cc-4cc4-a69c-e63e0c204091"). InnerVolumeSpecName "kube-api-access-btjgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 17:01:28.571222 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.571158    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btjgt\" (UniqueName: \"kubernetes.io/projected/531f718e-75cc-4cc4-a69c-e63e0c204091-kube-api-access-btjgt\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:01:28.571222 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.571201    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:01:28.571222 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.571215    2581 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/531f718e-75cc-4cc4-a69c-e63e0c204091-webhook-cert\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:01:28.970626 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.970589    2581 generic.go:356] "Generic (PLEG): container finished" podID="531f718e-75cc-4cc4-a69c-e63e0c204091" containerID="4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae" exitCode=0
Sep 08 17:01:28.971134 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.970640    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-4n4jh"
Sep 08 17:01:28.971134 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.970660    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-4n4jh" event={"ID":"531f718e-75cc-4cc4-a69c-e63e0c204091","Type":"ContainerDied","Data":"4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae"}
Sep 08 17:01:28.971134 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.970706    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-4n4jh" event={"ID":"531f718e-75cc-4cc4-a69c-e63e0c204091","Type":"ContainerDied","Data":"39d33096d66c189359706a01f99ec18caec20e34bb270af148a5292f591c649f"}
Sep 08 17:01:28.971134 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.970729    2581 scope.go:117] "RemoveContainer" containerID="4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae"
Sep 08 17:01:28.980911 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.980885    2581 scope.go:117] "RemoveContainer" containerID="4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae"
Sep 08 17:01:28.981287 ip-10-0-131-47 kubenswrapper[2581]: E0908 17:01:28.981266    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae\": container with ID starting with 4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae not found: ID does not exist" containerID="4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae"
Sep 08 17:01:28.981349 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.981297    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae"} err="failed to get container status \"4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae\": rpc error: code = NotFound desc = could not find container \"4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae\": container with ID starting with 4d311975ac066628edd380a0f5f1437f4088d3183f6d8490d61448aafd87e0ae not found: ID does not exist"
Sep 08 17:01:28.994950 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.994915    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-4n4jh"]
Sep 08 17:01:28.997873 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:28.997822    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-4n4jh"]
Sep 08 17:01:29.898648 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:29.898612    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:01:30.044615 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.044566    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-784b94fdd6-smjd5"]
Sep 08 17:01:30.045192 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045171    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy"
Sep 08 17:01:30.045270 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045195    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1c7f542-2e70-48bb-86b3-9e326ea5074c" containerName="istio-proxy"
Sep 08 17:01:30.045270 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045227    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531f718e-75cc-4cc4-a69c-e63e0c204091" containerName="manager"
Sep 08 17:01:30.045270 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045236    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="531f718e-75cc-4cc4-a69c-e63e0c204091" containerName="manager"
Sep 08 17:01:30.045429 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045271    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy"
Sep 08 17:01:30.045429 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045280    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce9eeca-9f3d-4bdf-83d9-ed58299c8940" containerName="istio-proxy"
Sep 08 17:01:30.045429 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045369    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cbeeb0d-f432-4e62-b589-b0ed220c4ceb" containerName="istio-proxy"
Sep 08 17:01:30.045429 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.045385    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="531f718e-75cc-4cc4-a69c-e63e0c204091" containerName="manager"
Sep 08 17:01:30.050069 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.050042    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.054131 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.054105    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 17:01:30.054567 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.054548    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 17:01:30.054619 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.054598    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 17:01:30.056598 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.056576    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-8sc6g\""
Sep 08 17:01:30.066408 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.066377    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-smjd5"]
Sep 08 17:01:30.187776 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.187745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/422a25e3-37cb-4934-8bc7-34119ae51a46-metrics-certs\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.187992 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.187903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/422a25e3-37cb-4934-8bc7-34119ae51a46-webhook-cert\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.187992 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.187973    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hx6f\" (UniqueName: \"kubernetes.io/projected/422a25e3-37cb-4934-8bc7-34119ae51a46-kube-api-access-4hx6f\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.289065 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.289015    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hx6f\" (UniqueName: \"kubernetes.io/projected/422a25e3-37cb-4934-8bc7-34119ae51a46-kube-api-access-4hx6f\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.289245 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.289081    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/422a25e3-37cb-4934-8bc7-34119ae51a46-metrics-certs\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.289245 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.289205    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/422a25e3-37cb-4934-8bc7-34119ae51a46-webhook-cert\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.291985 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.291958    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/422a25e3-37cb-4934-8bc7-34119ae51a46-webhook-cert\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.292106 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.292083    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/422a25e3-37cb-4934-8bc7-34119ae51a46-metrics-certs\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.298953 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.298916    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hx6f\" (UniqueName: \"kubernetes.io/projected/422a25e3-37cb-4934-8bc7-34119ae51a46-kube-api-access-4hx6f\") pod \"maas-controller-784b94fdd6-smjd5\" (UID: \"422a25e3-37cb-4934-8bc7-34119ae51a46\") " pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.361005 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.360959    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:30.467643 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.467541    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531f718e-75cc-4cc4-a69c-e63e0c204091" path="/var/lib/kubelet/pods/531f718e-75cc-4cc4-a69c-e63e0c204091/volumes"
Sep 08 17:01:30.637287 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.637258    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-784b94fdd6-smjd5"]
Sep 08 17:01:30.639337 ip-10-0-131-47 kubenswrapper[2581]: W0908 17:01:30.639293    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod422a25e3_37cb_4934_8bc7_34119ae51a46.slice/crio-398e8ac86162e2f5e034a21887a783159860e7992a4ca850d5844212a9317776 WatchSource:0}: Error finding container 398e8ac86162e2f5e034a21887a783159860e7992a4ca850d5844212a9317776: Status 404 returned error can't find the container with id 398e8ac86162e2f5e034a21887a783159860e7992a4ca850d5844212a9317776
Sep 08 17:01:30.984535 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:30.984501    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-smjd5" event={"ID":"422a25e3-37cb-4934-8bc7-34119ae51a46","Type":"ContainerStarted","Data":"398e8ac86162e2f5e034a21887a783159860e7992a4ca850d5844212a9317776"}
Sep 08 17:01:31.991075 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:31.991037    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-784b94fdd6-smjd5" event={"ID":"422a25e3-37cb-4934-8bc7-34119ae51a46","Type":"ContainerStarted","Data":"1cf22f061f17035a4427ef7733b6a70bc7db6158160b17d4e5649ba117cc6beb"}
Sep 08 17:01:31.991507 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:31.991141    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:32.012788 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:32.012728    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-784b94fdd6-smjd5" podStartSLOduration=1.071865044 podStartE2EDuration="2.01271036s" totalImagesPullingTime="940.845316ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 17:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:01:32.011387704 +0000 UTC m=+1859.999823670" watchObservedRunningTime="2026-09-08 17:01:32.01271036 +0000 UTC m=+1860.001146313"
Sep 08 17:01:42.999039 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:42.999001    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-784b94fdd6-smjd5"
Sep 08 17:01:55.774656 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:55.774563    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:01:59.073352 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:59.073311    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:01:59.145069 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:01:59.145035    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:03:14.913180 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:03:14.913146    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:04:18.639724 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:04:18.639690    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:04:30.754739 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:04:30.754695    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:04:50.716431 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:04:50.716391    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:05:14.555338 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:14.555242    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:05:16.885108 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:16.885063    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:05:32.628756 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:32.628723    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 17:05:32.632986 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:32.632963    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v4llq_e4b04399-60ff-45ee-992f-e680b8f498a8/ovn-acl-logging/0.log"
Sep 08 17:05:34.816403 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.816339    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"]
Sep 08 17:05:34.827098 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.827060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.834388 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.832776    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"]
Sep 08 17:05:34.880588 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.880551    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfvws\" (UniqueName: \"kubernetes.io/projected/1747b288-2d84-432d-96e5-5b046d29be39-kube-api-access-pfvws\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.880588 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.880595    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1747b288-2d84-432d-96e5-5b046d29be39-metrics-certs\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.880872 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.880616    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1747b288-2d84-432d-96e5-5b046d29be39-openshift-service-ca\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.880872 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.880773    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1747b288-2d84-432d-96e5-5b046d29be39-maas-api-tls\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.981629 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.981591    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfvws\" (UniqueName: \"kubernetes.io/projected/1747b288-2d84-432d-96e5-5b046d29be39-kube-api-access-pfvws\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.981629 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.981638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1747b288-2d84-432d-96e5-5b046d29be39-metrics-certs\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.981965 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.981657    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1747b288-2d84-432d-96e5-5b046d29be39-openshift-service-ca\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.981965 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.981735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1747b288-2d84-432d-96e5-5b046d29be39-maas-api-tls\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.982477 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.982451    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1747b288-2d84-432d-96e5-5b046d29be39-openshift-service-ca\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.984396 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.984371    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1747b288-2d84-432d-96e5-5b046d29be39-metrics-certs\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.984528 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.984500    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1747b288-2d84-432d-96e5-5b046d29be39-maas-api-tls\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:34.990450 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:34.990424    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfvws\" (UniqueName: \"kubernetes.io/projected/1747b288-2d84-432d-96e5-5b046d29be39-kube-api-access-pfvws\") pod \"maas-api-75ccb5ffc4-nnrww\" (UID: \"1747b288-2d84-432d-96e5-5b046d29be39\") " pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:35.142389 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:35.142283    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:35.428661 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:35.428523    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"]
Sep 08 17:05:35.432182 ip-10-0-131-47 kubenswrapper[2581]: W0908 17:05:35.432141    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1747b288_2d84_432d_96e5_5b046d29be39.slice/crio-827eb1a54000a64010da3678ce7fd0231e2a60baca013e6d8541cdff764fb2ba WatchSource:0}: Error finding container 827eb1a54000a64010da3678ce7fd0231e2a60baca013e6d8541cdff764fb2ba: Status 404 returned error can't find the container with id 827eb1a54000a64010da3678ce7fd0231e2a60baca013e6d8541cdff764fb2ba
Sep 08 17:05:36.269198 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:36.269159    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww" event={"ID":"1747b288-2d84-432d-96e5-5b046d29be39","Type":"ContainerStarted","Data":"c6233f45bef74e00bded34ba0d6700f0d35bf0409685bb8112d9e52d57b2b336"}
Sep 08 17:05:36.269626 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:36.269214    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww" event={"ID":"1747b288-2d84-432d-96e5-5b046d29be39","Type":"ContainerStarted","Data":"827eb1a54000a64010da3678ce7fd0231e2a60baca013e6d8541cdff764fb2ba"}
Sep 08 17:05:36.269626 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:36.269264    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:36.289067 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:36.289006    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww" podStartSLOduration=1.8660271480000001 podStartE2EDuration="2.28898944s" totalImagesPullingTime="422.962292ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 17:05:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:05:36.288056768 +0000 UTC m=+2104.276492722" watchObservedRunningTime="2026-09-08 17:05:36.28898944 +0000 UTC m=+2104.277425396"
Sep 08 17:05:42.279728 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:42.279694    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-75ccb5ffc4-nnrww"
Sep 08 17:05:50.473080 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:50.473047    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"]
Sep 08 17:05:50.473757 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:50.473256    2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh" podUID="a7f5a467-4687-4c87-97de-fa45f634e611" containerName="maas-api" containerID="cri-o://6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f" gracePeriod=30
Sep 08 17:05:51.727872 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.727826    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 17:05:51.856633 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.856532    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkcbg\" (UniqueName: \"kubernetes.io/projected/a7f5a467-4687-4c87-97de-fa45f634e611-kube-api-access-wkcbg\") pod \"a7f5a467-4687-4c87-97de-fa45f634e611\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") "
Sep 08 17:05:51.856633 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.856609    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f5a467-4687-4c87-97de-fa45f634e611-openshift-service-ca\") pod \"a7f5a467-4687-4c87-97de-fa45f634e611\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") "
Sep 08 17:05:51.856912 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.856746    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-metrics-certs\") pod \"a7f5a467-4687-4c87-97de-fa45f634e611\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") "
Sep 08 17:05:51.856976 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.856911    2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-maas-api-tls\") pod \"a7f5a467-4687-4c87-97de-fa45f634e611\" (UID: \"a7f5a467-4687-4c87-97de-fa45f634e611\") "
Sep 08 17:05:51.857587 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.857555    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7f5a467-4687-4c87-97de-fa45f634e611-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7f5a467-4687-4c87-97de-fa45f634e611" (UID: "a7f5a467-4687-4c87-97de-fa45f634e611"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 17:05:51.859156 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.859124    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a7f5a467-4687-4c87-97de-fa45f634e611" (UID: "a7f5a467-4687-4c87-97de-fa45f634e611"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:05:51.859156 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.859142    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7f5a467-4687-4c87-97de-fa45f634e611" (UID: "a7f5a467-4687-4c87-97de-fa45f634e611"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 17:05:51.859343 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.859319    2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7f5a467-4687-4c87-97de-fa45f634e611-kube-api-access-wkcbg" (OuterVolumeSpecName: "kube-api-access-wkcbg") pod "a7f5a467-4687-4c87-97de-fa45f634e611" (UID: "a7f5a467-4687-4c87-97de-fa45f634e611"). InnerVolumeSpecName "kube-api-access-wkcbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 17:05:51.958889 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.958819    2581 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-maas-api-tls\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:05:51.958889 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.958886    2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkcbg\" (UniqueName: \"kubernetes.io/projected/a7f5a467-4687-4c87-97de-fa45f634e611-kube-api-access-wkcbg\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:05:51.958889 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.958897    2581 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7f5a467-4687-4c87-97de-fa45f634e611-openshift-service-ca\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:05:51.959145 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:51.958906    2581 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7f5a467-4687-4c87-97de-fa45f634e611-metrics-certs\") on node \"ip-10-0-131-47.ec2.internal\" DevicePath \"\""
Sep 08 17:05:52.351568 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.351531    2581 generic.go:356] "Generic (PLEG): container finished" podID="a7f5a467-4687-4c87-97de-fa45f634e611" containerID="6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f" exitCode=0
Sep 08 17:05:52.351771 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.351582    2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"
Sep 08 17:05:52.351771 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.351606    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh" event={"ID":"a7f5a467-4687-4c87-97de-fa45f634e611","Type":"ContainerDied","Data":"6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f"}
Sep 08 17:05:52.351771 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.351659    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh" event={"ID":"a7f5a467-4687-4c87-97de-fa45f634e611","Type":"ContainerDied","Data":"21b4f27e4e22f682469c9935b1beb7c1097a3dd0d58ad643d4c707711b7e12c7"}
Sep 08 17:05:52.351771 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.351680    2581 scope.go:117] "RemoveContainer" containerID="6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f"
Sep 08 17:05:52.361816 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.361795    2581 scope.go:117] "RemoveContainer" containerID="6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f"
Sep 08 17:05:52.362188 ip-10-0-131-47 kubenswrapper[2581]: E0908 17:05:52.362166    2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f\": container with ID starting with 6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f not found: ID does not exist" containerID="6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f"
Sep 08 17:05:52.362250 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.362202    2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f"} err="failed to get container status \"6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f\": rpc error: code = NotFound desc = could not find container \"6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f\": container with ID starting with 6827001cc5c7851f8edcade447dbbe30c00847be6e4beb60c4e92d22672ccb8f not found: ID does not exist"
Sep 08 17:05:52.376331 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.376293    2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"]
Sep 08 17:05:52.378198 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.378172    2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d686bf8c4-2cnjh"]
Sep 08 17:05:52.470522 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:05:52.470473    2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7f5a467-4687-4c87-97de-fa45f634e611" path="/var/lib/kubelet/pods/a7f5a467-4687-4c87-97de-fa45f634e611/volumes"
Sep 08 17:06:09.074812 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:09.074774    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-784b94fdd6-smjd5_422a25e3-37cb-4934-8bc7-34119ae51a46/manager/0.log"
Sep 08 17:06:09.194614 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:09.194584    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8mkwr_5c83bcd3-82b8-4e5e-ade4-6ecbee495210/server/0.log"
Sep 08 17:06:09.312381 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:09.312345    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xwmjl_2b919858-2349-4df2-aef9-fa22ddcef0ad/manager/0.log"
Sep 08 17:06:09.546758 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:09.546731    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-qfxwb_324a88f2-c4b3-44bc-9a4d-dda628cf4e7e/copy-manifests/0.log"
Sep 08 17:06:09.553638 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:09.553587    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-qfxwb_324a88f2-c4b3-44bc-9a4d-dda628cf4e7e/manager/0.log"
Sep 08 17:06:10.048324 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:10.048286    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-75ccb5ffc4-nnrww_1747b288-2d84-432d-96e5-5b046d29be39/maas-api/0.log"
Sep 08 17:06:12.455146 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:12.455113    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs_818bb221-c71b-4e7f-a054-3dc1ccadde14/istio-proxy/0.log"
Sep 08 17:06:12.585362 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:12.585325    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fngj4_b14f374c-fbc3-4890-b4c6-6e80a76947ba/discovery/0.log"
Sep 08 17:06:12.945160 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:12.945129    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/1.log"
Sep 08 17:06:13.891557 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:13.891526    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-kcwb4_f8fcd2cc-952a-46e5-b66b-83d90698306f/main/0.log"
Sep 08 17:06:14.222854 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:14.222816    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-9khw2_7a09ec4a-f8cf-4e2d-8281-6c9525eab299/main/0.log"
Sep 08 17:06:20.092254 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:20.092218    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:06:20.188191 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:20.188144    2581 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log" limit=1024
Sep 08 17:06:24.362597 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:24.362510    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qhq59_640c101e-4720-47c2-97a7-742527783b4a/global-pull-secret-syncer/0.log"
Sep 08 17:06:24.462134 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:24.462102    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7ggbr_6b37c92e-b1a1-449a-b8df-88ccdce752d4/konnectivity-agent/0.log"
Sep 08 17:06:24.592299 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:24.592260    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-47.ec2.internal_68defcdbb2da9f7cb5b175cccb2ea2c9/haproxy/0.log"
Sep 08 17:06:31.529887 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.529860    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/alertmanager/0.log"
Sep 08 17:06:31.554698 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.554674    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/config-reloader/0.log"
Sep 08 17:06:31.580194 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.580161    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/kube-rbac-proxy-web/0.log"
Sep 08 17:06:31.605112 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.605085    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/kube-rbac-proxy/0.log"
Sep 08 17:06:31.628661 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.628630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/kube-rbac-proxy-metric/0.log"
Sep 08 17:06:31.663042 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.663004    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/prom-label-proxy/0.log"
Sep 08 17:06:31.684951 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.684923    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_06d1eceb-c358-4119-8f62-5b0487f54774/init-config-reloader/0.log"
Sep 08 17:06:31.784859 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.784815    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-b5gzw_06195537-483b-4474-8aae-29ec273796cb/kube-state-metrics/0.log"
Sep 08 17:06:31.815017 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.814984    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-b5gzw_06195537-483b-4474-8aae-29ec273796cb/kube-rbac-proxy-main/0.log"
Sep 08 17:06:31.848639 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.848611    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-b5gzw_06195537-483b-4474-8aae-29ec273796cb/kube-rbac-proxy-self/0.log"
Sep 08 17:06:31.885692 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.885657    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5494ddd995-4bsd7_1dc1a8b6-e237-46e3-8cd5-5cf11c69ad8c/metrics-server/0.log"
Sep 08 17:06:31.928994 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:31.928961    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-sjxmx_0e5fb49c-d114-4e77-b4c4-d2b67b7f1c26/monitoring-plugin/0.log"
Sep 08 17:06:32.177102 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.177074    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dcn4x_12015c5f-400c-4736-a670-8faf8cd6f0a8/node-exporter/0.log"
Sep 08 17:06:32.199068 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.199038    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dcn4x_12015c5f-400c-4736-a670-8faf8cd6f0a8/kube-rbac-proxy/0.log"
Sep 08 17:06:32.219645 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.219618    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dcn4x_12015c5f-400c-4736-a670-8faf8cd6f0a8/init-textfile/0.log"
Sep 08 17:06:32.246825 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.246795    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7x4cr_adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb/kube-rbac-proxy-main/0.log"
Sep 08 17:06:32.268849 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.268814    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7x4cr_adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb/kube-rbac-proxy-self/0.log"
Sep 08 17:06:32.289377 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.289293    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-7x4cr_adcfdcfa-65ac-4c39-bac4-42c6aa5ac7cb/openshift-state-metrics/0.log"
Sep 08 17:06:32.327613 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.327584    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/prometheus/0.log"
Sep 08 17:06:32.354290 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.354265    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/config-reloader/0.log"
Sep 08 17:06:32.374656 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.374626    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/thanos-sidecar/0.log"
Sep 08 17:06:32.395997 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.395977    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/kube-rbac-proxy-web/0.log"
Sep 08 17:06:32.418447 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.418413    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/kube-rbac-proxy/0.log"
Sep 08 17:06:32.440953 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.440928    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/kube-rbac-proxy-thanos/0.log"
Sep 08 17:06:32.468136 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.468114    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_684b8e3b-4c15-467e-923a-72cf61109126/init-config-reloader/0.log"
Sep 08 17:06:32.497276 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.497245    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-smt86_d9681c43-4c1c-4d15-a615-cb2892850dac/prometheus-operator/0.log"
Sep 08 17:06:32.518952 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.518922    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-smt86_d9681c43-4c1c-4d15-a615-cb2892850dac/kube-rbac-proxy/0.log"
Sep 08 17:06:32.726506 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.726484    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f47d7dc8d-9487d_2899abfb-a708-4049-b324-23c18bf0e65f/thanos-query/0.log"
Sep 08 17:06:32.772918 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.772886    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f47d7dc8d-9487d_2899abfb-a708-4049-b324-23c18bf0e65f/kube-rbac-proxy-web/0.log"
Sep 08 17:06:32.796973 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.796948    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f47d7dc8d-9487d_2899abfb-a708-4049-b324-23c18bf0e65f/kube-rbac-proxy/0.log"
Sep 08 17:06:32.822572 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.822548    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f47d7dc8d-9487d_2899abfb-a708-4049-b324-23c18bf0e65f/prom-label-proxy/0.log"
Sep 08 17:06:32.846981 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.846954    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f47d7dc8d-9487d_2899abfb-a708-4049-b324-23c18bf0e65f/kube-rbac-proxy-rules/0.log"
Sep 08 17:06:32.870746 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:32.870718    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-f47d7dc8d-9487d_2899abfb-a708-4049-b324-23c18bf0e65f/kube-rbac-proxy-metrics/0.log"
Sep 08 17:06:35.142386 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.142343    2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"]
Sep 08 17:06:35.143969 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.143940    2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7f5a467-4687-4c87-97de-fa45f634e611" containerName="maas-api"
Sep 08 17:06:35.144144 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.144131    2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7f5a467-4687-4c87-97de-fa45f634e611" containerName="maas-api"
Sep 08 17:06:35.144473 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.144458    2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7f5a467-4687-4c87-97de-fa45f634e611" containerName="maas-api"
Sep 08 17:06:35.150422 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.150393    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.153057 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.153030    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6s2hc\"/\"openshift-service-ca.crt\""
Sep 08 17:06:35.153211 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.153034    2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6s2hc\"/\"kube-root-ca.crt\""
Sep 08 17:06:35.153211 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.153036    2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6s2hc\"/\"default-dockercfg-gwsmc\""
Sep 08 17:06:35.156970 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.156940    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"]
Sep 08 17:06:35.199026 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.198978    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-proc\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.199224 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.199123    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2h4h\" (UniqueName: \"kubernetes.io/projected/1b4b7b7e-e47e-45ef-8fee-d388f109824c-kube-api-access-c2h4h\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.199224 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.199192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-podres\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.199332 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.199234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-lib-modules\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.199332 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.199258    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-sys\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.281853 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.281808    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-554d8c779-fmjmz_faebcedf-5434-4a0b-8544-c5c33aae146f/console/0.log"
Sep 08 17:06:35.300191 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300158    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-podres\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300209    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-lib-modules\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300229    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-sys\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300253    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-proc\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300325    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2h4h\" (UniqueName: \"kubernetes.io/projected/1b4b7b7e-e47e-45ef-8fee-d388f109824c-kube-api-access-c2h4h\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300336    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-podres\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300338    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-lib-modules\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300363    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-proc\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.300391 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.300365    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b4b7b7e-e47e-45ef-8fee-d388f109824c-sys\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.310104 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.310069    2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2h4h\" (UniqueName: \"kubernetes.io/projected/1b4b7b7e-e47e-45ef-8fee-d388f109824c-kube-api-access-c2h4h\") pod \"perf-node-gather-daemonset-92kzp\" (UID: \"1b4b7b7e-e47e-45ef-8fee-d388f109824c\") " pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.463429 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.463392    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:35.744787 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:35.744740    2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"]
Sep 08 17:06:35.746648 ip-10-0-131-47 kubenswrapper[2581]: W0908 17:06:35.746615    2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1b4b7b7e_e47e_45ef_8fee_d388f109824c.slice/crio-0b3d51497ea42ae3407d4242e1c9686c62b16826ab0e92d829b3bdb35e9ab4c0 WatchSource:0}: Error finding container 0b3d51497ea42ae3407d4242e1c9686c62b16826ab0e92d829b3bdb35e9ab4c0: Status 404 returned error can't find the container with id 0b3d51497ea42ae3407d4242e1c9686c62b16826ab0e92d829b3bdb35e9ab4c0
Sep 08 17:06:36.582440 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:36.582391    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp" event={"ID":"1b4b7b7e-e47e-45ef-8fee-d388f109824c","Type":"ContainerStarted","Data":"6d0796ae0477ae9f6be43cf7173f3088754e5796ab524eb4e3cedd7fd3a2af3a"}
Sep 08 17:06:36.582865 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:36.582458    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:36.582865 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:36.582475    2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp" event={"ID":"1b4b7b7e-e47e-45ef-8fee-d388f109824c","Type":"ContainerStarted","Data":"0b3d51497ea42ae3407d4242e1c9686c62b16826ab0e92d829b3bdb35e9ab4c0"}
Sep 08 17:06:36.600331 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:36.600271    2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp" podStartSLOduration=1.600252375 podStartE2EDuration="1.600252375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 17:06:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 17:06:36.598321772 +0000 UTC m=+2164.586757726" watchObservedRunningTime="2026-09-08 17:06:36.600252375 +0000 UTC m=+2164.588688388"
Sep 08 17:06:37.194225 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:37.194193    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-86f9f_a05ddf23-324a-4306-94db-ba8c35725f98/dns/0.log"
Sep 08 17:06:37.218671 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:37.218630    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-86f9f_a05ddf23-324a-4306-94db-ba8c35725f98/kube-rbac-proxy/0.log"
Sep 08 17:06:37.387380 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:37.387351    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-spd2m_b571ac4f-aa42-485c-a499-31ec1ce3ca21/dns-node-resolver/0.log"
Sep 08 17:06:38.036104 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:38.036072    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zvrpv_7f9d4276-bad2-4034-8011-0ba5b03a071c/node-ca/0.log"
Sep 08 17:06:39.016612 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:39.016578    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs_818bb221-c71b-4e7f-a054-3dc1ccadde14/istio-proxy/0.log"
Sep 08 17:06:39.248331 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:39.248296    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fngj4_b14f374c-fbc3-4890-b4c6-6e80a76947ba/discovery/0.log"
Sep 08 17:06:39.331387 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:39.331302    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/0.log"
Sep 08 17:06:39.339125 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:39.339096    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/1.log"
Sep 08 17:06:40.333514 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:40.333483    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2jxkw_a05c0e76-b0d6-404f-ab9a-345bad345f71/serve-healthcheck-canary/0.log"
Sep 08 17:06:41.127927 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:41.127899    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpptf_e852cdd4-a83f-47cd-a2b6-87a8f8b970d4/kube-rbac-proxy/0.log"
Sep 08 17:06:41.161926 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:41.161894    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpptf_e852cdd4-a83f-47cd-a2b6-87a8f8b970d4/exporter/0.log"
Sep 08 17:06:41.185561 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:41.185534    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wpptf_e852cdd4-a83f-47cd-a2b6-87a8f8b970d4/extractor/0.log"
Sep 08 17:06:42.598786 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:42.598756    2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6s2hc/perf-node-gather-daemonset-92kzp"
Sep 08 17:06:43.777143 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:43.777099    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-784b94fdd6-smjd5_422a25e3-37cb-4934-8bc7-34119ae51a46/manager/0.log"
Sep 08 17:06:43.801323 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:43.801294    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-8mkwr_5c83bcd3-82b8-4e5e-ade4-6ecbee495210/server/0.log"
Sep 08 17:06:43.881370 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:43.881339    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-xwmjl_2b919858-2349-4df2-aef9-fa22ddcef0ad/manager/0.log"
Sep 08 17:06:44.000321 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:44.000286    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-qfxwb_324a88f2-c4b3-44bc-9a4d-dda628cf4e7e/manager/0.log"
Sep 08 17:06:44.022042 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:44.022007    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-86d7bb586f-qfxwb_324a88f2-c4b3-44bc-9a4d-dda628cf4e7e/copy-manifests/0.log"
Sep 08 17:06:45.552548 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:45.552515    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-76d8558585-ppg4n_3ea41980-826b-4c23-9f76-53735cc48b2d/manager/0.log"
Sep 08 17:06:46.212306 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:46.212274    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs_818bb221-c71b-4e7f-a054-3dc1ccadde14/istio-proxy/0.log"
Sep 08 17:06:46.432264 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:46.432226    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fngj4_b14f374c-fbc3-4890-b4c6-6e80a76947ba/discovery/0.log"
Sep 08 17:06:46.482551 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:46.482455    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/0.log"
Sep 08 17:06:46.490523 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:46.490489    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/1.log"
Sep 08 17:06:48.085499 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:48.085467    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-srrzs_818bb221-c71b-4e7f-a054-3dc1ccadde14/istio-proxy/0.log"
Sep 08 17:06:48.318947 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:48.318898    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-fngj4_b14f374c-fbc3-4890-b4c6-6e80a76947ba/discovery/0.log"
Sep 08 17:06:48.375101 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:48.375014    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/0.log"
Sep 08 17:06:48.384983 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:48.384950    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-fw42b_7da861c5-9489-4ca8-9863-c616d748d2b6/istio-proxy/1.log"
Sep 08 17:06:52.505039 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.505006    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/kube-multus-additional-cni-plugins/0.log"
Sep 08 17:06:52.527410 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.527383    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/egress-router-binary-copy/0.log"
Sep 08 17:06:52.548156 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.548121    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/cni-plugins/0.log"
Sep 08 17:06:52.568684 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.568653    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/bond-cni-plugin/0.log"
Sep 08 17:06:52.591447 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.591427    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/routeoverride-cni/0.log"
Sep 08 17:06:52.615236 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.615206    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/whereabouts-cni-bincopy/0.log"
Sep 08 17:06:52.642756 ip-10-0-131-47 kubenswrapper[2581]: I0908 17:06:52.642724    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2mln5_77e29550-28a7-47dc-979d-52e72877e925/whereabouts-cni/0.log"