Sep 08 01:59:02.425204 ip-10-0-131-169 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 01:59:02.850970 ip-10-0-131-169 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 01:59:02.850970 ip-10-0-131-169 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 01:59:02.850970 ip-10-0-131-169 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 01:59:02.850970 ip-10-0-131-169 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 01:59:02.850970 ip-10-0-131-169 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 01:59:02.853629 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.853529    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 01:59:02.857299 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857283    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 01:59:02.857299 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857299    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857304    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857307    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857310    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857314    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857319    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857322    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857325    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857327    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857330    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857333    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857335    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857338    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857341    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857343    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857346    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857348    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857351    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857357    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857360    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 01:59:02.857361 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857363    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857365    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857368    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857371    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857374    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857378    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857382    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857385    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857389    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857393    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857396    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857398    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857402    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857405    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857407    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857410    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857412    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857415    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857418    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 01:59:02.857865 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857420    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857423    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857425    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857428    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857431    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857433    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857436    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857438    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857441    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857443    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857446    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857448    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857451    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857453    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857455    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857459    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857462    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857465    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857468    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857470    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 01:59:02.858337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857473    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857475    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857478    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857481    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857483    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857485    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857488    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857491    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857494    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857496    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857499    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857501    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857504    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857506    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857509    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857511    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857514    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857516    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857519    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857522    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 01:59:02.858826 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857524    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857527    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857530    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857532    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857534    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857537    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857539    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857543    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857545    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857548    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857550    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857553    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857555    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857558    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857560    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857563    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857566    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857568    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.857571    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858298    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 01:59:02.859315 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858305    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858309    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858312    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858315    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858319    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858323    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858326    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858329    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858332    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858335    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858338    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858342    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858345    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858348    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858351    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858354    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858357    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858360    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858363    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858367    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 01:59:02.859807 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858370    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858373    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858376    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858379    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858381    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858386    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858390    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858393    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858396    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858399    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858402    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858405    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858407    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858410    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858413    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858416    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858418    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858421    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858424    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 01:59:02.860312 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858427    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858429    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858432    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858434    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858437    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858440    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858442    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858445    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858448    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858450    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858453    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858455    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858459    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858461    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858464    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858467    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858470    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858474    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858477    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 01:59:02.860774 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858480    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858483    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858486    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858490    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858493    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858496    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858498    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858501    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858504    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858507    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858510    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858512    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858515    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858518    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858521    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858523    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858526    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858528    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858531    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858533    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 01:59:02.861259 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858536    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858538    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858541    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858544    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858548    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858551    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858554    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858557    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858560    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858563    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858566    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858568    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858571    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858574    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858576    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858579    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858581    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858584    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858588    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858592    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 01:59:02.861758 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858982    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858987    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858991    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858993    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858997    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.858999    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859002    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859006    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859010    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859013    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859015    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859018    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859020    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859023    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859026    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859028    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859034    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859037    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859039    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 01:59:02.862255 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859042    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859045    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859047    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859050    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859053    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859055    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859058    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859060    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859063    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859066    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859068    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859071    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859073    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859076    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859078    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859081    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859084    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859086    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859089    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859092    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 01:59:02.862801 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859095    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859098    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859100    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859103    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859105    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859107    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859110    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859113    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859116    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859119    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859123    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859126    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859128    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859131    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859133    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859136    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859139    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859143    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859146    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 01:59:02.863337 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859149    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859152    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859154    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859157    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859160    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859162    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859165    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859167    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859170    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859173    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859175    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859177    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859180    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859183    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859186    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859190    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859194    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859197    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859199    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859202    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 01:59:02.863817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859205    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859208    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859213    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859216    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859219    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859222    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859225    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859228    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859231    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859233    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859236    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859240    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859242    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859245    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859247    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859250    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859252    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859255    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859258    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859260    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 01:59:02.864310 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.859263    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859340    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859373    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859379    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859384    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859389    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859392    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859396    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859401    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859404    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859407    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859410    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859414    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859417    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859420    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859425    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859429    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859432    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859435    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859440    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859443    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859446    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859449    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859453    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 01:59:02.864818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859457    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859460    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859463    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859466    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859469    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859472    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859475    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859479    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859481    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859486    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859489    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859492    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859495    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859498    2562 flags.go:64] FLAG: --enable-server="true"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859501    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859506    2562 flags.go:64] FLAG: --event-burst="100"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859509    2562 flags.go:64] FLAG: --event-qps="50"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859512    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859515    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859517    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859521    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859524    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859527    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859532    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859535    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 01:59:02.865406 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859538    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859540    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859543    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859547    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859550    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859552    2562 flags.go:64] FLAG: --feature-gates=""
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859556    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859559    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859563    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859566    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859569    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859572    2562 flags.go:64] FLAG: --help="false"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859575    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-131-169.ec2.internal"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859578    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859581    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859584    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859587    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859591    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859594    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859597    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859600    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859602    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859606    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859609    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 01:59:02.866035 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859612    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859615    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859617    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859621    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859623    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859627    2562 flags.go:64] FLAG: --lock-file=""
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859631    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859633    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859636    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859642    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859645    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859648    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859650    2562 flags.go:64] FLAG: --logging-format="text"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859653    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859656    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859659    2562 flags.go:64] FLAG: --manifest-url=""
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859663    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859667    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859671    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859682    2562 flags.go:64] FLAG: --max-pods="110"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859686    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859689    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859692    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859695    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859699    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 01:59:02.866627 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859702    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859705    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859712    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859715    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859718    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859721    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859725    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859731    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859734    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859737    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859740    2562 flags.go:64] FLAG: --port="10250"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859743    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859746    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-035b946cb62e44123"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859749    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859754    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859757    2562 flags.go:64] FLAG: --register-node="true"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859760    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859763    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859766    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859769    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859772    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859778    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859782    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859785    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859788    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 01:59:02.867268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859790    2562 flags.go:64] FLAG: --runonce="false"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859793    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859796    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859799    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859802    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859805    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859808    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859811    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859815    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859817    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859820    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859823    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859826    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859829    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859833    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859836    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859841    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859844    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859847    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859853    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859855    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859859    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859862    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859865    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859868    2562 flags.go:64] FLAG: --v="2"
Sep 08 01:59:02.867926 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859872    2562 flags.go:64] FLAG: --version="false"
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859876    2562 flags.go:64] FLAG: --vmodule=""
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859879    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.859883    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860010    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860014    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860017    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860022    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860026    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860029    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860032    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860035    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860037    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860040    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860044    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860047    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860050    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860052    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860055    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860058    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 01:59:02.868536 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860061    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860063    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860066    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860069    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860072    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860075    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860079    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860081    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860084    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860087    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860090    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860093    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860095    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860098    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860101    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860103    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860106    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860109    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860111    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 01:59:02.869037 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860114    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860117    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860119    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860122    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860124    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860127    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860129    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860132    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860135    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860137    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860140    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860142    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860145    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860147    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860150    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860152    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860156    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860158    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860161    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860165    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 01:59:02.869511 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860167    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860170    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860172    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860176    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860180    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860183    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860186    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860189    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860192    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860195    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860197    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860200    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860204    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860207    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860210    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860212    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860215    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860217    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860220    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 01:59:02.870018 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860222    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860225    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860227    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860230    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860232    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860235    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860237    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860240    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860242    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860245    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860248    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860251    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860257    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860260    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860264    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860267    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860270    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860273    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860276    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860278    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 01:59:02.870481 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860281    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860283    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860286    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860288    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.860291    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.860856    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.867902    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.867936    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.868797    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.868807    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868860    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868865    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868869    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868872    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 01:59:02.870985 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868877    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868882    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868885    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868888    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868891    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868895    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868898    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868901    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868904    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868908    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868924    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868929    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868931    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868934    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868937    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868939    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868942    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868944    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868947    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868950    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 01:59:02.871364 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868953    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868955    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868958    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868960    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868963    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868968    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868970    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868973    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868976    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868979    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868981    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868984    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868986    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868989    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868991    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868994    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868997    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.868999    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869002    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 01:59:02.871862 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869004    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869007    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869009    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869012    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869014    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869017    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869020    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869022    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869025    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869027    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869030    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869032    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869035    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869038    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869040    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869043    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869046    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869048    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869052    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869055    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 01:59:02.872341 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869058    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869061    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869065    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869067    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869070    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869072    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869075    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869077    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869080    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869082    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869085    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869087    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869090    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869093    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869095    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869098    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869101    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869103    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869106    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 01:59:02.872817 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869108    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869111    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869113    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869116    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869118    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869121    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869123    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869126    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869130    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869134    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869137    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869141    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869144    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869148    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869151    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869154    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 01:59:02.873400 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869157    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.869162    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869299    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869305    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869308    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869311    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869314    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869317    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869320    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869323    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869326    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869329    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869331    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869334    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869337    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 01:59:02.873791 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869340    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869342    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869345    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869348    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869350    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869353    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869355    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869358    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869361    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869365    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869368    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869371    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869374    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869377    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869379    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869382    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869385    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869388    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869391    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 01:59:02.874179 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869394    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869398    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869401    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869404    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869407    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869410    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869413    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869416    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869419    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869423    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869425    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869428    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869431    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869433    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869436    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869438    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869441    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869443    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869446    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869448    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 01:59:02.874633 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869451    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869453    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869456    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869458    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869461    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869463    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869467    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869469    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869472    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869475    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869477    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869480    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869482    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869485    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869487    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869490    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869493    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869495    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869498    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 01:59:02.875124 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869500    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869503    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869505    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869508    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869510    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869513    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869516    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869519    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869521    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869524    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869526    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869529    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869531    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869534    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869537    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869539    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869541    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869544    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869547    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869549    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 01:59:02.875579 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869552    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869554    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869557    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869560    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869562    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869564    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869567    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:02.869569    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.869574    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.869676    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.871651    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.872731    2562 server.go:1019] "Starting client certificate rotation"
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.872826    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 01:59:02.876228 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.872893    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 01:59:02.876778 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.875350    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 01:59:02.877860 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.877838    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 01:59:02.890622 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.890607    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 08 01:59:02.893374 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.893359    2562 log.go:25] "Validated CRI v1 image API"
Sep 08 01:59:02.896379 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.896363    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 01:59:02.900562 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.900542    2562 fs.go:135] Filesystem UUIDs: map[13cbb269-7740-4bd9-b6e5-4dc612403e8a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a869b7c7-b93b-49d3-b022-d250b31a1e9e:/dev/nvme0n1p3]
Sep 08 01:59:02.900622 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.900563    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 01:59:02.903738 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.903719    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 01:59:02.905766 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.905654    2562 manager.go:216] Machine: {Timestamp:2026-09-08 01:59:02.904181138 +0000 UTC m=+0.359796063 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101829 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec278046ba45934e1bcab697d496d2f3 SystemUUID:ec278046-ba45-934e-1bca-b697d496d2f3 BootID:f46e4c72-548d-4f9c-8dad-dce879e21738 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:92:bc:77:06:1d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:92:bc:77:06:1d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ee:d9:a4:d1:1f:8f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 01:59:02.905766 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.905761    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 01:59:02.905882 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.905840    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 01:59:02.908547 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.908522    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 01:59:02.908686 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.908549    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-169.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 01:59:02.909986 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.909976    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 01:59:02.910019 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.909989    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 01:59:02.910019 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.909997    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 01:59:02.910812 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.910802    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 01:59:02.912076 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.912066    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 01:59:02.915630 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915617    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 01:59:02.915748 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915739    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 01:59:02.915780 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915770    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 01:59:02.915780 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915779    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 01:59:02.915834 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915797    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 01:59:02.915834 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915807    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 08 01:59:02.915834 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.915819    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 01:59:02.916202 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.916189    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 01:59:02.916262 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.916214    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 01:59:02.919048 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.919028    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 01:59:02.922049 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922025    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 01:59:02.922125 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922061    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 01:59:02.922263 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922251    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 01:59:02.922307 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922270    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 01:59:02.922307 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922280    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 01:59:02.922307 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922289    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 01:59:02.922307 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922301    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 01:59:02.922429 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922309    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 01:59:02.922814 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922798    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 01:59:02.922883 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922822    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 01:59:02.922883 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922834    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 01:59:02.922883 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922843    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 01:59:02.922883 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922856    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 01:59:02.922883 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.922869    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 01:59:02.923786 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.923757    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 01:59:02.923859 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.923791    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 01:59:02.925390 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.925358    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 01:59:02.925496 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.925356    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 01:59:02.925650 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.925633    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-169.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 01:59:02.925836 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.925804    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vpnlx"
Sep 08 01:59:02.928809 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.928632    2562 server.go:1268] "Started kubelet"
Sep 08 01:59:02.928885 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.928689    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 01:59:02.928994 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.928704    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 01:59:02.929062 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.929037    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 01:59:02.929866 ip-10-0-131-169 systemd[1]: Started Kubernetes Kubelet.
Sep 08 01:59:02.930899 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.930162    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 01:59:02.932928 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.932900    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 01:59:02.933018 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.932937    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vpnlx"
Sep 08 01:59:02.934140 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.933022    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-169.ec2.internal.18d335e6ecd8c947  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-169.ec2.internal,UID:ip-10-0-131-169.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-169.ec2.internal,},FirstTimestamp:2026-09-08 01:59:02.928599367 +0000 UTC m=+0.384214334,LastTimestamp:2026-09-08 01:59:02.928599367 +0000 UTC m=+0.384214334,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-169.ec2.internal,}"
Sep 08 01:59:02.934874 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.934858    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 01:59:02.936966 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.936953    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 01:59:02.936966 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.936964    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 01:59:02.937076 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.937026    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:02.937495 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937470    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 01:59:02.937495 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937482    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 01:59:02.937648 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937502    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 01:59:02.937707 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937693    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 01:59:02.937707 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937703    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 01:59:02.937835 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937817    2562 factory.go:55] Registering systemd factory
Sep 08 01:59:02.937835 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.937834    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 08 01:59:02.938066 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.938050    2562 factory.go:153] Registering CRI-O factory
Sep 08 01:59:02.938066 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.938066    2562 factory.go:223] Registration of the crio container factory successfully
Sep 08 01:59:02.938190 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.938116    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 01:59:02.938190 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.938135    2562 factory.go:103] Registering Raw factory
Sep 08 01:59:02.938190 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.938150    2562 manager.go:1196] Started watching for new ooms in manager
Sep 08 01:59:02.938566 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.938553    2562 manager.go:349] Starting recovery of all containers
Sep 08 01:59:02.939000 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.938977    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 01:59:02.939000 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.938982    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-169.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 01:59:02.949956 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.949936    2562 manager.go:354] Recovery completed
Sep 08 01:59:02.955977 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.955964    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:02.958142 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958122    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:02.958229 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958158    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:02.958229 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958173    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:02.958777 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958762    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 01:59:02.958777 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958774    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 01:59:02.958935 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958790    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 01:59:02.958935 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.958825    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:02.959546 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.959531    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:02.959618 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.959558    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:02.959618 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.959568    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:02.960857 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.960841    2562 policy_none.go:49] "None policy: Start"
Sep 08 01:59:02.960936 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.960861    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 01:59:02.960936 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.960874    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 01:59:02.962882 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.962869    2562 policy_none.go:47] "Start"
Sep 08 01:59:02.998508 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.998491    2562 manager.go:337] "Starting Device Plugin manager"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.998528    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.998538    2562 server.go:87] "Starting device plugin registration server"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.998861    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.998872    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.998976    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.999054    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:02.999062    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.999784    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 01:59:03.014969 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:02.999837    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.061963 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.061929    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 01:59:03.063312 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.063292    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 01:59:03.063395 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.063341    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 01:59:03.063395 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.063367    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 01:59:03.063495 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.063409    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 01:59:03.065189 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.065169    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 01:59:03.099983 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.099963    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:03.100835 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.100821    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:03.100907 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.100848    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:03.100907 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.100858    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:03.100907 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.100882    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.108559 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.108472    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.108559 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.108494    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-169.ec2.internal\": node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.122391 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.122369    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.164163 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.164140    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"]
Sep 08 01:59:03.164249 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.164199    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:03.165076 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.165063    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:03.165133 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.165089    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:03.165133 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.165100    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:03.167150 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167139    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:03.167293 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167280    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.167328 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167310    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:03.167836 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167822    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:03.167897 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167843    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:03.167897 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167853    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:03.167897 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167841    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:03.167897 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167893    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:03.168068 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.167908    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:03.170211 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.170199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.170263 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.170222    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 01:59:03.170931 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.170897    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 01:59:03.170999 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.170939    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 01:59:03.170999 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.170949    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeHasSufficientPID"
Sep 08 01:59:03.185509 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.185489    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-169.ec2.internal\" not found" node="ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.189943 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.189929    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-169.ec2.internal\" not found" node="ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.222476 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.222458    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.239892 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.239871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f56ef06874a58adb59f017702cc18a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal\" (UID: \"f56ef06874a58adb59f017702cc18a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.239962 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.239896    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/578f76e9e3628a7f638f2eba0229db4a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-169.ec2.internal\" (UID: \"578f76e9e3628a7f638f2eba0229db4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.239962 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.239926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f56ef06874a58adb59f017702cc18a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal\" (UID: \"f56ef06874a58adb59f017702cc18a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.323047 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.323023    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.340369 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.340351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f56ef06874a58adb59f017702cc18a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal\" (UID: \"f56ef06874a58adb59f017702cc18a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.340424 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.340374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f56ef06874a58adb59f017702cc18a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal\" (UID: \"f56ef06874a58adb59f017702cc18a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.340424 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.340401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/578f76e9e3628a7f638f2eba0229db4a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-169.ec2.internal\" (UID: \"578f76e9e3628a7f638f2eba0229db4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.340489 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.340436    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f56ef06874a58adb59f017702cc18a23-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal\" (UID: \"f56ef06874a58adb59f017702cc18a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.340489 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.340443    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f56ef06874a58adb59f017702cc18a23-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal\" (UID: \"f56ef06874a58adb59f017702cc18a23\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.340547 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.340490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/578f76e9e3628a7f638f2eba0229db4a-config\") pod \"kube-apiserver-proxy-ip-10-0-131-169.ec2.internal\" (UID: \"578f76e9e3628a7f638f2eba0229db4a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.423812 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.423743    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.489673 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.489625    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.492999 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.492980    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.523948 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.523906    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.630223 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.630175    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.730424 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.730351    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.831009 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.830969    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-169.ec2.internal\" not found"
Sep 08 01:59:03.872019 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.871978    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 01:59:03.872426 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.872158    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 01:59:03.913422 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.913400    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 01:59:03.916307 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.916291    2562 apiserver.go:52] "Watching apiserver"
Sep 08 01:59:03.930966 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.930929    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 01:59:03.931310 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.931283    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-f8rjv","openshift-network-diagnostics/network-check-target-bd4nc","kube-system/konnectivity-agent-bglsd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9","openshift-dns/node-resolver-swc6x","openshift-multus/multus-additional-cni-plugins-czrbk","openshift-multus/multus-wfdf4","openshift-network-operator/iptables-alerter-xfpkk","openshift-ovn-kubernetes/ovnkube-node-27nx6","kube-system/global-pull-secret-syncer-m4v75","openshift-cluster-node-tuning-operator/tuned-89wxp","openshift-image-registry/node-ca-dtxzg"]
Sep 08 01:59:03.934003 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.933986    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:03.934096 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.934046    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:03.936231 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.936216    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:03.936286 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.936270    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:03.937308 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.937292    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.937390 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.937307    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 01:59:03.938628 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.938605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:03.939008 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.938923    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 01:54:03 +0000 UTC" deadline="2028-06-14 10:29:49.70212908 +0000 UTC"
Sep 08 01:59:03.939008 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.939007    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15488h30m45.763126128s"
Sep 08 01:59:03.940877 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.940855    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:03.940981 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.940907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 01:59:03.940981 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.940954    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b2vtb\""
Sep 08 01:59:03.941272 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.941239    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 01:59:03.943278 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943259    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.943379 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:03.943442 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/076a973d-56e0-43e1-8ccd-46dd0ee0422b-konnectivity-ca\") pod \"konnectivity-agent-bglsd\" (UID: \"076a973d-56e0-43e1-8ccd-46dd0ee0422b\") " pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:03.943515 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943493    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.943617 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943518    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:03.943617 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72b2d\" (UniqueName: \"kubernetes.io/projected/478998cf-9541-4e4d-99af-b5768b9a387d-kube-api-access-72b2d\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:03.943729 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:03.943729 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943650    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/076a973d-56e0-43e1-8ccd-46dd0ee0422b-agent-certs\") pod \"konnectivity-agent-bglsd\" (UID: \"076a973d-56e0-43e1-8ccd-46dd0ee0422b\") " pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:03.943803 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943752    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bx8f9\""
Sep 08 01:59:03.943803 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.943782    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 01:59:03.945968 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.945836    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.945968 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.945897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:03.945968 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.945941    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.946176 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.945904    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5xfgw\""
Sep 08 01:59:03.948244 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948222    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zs9wd\""
Sep 08 01:59:03.948731 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948461    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:03.948731 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948495    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 01:59:03.948731 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948504    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.948731 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948627    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.948956 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948744    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 01:59:03.948956 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948878    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"
Sep 08 01:59:03.948956 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948908    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 01:59:03.949069 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.948996    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 01:59:03.950975 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.950952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:03.951267 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.951245    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 01:59:03.951465 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.951449    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-djzfq\""
Sep 08 01:59:03.953554 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.953536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:03.953643 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.953544    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.953868 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.953849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nlrpv\""
Sep 08 01:59:03.953937 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.953875    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 01:59:03.954363 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.954337    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 01:59:03.954625 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.954600    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.956754 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.956729    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 01:59:03.956846 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.956768    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wjlgx\""
Sep 08 01:59:03.957386 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.957369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 01:59:03.957571 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.957540    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 01:59:03.957652 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.957574    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.957652 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.957602    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.957816 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.957798    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 01:59:03.957918 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.957903    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:03.958021 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:03.957996    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:03.958113 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.958097    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 01:59:03.960588 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.960569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:03.962971 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.962952    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qwsdw\""
Sep 08 01:59:03.962971 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.962967    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.963137 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.962953    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.963137 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.962959    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal"]
Sep 08 01:59:03.963137 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.963047    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:03.963137 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.963080    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal"]
Sep 08 01:59:03.965505 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.965474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 01:59:03.965617 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.965476    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 01:59:03.965726 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.965675    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 01:59:03.965726 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.965720    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kz4hl\""
Sep 08 01:59:03.972601 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.972582    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gblcl"
Sep 08 01:59:03.980274 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:03.980256    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gblcl"
Sep 08 01:59:04.038107 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.038083    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 01:59:04.043951 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.043928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-systemd-units\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044079 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.043961    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-var-lib-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044079 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-system-cni-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.044079 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-netns\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.044079 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-socket-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.044079 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044079    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovnkube-config\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-kubelet\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044130    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-device-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovn-node-metrics-cert\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044202    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-sys\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-host\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-node-log\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.044349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysconfig\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044377    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-tuned\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-systemd\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-kubernetes\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-cnibin\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/076a973d-56e0-43e1-8ccd-46dd0ee0422b-konnectivity-ca\") pod \"konnectivity-agent-bglsd\" (UID: \"076a973d-56e0-43e1-8ccd-46dd0ee0422b\") " pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-cni-bin\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044545    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-sys-fs\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-run-netns\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-cni-bin\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044604    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-systemd\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cc0d11-8de8-4999-abda-a566c7e01ebc-tmp\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-socket-dir-parent\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.044808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42b4r\" (UniqueName: \"kubernetes.io/projected/71e5393a-88a0-4b82-9f4c-06421c623a80-kube-api-access-42b4r\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-conf-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044883    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-slash\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-cni-netd\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81de7c44-fc49-4e80-bdf7-7006f275207c-dbus\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-hostroot\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb7cj\" (UniqueName: \"kubernetes.io/projected/a237656e-58b9-4e62-b4ee-35d1163e84d9-kube-api-access-qb7cj\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.044997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4v9w\" (UniqueName: \"kubernetes.io/projected/84a62f2e-5005-466f-baac-35def54984da-kube-api-access-l4v9w\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-etc-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689f935b-6e31-4f84-9c72-a9334097564f-tmp-dir\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-cni-multus\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84a62f2e-5005-466f-baac-35def54984da-host-slash\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-registration-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.045419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045220    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysctl-conf\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.045911 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-lib-modules\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.045911 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045764    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:04.045911 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-cnibin\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.046146 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.045967    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-k8s-cni-cncf-io\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.046146 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5xq\" (UniqueName: \"kubernetes.io/projected/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-kube-api-access-fm5xq\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.046146 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046035    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/076a973d-56e0-43e1-8ccd-46dd0ee0422b-konnectivity-ca\") pod \"konnectivity-agent-bglsd\" (UID: \"076a973d-56e0-43e1-8ccd-46dd0ee0422b\") " pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:04.046146 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-kubelet\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.046146 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/076a973d-56e0-43e1-8ccd-46dd0ee0422b-agent-certs\") pod \"konnectivity-agent-bglsd\" (UID: \"076a973d-56e0-43e1-8ccd-46dd0ee0422b\") " pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/689f935b-6e31-4f84-9c72-a9334097564f-hosts-file\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-etc-kubernetes\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-env-overrides\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysctl-d\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.046389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a29481b6-14dc-4758-86ac-8432c48f1a9e-serviceca\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046399    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-daemon-config\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046416    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84a62f2e-5005-466f-baac-35def54984da-iptables-alerter-script\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046439    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9spp\" (UniqueName: \"kubernetes.io/projected/d6cc0d11-8de8-4999-abda-a566c7e01ebc-kube-api-access-r9spp\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-system-cni-dir\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046519    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-log-socket\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046542    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkl2k\" (UniqueName: \"kubernetes.io/projected/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-kube-api-access-jkl2k\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046560    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a29481b6-14dc-4758-86ac-8432c48f1a9e-host\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a237656e-58b9-4e62-b4ee-35d1163e84d9-cni-binary-copy\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-modprobe-d\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-var-lib-kubelet\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-ovn\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.046671 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-cni-binary-copy\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.046695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.046786    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2n5h\" (UniqueName: \"kubernetes.io/projected/689f935b-6e31-4f84-9c72-a9334097564f-kube-api-access-k2n5h\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.047151    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 01:59:04.547114037 +0000 UTC m=+2.002728948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovnkube-script-lib\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81de7c44-fc49-4e80-bdf7-7006f275207c-kubelet-config\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047331    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-run\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047410    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72b2d\" (UniqueName: \"kubernetes.io/projected/478998cf-9541-4e4d-99af-b5768b9a387d-kube-api-access-72b2d\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-cni-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-multus-certs\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047640    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.047886 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.047700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wfsh\" (UniqueName: \"kubernetes.io/projected/a29481b6-14dc-4758-86ac-8432c48f1a9e-kube-api-access-7wfsh\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.051830 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.051811    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:04.051922 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.051833    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:04.051922 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.051844    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:04.051922 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.051891    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:04.55187894 +0000 UTC m=+2.007493837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:04.053387 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.053259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/076a973d-56e0-43e1-8ccd-46dd0ee0422b-agent-certs\") pod \"konnectivity-agent-bglsd\" (UID: \"076a973d-56e0-43e1-8ccd-46dd0ee0422b\") " pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:04.055258 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.055236    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72b2d\" (UniqueName: \"kubernetes.io/projected/478998cf-9541-4e4d-99af-b5768b9a387d-kube-api-access-72b2d\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:04.093575 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.093544    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod578f76e9e3628a7f638f2eba0229db4a.slice/crio-42c218a6dac828115d92dd472bd3d00a42e073de99fcc32d516b392bb85a872f WatchSource:0}: Error finding container 42c218a6dac828115d92dd472bd3d00a42e073de99fcc32d516b392bb85a872f: Status 404 returned error can't find the container with id 42c218a6dac828115d92dd472bd3d00a42e073de99fcc32d516b392bb85a872f
Sep 08 01:59:04.093843 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.093819    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56ef06874a58adb59f017702cc18a23.slice/crio-6ea7c901cd520c06040fe1f06cb881c71cca4df5a2aea6e8341108fd1de5b005 WatchSource:0}: Error finding container 6ea7c901cd520c06040fe1f06cb881c71cca4df5a2aea6e8341108fd1de5b005: Status 404 returned error can't find the container with id 6ea7c901cd520c06040fe1f06cb881c71cca4df5a2aea6e8341108fd1de5b005
Sep 08 01:59:04.098715 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.098696    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 01:59:04.148010 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.147972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-cnibin\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.148010 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-cni-bin\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-sys-fs\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-run-netns\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148077    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-cnibin\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-cni-bin\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-cni-bin\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-run-netns\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148143    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-cni-bin\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-sys-fs\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-systemd\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148204    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cc0d11-8de8-4999-abda-a566c7e01ebc-tmp\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-systemd\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148234    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-socket-dir-parent\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148247 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42b4r\" (UniqueName: \"kubernetes.io/projected/71e5393a-88a0-4b82-9f4c-06421c623a80-kube-api-access-42b4r\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148389    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-conf-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-slash\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-socket-dir-parent\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148444    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-cni-netd\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148482    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-slash\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-cni-netd\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148488    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-conf-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81de7c44-fc49-4e80-bdf7-7006f275207c-dbus\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148547    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-hostroot\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb7cj\" (UniqueName: \"kubernetes.io/projected/a237656e-58b9-4e62-b4ee-35d1163e84d9-kube-api-access-qb7cj\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-hostroot\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4v9w\" (UniqueName: \"kubernetes.io/projected/84a62f2e-5005-466f-baac-35def54984da-kube-api-access-l4v9w\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81de7c44-fc49-4e80-bdf7-7006f275207c-dbus\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148646    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-etc-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689f935b-6e31-4f84-9c72-a9334097564f-tmp-dir\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-etc-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.148833 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148715    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-cni-multus\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84a62f2e-5005-466f-baac-35def54984da-host-slash\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-cni-multus\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148781    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-registration-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/84a62f2e-5005-466f-baac-35def54984da-host-slash\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148832    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysctl-conf\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148847    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-lib-modules\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148889    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-registration-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-cnibin\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148975    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-lib-modules\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.148996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-k8s-cni-cncf-io\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149032    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-cnibin\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysctl-conf\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/689f935b-6e31-4f84-9c72-a9334097564f-tmp-dir\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5xq\" (UniqueName: \"kubernetes.io/projected/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-kube-api-access-fm5xq\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149107    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-kubelet\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.149722 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/689f935b-6e31-4f84-9c72-a9334097564f-hosts-file\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-etc-kubernetes\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149109    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-k8s-cni-cncf-io\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-kubelet\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149264    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/689f935b-6e31-4f84-9c72-a9334097564f-hosts-file\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149265    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-etc-kubernetes\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-env-overrides\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149321    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-run-ovn-kubernetes\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149347    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysctl-d\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a29481b6-14dc-4758-86ac-8432c48f1a9e-serviceca\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-daemon-config\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149429    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84a62f2e-5005-466f-baac-35def54984da-iptables-alerter-script\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9spp\" (UniqueName: \"kubernetes.io/projected/d6cc0d11-8de8-4999-abda-a566c7e01ebc-kube-api-access-r9spp\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-system-cni-dir\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.150591 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149503    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysctl-d\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149552    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149562    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-system-cni-dir\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-log-socket\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkl2k\" (UniqueName: \"kubernetes.io/projected/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-kube-api-access-jkl2k\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149636    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a29481b6-14dc-4758-86ac-8432c48f1a9e-host\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a237656e-58b9-4e62-b4ee-35d1163e84d9-cni-binary-copy\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-modprobe-d\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-var-lib-kubelet\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-ovn\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149801    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-cni-binary-copy\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149820    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-env-overrides\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2n5h\" (UniqueName: \"kubernetes.io/projected/689f935b-6e31-4f84-9c72-a9334097564f-kube-api-access-k2n5h\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149917    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a29481b6-14dc-4758-86ac-8432c48f1a9e-serviceca\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.151283 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-log-socket\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150171    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a29481b6-14dc-4758-86ac-8432c48f1a9e-host\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.149922    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovnkube-script-lib\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81de7c44-fc49-4e80-bdf7-7006f275207c-kubelet-config\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150872    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81de7c44-fc49-4e80-bdf7-7006f275207c-kubelet-config\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150465    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/71e5393a-88a0-4b82-9f4c-06421c623a80-tuning-conf-dir\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150559    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-modprobe-d\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150616    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-ovn\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150914    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-run\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150758    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/84a62f2e-5005-466f-baac-35def54984da-iptables-alerter-script\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-run\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-cni-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-var-lib-kubelet\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-multus-certs\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151043    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-multus-certs\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wfsh\" (UniqueName: \"kubernetes.io/projected/a29481b6-14dc-4758-86ac-8432c48f1a9e-kube-api-access-7wfsh\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.152090 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovnkube-script-lib\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-systemd-units\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a237656e-58b9-4e62-b4ee-35d1163e84d9-cni-binary-copy\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-var-lib-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-cni-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a237656e-58b9-4e62-b4ee-35d1163e84d9-multus-daemon-config\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.150648    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/71e5393a-88a0-4b82-9f4c-06421c623a80-cni-binary-copy\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151195    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-systemd-units\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-var-lib-openvswitch\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-system-cni-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151242    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-netns\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-socket-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovnkube-config\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-kubelet\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151318    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-run-netns\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-device-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovn-node-metrics-cert\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.152698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-system-cni-dir\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d6cc0d11-8de8-4999-abda-a566c7e01ebc-tmp\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-socket-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151406    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a237656e-58b9-4e62-b4ee-35d1163e84d9-host-var-lib-kubelet\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-device-dir\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-sys\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-host\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-node-log\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151563    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-sys\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151579    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-node-log\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-host\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151681    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysconfig\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-sysconfig\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-tuned\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.151775    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:04.153292 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-systemd\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-kubernetes\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151848    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-run-systemd\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.151857    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 01:59:04.651839425 +0000 UTC m=+2.107454330 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovnkube-config\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.151886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-kubernetes\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.153394    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-ovn-node-metrics-cert\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.153865 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.153659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d6cc0d11-8de8-4999-abda-a566c7e01ebc-etc-tuned\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.162963 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.162939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb7cj\" (UniqueName: \"kubernetes.io/projected/a237656e-58b9-4e62-b4ee-35d1163e84d9-kube-api-access-qb7cj\") pod \"multus-wfdf4\" (UID: \"a237656e-58b9-4e62-b4ee-35d1163e84d9\") " pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.163225 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.163201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkl2k\" (UniqueName: \"kubernetes.io/projected/96fbdf15-dfed-41b3-8589-4de4d76ba9d8-kube-api-access-jkl2k\") pod \"ovnkube-node-27nx6\" (UID: \"96fbdf15-dfed-41b3-8589-4de4d76ba9d8\") " pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.163225 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.163199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9spp\" (UniqueName: \"kubernetes.io/projected/d6cc0d11-8de8-4999-abda-a566c7e01ebc-kube-api-access-r9spp\") pod \"tuned-89wxp\" (UID: \"d6cc0d11-8de8-4999-abda-a566c7e01ebc\") " pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.163410 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.163262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4v9w\" (UniqueName: \"kubernetes.io/projected/84a62f2e-5005-466f-baac-35def54984da-kube-api-access-l4v9w\") pod \"iptables-alerter-xfpkk\" (UID: \"84a62f2e-5005-466f-baac-35def54984da\") " pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.163557 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.163538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42b4r\" (UniqueName: \"kubernetes.io/projected/71e5393a-88a0-4b82-9f4c-06421c623a80-kube-api-access-42b4r\") pod \"multus-additional-cni-plugins-czrbk\" (UID: \"71e5393a-88a0-4b82-9f4c-06421c623a80\") " pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.163623 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.163540    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wfsh\" (UniqueName: \"kubernetes.io/projected/a29481b6-14dc-4758-86ac-8432c48f1a9e-kube-api-access-7wfsh\") pod \"node-ca-dtxzg\" (UID: \"a29481b6-14dc-4758-86ac-8432c48f1a9e\") " pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.163720 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.163703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2n5h\" (UniqueName: \"kubernetes.io/projected/689f935b-6e31-4f84-9c72-a9334097564f-kube-api-access-k2n5h\") pod \"node-resolver-swc6x\" (UID: \"689f935b-6e31-4f84-9c72-a9334097564f\") " pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.164404 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.164386    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5xq\" (UniqueName: \"kubernetes.io/projected/bf02aa83-25f6-4f4c-9f65-ceafc66070cd-kube-api-access-fm5xq\") pod \"aws-ebs-csi-driver-node-bj2z9\" (UID: \"bf02aa83-25f6-4f4c-9f65-ceafc66070cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.263402 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.263315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:04.269074 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.269048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9"
Sep 08 01:59:04.275061 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.275038    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod076a973d_56e0_43e1_8ccd_46dd0ee0422b.slice/crio-e206f81631074223584c46320a2b9a1ff517648db5240e48e7f05328c690b6b1 WatchSource:0}: Error finding container e206f81631074223584c46320a2b9a1ff517648db5240e48e7f05328c690b6b1: Status 404 returned error can't find the container with id e206f81631074223584c46320a2b9a1ff517648db5240e48e7f05328c690b6b1
Sep 08 01:59:04.278317 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.278293    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf02aa83_25f6_4f4c_9f65_ceafc66070cd.slice/crio-ff6aaacce0a5c6272e67b8a25fab439445fd329a6b4c3abb52b81e8785968273 WatchSource:0}: Error finding container ff6aaacce0a5c6272e67b8a25fab439445fd329a6b4c3abb52b81e8785968273: Status 404 returned error can't find the container with id ff6aaacce0a5c6272e67b8a25fab439445fd329a6b4c3abb52b81e8785968273
Sep 08 01:59:04.292155 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.292136    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-swc6x"
Sep 08 01:59:04.301271 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.301246    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod689f935b_6e31_4f84_9c72_a9334097564f.slice/crio-a622ebb3bc6a8be71fddce545d3a0f5f2c68797c5967ce79146a3536231c5a3f WatchSource:0}: Error finding container a622ebb3bc6a8be71fddce545d3a0f5f2c68797c5967ce79146a3536231c5a3f: Status 404 returned error can't find the container with id a622ebb3bc6a8be71fddce545d3a0f5f2c68797c5967ce79146a3536231c5a3f
Sep 08 01:59:04.311849 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.311830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-czrbk"
Sep 08 01:59:04.317065 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.317044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wfdf4"
Sep 08 01:59:04.319989 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.319972    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71e5393a_88a0_4b82_9f4c_06421c623a80.slice/crio-d3ede73c5ced3d1f1713def09d3fd1e4e7bc530ed253049f33a96d2116224658 WatchSource:0}: Error finding container d3ede73c5ced3d1f1713def09d3fd1e4e7bc530ed253049f33a96d2116224658: Status 404 returned error can't find the container with id d3ede73c5ced3d1f1713def09d3fd1e4e7bc530ed253049f33a96d2116224658
Sep 08 01:59:04.325572 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.325553    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda237656e_58b9_4e62_b4ee_35d1163e84d9.slice/crio-eacc2b10c5c2e44132bf8fba93e65f068459344cdb3b190b9a99e48e87fb96b7 WatchSource:0}: Error finding container eacc2b10c5c2e44132bf8fba93e65f068459344cdb3b190b9a99e48e87fb96b7: Status 404 returned error can't find the container with id eacc2b10c5c2e44132bf8fba93e65f068459344cdb3b190b9a99e48e87fb96b7
Sep 08 01:59:04.341675 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.341656    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xfpkk"
Sep 08 01:59:04.350140 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.350122    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84a62f2e_5005_466f_baac_35def54984da.slice/crio-948449dcd60d98c9e67ad97d973ba78535c5d60ed6e04899d67495d04e5f9914 WatchSource:0}: Error finding container 948449dcd60d98c9e67ad97d973ba78535c5d60ed6e04899d67495d04e5f9914: Status 404 returned error can't find the container with id 948449dcd60d98c9e67ad97d973ba78535c5d60ed6e04899d67495d04e5f9914
Sep 08 01:59:04.361131 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.361111    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:04.370477 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.370457    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fbdf15_dfed_41b3_8589_4de4d76ba9d8.slice/crio-3018e27ca7a87564dbb60b5093e05f77b6cee4cc08e56dee0aa3a795a291d043 WatchSource:0}: Error finding container 3018e27ca7a87564dbb60b5093e05f77b6cee4cc08e56dee0aa3a795a291d043: Status 404 returned error can't find the container with id 3018e27ca7a87564dbb60b5093e05f77b6cee4cc08e56dee0aa3a795a291d043
Sep 08 01:59:04.375803 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.375788    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-89wxp"
Sep 08 01:59:04.382145 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.382119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dtxzg"
Sep 08 01:59:04.383717 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.383699    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cc0d11_8de8_4999_abda_a566c7e01ebc.slice/crio-62cb9300a7a67b3c85a17fad62d1f712cefa7e31869da50c024b3ca13b8e8df6 WatchSource:0}: Error finding container 62cb9300a7a67b3c85a17fad62d1f712cefa7e31869da50c024b3ca13b8e8df6: Status 404 returned error can't find the container with id 62cb9300a7a67b3c85a17fad62d1f712cefa7e31869da50c024b3ca13b8e8df6
Sep 08 01:59:04.391381 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:04.391359    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda29481b6_14dc_4758_86ac_8432c48f1a9e.slice/crio-e64ca5cc7e78a3e484f2687a80baa9fe2ed5e413874cfbf442ca42ba8a557c7d WatchSource:0}: Error finding container e64ca5cc7e78a3e484f2687a80baa9fe2ed5e413874cfbf442ca42ba8a557c7d: Status 404 returned error can't find the container with id e64ca5cc7e78a3e484f2687a80baa9fe2ed5e413874cfbf442ca42ba8a557c7d
Sep 08 01:59:04.421191 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.421169    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 01:59:04.444041 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.444019    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 01:59:04.554876 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.554797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:04.554876 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.554841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:04.555099 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.554935    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:04.555099 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.555002    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 01:59:05.554987165 +0000 UTC m=+3.010602057 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:04.555099 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.555003    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:04.555099 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.555028    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:04.555099 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.555041    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:04.555271 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.555106    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:05.555089463 +0000 UTC m=+3.010704356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:04.655915 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.655874    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:04.656126 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.656047    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:04.656126 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:04.656113    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 01:59:05.656092521 +0000 UTC m=+3.111707420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:04.854359 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.854086    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 01:59:04.984384 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.984314    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 01:54:04 +0000 UTC" deadline="2028-04-27 17:55:53.33955433 +0000 UTC"
Sep 08 01:59:04.984384 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:04.984382    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14343h56m48.355177501s"
Sep 08 01:59:05.066043 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.066011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:05.066218 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.066161    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:05.101098 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.101028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtxzg" event={"ID":"a29481b6-14dc-4758-86ac-8432c48f1a9e","Type":"ContainerStarted","Data":"e64ca5cc7e78a3e484f2687a80baa9fe2ed5e413874cfbf442ca42ba8a557c7d"}
Sep 08 01:59:05.119032 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.118954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89wxp" event={"ID":"d6cc0d11-8de8-4999-abda-a566c7e01ebc","Type":"ContainerStarted","Data":"62cb9300a7a67b3c85a17fad62d1f712cefa7e31869da50c024b3ca13b8e8df6"}
Sep 08 01:59:05.153988 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.153907    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerStarted","Data":"d3ede73c5ced3d1f1713def09d3fd1e4e7bc530ed253049f33a96d2116224658"}
Sep 08 01:59:05.171008 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.170966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-swc6x" event={"ID":"689f935b-6e31-4f84-9c72-a9334097564f","Type":"ContainerStarted","Data":"a622ebb3bc6a8be71fddce545d3a0f5f2c68797c5967ce79146a3536231c5a3f"}
Sep 08 01:59:05.178175 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.178143    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9" event={"ID":"bf02aa83-25f6-4f4c-9f65-ceafc66070cd","Type":"ContainerStarted","Data":"ff6aaacce0a5c6272e67b8a25fab439445fd329a6b4c3abb52b81e8785968273"}
Sep 08 01:59:05.210195 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.210160    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bglsd" event={"ID":"076a973d-56e0-43e1-8ccd-46dd0ee0422b","Type":"ContainerStarted","Data":"e206f81631074223584c46320a2b9a1ff517648db5240e48e7f05328c690b6b1"}
Sep 08 01:59:05.245879 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.245833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"3018e27ca7a87564dbb60b5093e05f77b6cee4cc08e56dee0aa3a795a291d043"}
Sep 08 01:59:05.257147 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.257109    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xfpkk" event={"ID":"84a62f2e-5005-466f-baac-35def54984da","Type":"ContainerStarted","Data":"948449dcd60d98c9e67ad97d973ba78535c5d60ed6e04899d67495d04e5f9914"}
Sep 08 01:59:05.268636 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.268595    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfdf4" event={"ID":"a237656e-58b9-4e62-b4ee-35d1163e84d9","Type":"ContainerStarted","Data":"eacc2b10c5c2e44132bf8fba93e65f068459344cdb3b190b9a99e48e87fb96b7"}
Sep 08 01:59:05.277663 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.277635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal" event={"ID":"f56ef06874a58adb59f017702cc18a23","Type":"ContainerStarted","Data":"6ea7c901cd520c06040fe1f06cb881c71cca4df5a2aea6e8341108fd1de5b005"}
Sep 08 01:59:05.284864 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.284796    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal" event={"ID":"578f76e9e3628a7f638f2eba0229db4a","Type":"ContainerStarted","Data":"42c218a6dac828115d92dd472bd3d00a42e073de99fcc32d516b392bb85a872f"}
Sep 08 01:59:05.564706 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.564622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:05.564909 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.564724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:05.564909 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.564879    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:05.564909 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.564897    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:05.565167 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.564943    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:05.565167 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.565005    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:07.564986536 +0000 UTC m=+5.020601449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:05.565167 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.565074    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:05.565167 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.565113    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 01:59:07.5650996 +0000 UTC m=+5.020714503 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:05.665743 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.665133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:05.665743 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.665286    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:05.665743 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:05.665370    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 01:59:07.665335908 +0000 UTC m=+5.120950818 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:05.985263 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.985159    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 01:54:04 +0000 UTC" deadline="2028-03-06 03:54:15.678402571 +0000 UTC"
Sep 08 01:59:05.985263 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:05.985201    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13081h55m9.693205615s"
Sep 08 01:59:06.064929 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:06.064238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:06.064929 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:06.064371    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:06.064929 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:06.064770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:06.064929 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:06.064865    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:07.066197 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:07.066166    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:07.066743 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.066316    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:07.581522 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:07.581486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:07.581712 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:07.581572    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:07.581776 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.581720    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:07.581776 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.581738    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:07.581776 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.581753    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:07.581945 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.581815    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:11.581796985 +0000 UTC m=+9.037411884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:07.582250 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.582228    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:07.582343 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.582285    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 01:59:11.58227036 +0000 UTC m=+9.037885265 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:07.682495 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:07.682441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:07.682654 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.682617    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:07.682729 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:07.682679    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 01:59:11.682660438 +0000 UTC m=+9.138275334 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:08.064681 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:08.064602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:08.064832 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:08.064730    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:08.065254 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:08.065227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:08.065440 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:08.065418    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:09.064475 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:09.064436    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:09.064927 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:09.064592    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:10.064126 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:10.064092    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:10.064286 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:10.064145    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:10.064415 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:10.064388    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:10.064492 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:10.064226    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:11.063895 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:11.063861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:11.064349 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.064019    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:11.622099 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:11.622066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:11.622242 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:11.622116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:11.622242 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.622237    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:11.622316 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.622241    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:11.622316 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.622265    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:11.622316 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.622278    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:11.622316 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.622286    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 01:59:19.622267426 +0000 UTC m=+17.077882317 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:11.622536 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.622327    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:19.622310789 +0000 UTC m=+17.077925693 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:11.722812 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:11.722743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:11.723025 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.722931    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:11.723025 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:11.723004    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 01:59:19.722983282 +0000 UTC m=+17.178598179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:12.064274 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:12.064244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:12.064884 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:12.064372    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:12.064884 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:12.064746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:12.064884 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:12.064843    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:13.064727 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:13.064603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:13.065189 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:13.064776    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:14.063943 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:14.063899    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:14.064114 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:14.064038    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:14.064114 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:14.064065    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:14.064298 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:14.064274    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:15.064555 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:15.064515    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:15.065012 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:15.064653    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:16.064250 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:16.064178    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:16.064419 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:16.064305    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:16.064419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:16.064358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:16.064512 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:16.064454    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:17.064098 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:17.064061    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:17.064579 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:17.064210    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:18.063748 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:18.063712    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:18.063748 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:18.063756    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:18.063951 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:18.063848    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:18.064014 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:18.063987    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:19.063807 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:19.063777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:19.064286 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.063922    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:19.681858 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:19.681771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:19.681858 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:19.681833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:19.682102 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.681956    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:19.682102 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.681977    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:19.682102 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.682003    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:19.682102 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.682013    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:19.682102 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.682020    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 01:59:35.682003068 +0000 UTC m=+33.137617964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:19.682102 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.682059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:35.682043023 +0000 UTC m=+33.137657935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:19.782196 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:19.782164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:19.782360 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.782336    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:19.782428 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:19.782416    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 01:59:35.782396186 +0000 UTC m=+33.238011096 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:20.063903 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:20.063868    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:20.064366 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:20.064012    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:20.064366 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:20.064068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:20.064366 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:20.064201    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:21.064630 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:21.064593    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:21.065111 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:21.064730    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:22.064393 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:22.064350    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:22.064579 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:22.064354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:22.064579 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:22.064494    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:22.064579 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:22.064560    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:23.064769 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:23.064733    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:23.065212 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:23.064842    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:24.064559 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.064531    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:24.064677 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.064529    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:24.064677 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:24.064624    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:24.064782 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:24.064732    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:24.340188 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.340148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dtxzg" event={"ID":"a29481b6-14dc-4758-86ac-8432c48f1a9e","Type":"ContainerStarted","Data":"ff1117ebc49c169b2166717312cfb92af5bee5bb533b79919f919c033fe8c4f2"}
Sep 08 01:59:24.341705 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.341649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-89wxp" event={"ID":"d6cc0d11-8de8-4999-abda-a566c7e01ebc","Type":"ContainerStarted","Data":"4338d18cbaa1b973664d02a7b1507fec3b3769bffddc3e73eb2221a34c6906f4"}
Sep 08 01:59:24.342974 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.342953    2562 generic.go:356] "Generic (PLEG): container finished" podID="71e5393a-88a0-4b82-9f4c-06421c623a80" containerID="639095ca9bf063f555430330dc8d51e5dd382505b91f66cf6dbe0868111f4f94" exitCode=0
Sep 08 01:59:24.343069 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.343022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerDied","Data":"639095ca9bf063f555430330dc8d51e5dd382505b91f66cf6dbe0868111f4f94"}
Sep 08 01:59:24.344630 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.344607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-swc6x" event={"ID":"689f935b-6e31-4f84-9c72-a9334097564f","Type":"ContainerStarted","Data":"ddec70a43c194fe6bbb1ea6687a432e6835e595493a74d698e681f5abd61aa88"}
Sep 08 01:59:24.346237 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.346220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9" event={"ID":"bf02aa83-25f6-4f4c-9f65-ceafc66070cd","Type":"ContainerStarted","Data":"0f1138cb7fa0711d04e3a9795e484345b9e2ff3932437e26118c956128868e9f"}
Sep 08 01:59:24.347582 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.347564    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bglsd" event={"ID":"076a973d-56e0-43e1-8ccd-46dd0ee0422b","Type":"ContainerStarted","Data":"36c493dc3c199cb45351576522584e31765bded30bee1599b95a60d81de6d3e4"}
Sep 08 01:59:24.350286 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350270    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 01:59:24.350626 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350608    2562 generic.go:356] "Generic (PLEG): container finished" podID="96fbdf15-dfed-41b3-8589-4de4d76ba9d8" containerID="eae946213dab73beff7ca9d35a2f20e66d5f09a8010fae5269f9b802a8eb48fa" exitCode=1
Sep 08 01:59:24.350695 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350667    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"4f75bef98032a48f517bfe369a2a96fb81a9c322ed1a748e8e5b3b8a01ac5463"}
Sep 08 01:59:24.350738 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350723    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"25f6e6794f287ddd2a1205c25b69d188025509492563da62442b1def67d0a9cc"}
Sep 08 01:59:24.350779 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"a504d373bb95b8a171cb4f3e735ac749c5939c5d2add8a3dadea45d641e56bb8"}
Sep 08 01:59:24.350818 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350806    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"d571e531152f7ae4014f937b4cf34bf9efffe489e544f43f340feb327f837d02"}
Sep 08 01:59:24.350857 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerDied","Data":"eae946213dab73beff7ca9d35a2f20e66d5f09a8010fae5269f9b802a8eb48fa"}
Sep 08 01:59:24.350896 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.350883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"cebd96c005880258f1b9a2ef2ccb8bffcd0b0283147b37cf41ab65eaae269403"}
Sep 08 01:59:24.352031 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.352013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wfdf4" event={"ID":"a237656e-58b9-4e62-b4ee-35d1163e84d9","Type":"ContainerStarted","Data":"ff12ee2c2a1e842df86725de2f7f58023d33d6df0498e8ad9de445f5cbc62953"}
Sep 08 01:59:24.353345 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.353328    2562 generic.go:356] "Generic (PLEG): container finished" podID="f56ef06874a58adb59f017702cc18a23" containerID="83d6b8ddebc4f5f29e24a18ab31c077ee71d1aade144644e32962acf603bb198" exitCode=0
Sep 08 01:59:24.353423 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.353385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal" event={"ID":"f56ef06874a58adb59f017702cc18a23","Type":"ContainerDied","Data":"83d6b8ddebc4f5f29e24a18ab31c077ee71d1aade144644e32962acf603bb198"}
Sep 08 01:59:24.354626 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.354600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal" event={"ID":"578f76e9e3628a7f638f2eba0229db4a","Type":"ContainerStarted","Data":"24e0322636b51978eb047d9e2c7b39fe7a477687161bbd944596b0568a088e24"}
Sep 08 01:59:24.355079 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.355045    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dtxzg" podStartSLOduration=6.401632456 podStartE2EDuration="21.355033483s" totalImagesPullingTime="14.953401027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:24.354688535 +0000 UTC m=+21.810303468" watchObservedRunningTime="2026-09-08 01:59:24.355033483 +0000 UTC m=+21.810648435"
Sep 08 01:59:24.375334 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.375288    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-169.ec2.internal" podStartSLOduration=20.375275209 podStartE2EDuration="20.375275209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:24.374358841 +0000 UTC m=+21.829973754" watchObservedRunningTime="2026-09-08 01:59:24.375275209 +0000 UTC m=+21.830890122"
Sep 08 01:59:24.395701 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.395650    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bglsd" podStartSLOduration=2.378716593 podStartE2EDuration="21.395636721s" totalImagesPullingTime="19.016920128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:24.395173808 +0000 UTC m=+21.850788740" watchObservedRunningTime="2026-09-08 01:59:24.395636721 +0000 UTC m=+21.851251633"
Sep 08 01:59:24.419884 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.419856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:24.423603 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.423566    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-swc6x" podStartSLOduration=2.432282635 podStartE2EDuration="21.423553695s" totalImagesPullingTime="18.99127106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:24.408270496 +0000 UTC m=+21.863885408" watchObservedRunningTime="2026-09-08 01:59:24.423553695 +0000 UTC m=+21.879168589"
Sep 08 01:59:24.423741 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.423722    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wfdf4" podStartSLOduration=2.211933821 podStartE2EDuration="21.423717633s" totalImagesPullingTime="19.211783812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:24.423677798 +0000 UTC m=+21.879292701" watchObservedRunningTime="2026-09-08 01:59:24.423717633 +0000 UTC m=+21.879332546"
Sep 08 01:59:24.459076 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.459037    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-89wxp" podStartSLOduration=2.549895682 podStartE2EDuration="21.459024285s" totalImagesPullingTime="18.909128603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:24.458711025 +0000 UTC m=+21.914325939" watchObservedRunningTime="2026-09-08 01:59:24.459024285 +0000 UTC m=+21.914639198"
Sep 08 01:59:24.492069 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.492039    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:24.492583 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.492564    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:24.540240 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.540215    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:24.602999 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.602894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:24.656843 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.656791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:24.748061 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.748031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:24.810463 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:24.810428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:25.060961 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.060937    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 01:59:25.064289 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.064271    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:25.064391 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:25.064374    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:25.358202 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.358165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9" event={"ID":"bf02aa83-25f6-4f4c-9f65-ceafc66070cd","Type":"ContainerStarted","Data":"2265f62428c1d1470dbe0fbe82e102c9d75359bfb28d2adc6c3b19d1d1c8b6a2"}
Sep 08 01:59:25.359584 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.359543    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xfpkk" event={"ID":"84a62f2e-5005-466f-baac-35def54984da","Type":"ContainerStarted","Data":"4563fd9d936c683e6d7bf878cb7468640aa6efe9cc7c2236b6bf450808b2eaa7"}
Sep 08 01:59:25.359876 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.359851    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:25.360763 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.360439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bglsd"
Sep 08 01:59:25.373259 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.373222    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xfpkk" podStartSLOduration=3.430942559 podStartE2EDuration="22.373209272s" totalImagesPullingTime="18.942266713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:25.372749312 +0000 UTC m=+22.828364225" watchObservedRunningTime="2026-09-08 01:59:25.373209272 +0000 UTC m=+22.828824184"
Sep 08 01:59:25.447617 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.447589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:25.550661 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.550626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:25.651978 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.651853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:25.705465 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:25.705428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:26.011436 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.011285    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T01:59:25.060956373Z","UUID":"445fba31-308d-4d7b-90e2-c38b5246427b","Handler":null,"Name":"","Endpoint":""}
Sep 08 01:59:26.012402 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.012376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:26.013422 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.013405    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 01:59:26.013511 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.013433    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 01:59:26.064389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.064357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:26.064518 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.064390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:26.064518 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:26.064481    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:26.064619 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:26.064591    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:26.069863 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.069830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:26.364950 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.364852    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9" event={"ID":"bf02aa83-25f6-4f4c-9f65-ceafc66070cd","Type":"ContainerStarted","Data":"7658ef592c26f12992115c1458f298e5bd25bcb7f9e4d9563d41513270c1fa8b"}
Sep 08 01:59:26.368878 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.368857    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 01:59:26.369348 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.369319    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"2b150fa899807d2e4370717ab766d1d245e036155986c0aadc281421206b3e9a"}
Sep 08 01:59:26.371622 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.371585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal" event={"ID":"f56ef06874a58adb59f017702cc18a23","Type":"ContainerStarted","Data":"37e5e632f4751b9f3b2f306f4e43d538062235031c6561e9110bb8994a1cbef8"}
Sep 08 01:59:26.381803 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.381760    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bj2z9" podStartSLOduration=2.425186595 podStartE2EDuration="23.381744575s" totalImagesPullingTime="20.95655798s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:26.381464758 +0000 UTC m=+23.837079664" watchObservedRunningTime="2026-09-08 01:59:26.381744575 +0000 UTC m=+23.837359488"
Sep 08 01:59:26.395577 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.395529    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-169.ec2.internal" podStartSLOduration=22.395516613 podStartE2EDuration="22.395516613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:26.39498055 +0000 UTC m=+23.850595476" watchObservedRunningTime="2026-09-08 01:59:26.395516613 +0000 UTC m=+23.851131525"
Sep 08 01:59:26.953221 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:26.953185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:27.064051 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:27.064018    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:27.064225 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:27.064148    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:27.289634 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:27.289605    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-swc6x_689f935b-6e31-4f84-9c72-a9334097564f/dns-node-resolver/0.log"
Sep 08 01:59:27.657001 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:27.656897    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:27.761201 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:27.761157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:27.889449 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:27.889419    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtxzg_a29481b6-14dc-4758-86ac-8432c48f1a9e/node-ca/0.log"
Sep 08 01:59:28.064255 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:28.064217    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:28.064419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:28.064268    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:28.064419 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:28.064358    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:28.064534 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:28.064493    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:29.064432 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.064246    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:29.064749 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:29.064553    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:29.161320 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.161294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:29.217588 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.217561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:29.383353 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.383262    2562 generic.go:356] "Generic (PLEG): container finished" podID="71e5393a-88a0-4b82-9f4c-06421c623a80" containerID="2056c94357febb4ef7154f91b8f3dbd9ae4f1531a4c98518a1258ed4835cfba8" exitCode=0
Sep 08 01:59:29.383511 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.383353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerDied","Data":"2056c94357febb4ef7154f91b8f3dbd9ae4f1531a4c98518a1258ed4835cfba8"}
Sep 08 01:59:29.386994 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.386976    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 01:59:29.387372 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.387353    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"728c4a6eb3689f635ecb263f7665a58155dc2e4f6943fb9b298b025b8ad5f416"}
Sep 08 01:59:29.387555 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.387537    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:29.387624 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.387612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:29.387766 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.387753    2562 scope.go:117] "RemoveContainer" containerID="eae946213dab73beff7ca9d35a2f20e66d5f09a8010fae5269f9b802a8eb48fa"
Sep 08 01:59:29.402673 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:29.402656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:30.063982 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.063959    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:30.064069 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.063983    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:30.064069 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:30.064053    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:30.064173 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:30.064156    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:30.242777 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.242749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:30.367059 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.367025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:30.391234 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.391208    2562 generic.go:356] "Generic (PLEG): container finished" podID="71e5393a-88a0-4b82-9f4c-06421c623a80" containerID="388c744d9dfe6c4103748d0c4b34490b70ad89309fe993ee629e994c81dd50d5" exitCode=0
Sep 08 01:59:30.391357 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.391292    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerDied","Data":"388c744d9dfe6c4103748d0c4b34490b70ad89309fe993ee629e994c81dd50d5"}
Sep 08 01:59:30.395214 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.395198    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 01:59:30.395603 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.395580    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" event={"ID":"96fbdf15-dfed-41b3-8589-4de4d76ba9d8","Type":"ContainerStarted","Data":"9e07992b9762f1bb33a77b4637ed38adaa03d2f6c89cbb1f6cb2f8cb0dd0d8f7"}
Sep 08 01:59:30.395897 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.395882    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:30.410693 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.410673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 01:59:30.465556 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.465517    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6" podStartSLOduration=8.506159062 podStartE2EDuration="27.465504653s" totalImagesPullingTime="18.959345591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:30.465173619 +0000 UTC m=+27.920788537" watchObservedRunningTime="2026-09-08 01:59:30.465504653 +0000 UTC m=+27.921119559"
Sep 08 01:59:30.632752 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.632665    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:30.733953 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.733906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:30.833416 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.833387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:30.933234 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.933157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:30.984149 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:30.984123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:31.064422 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:31.064394    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:31.064562 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:31.064536    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:31.400199 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:31.400170    2562 generic.go:356] "Generic (PLEG): container finished" podID="71e5393a-88a0-4b82-9f4c-06421c623a80" containerID="3a7c19ecf4e207352818632434fd0ebe783e1535abe0aa7a32092db00b5256ba" exitCode=0
Sep 08 01:59:31.400603 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:31.400255    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerDied","Data":"3a7c19ecf4e207352818632434fd0ebe783e1535abe0aa7a32092db00b5256ba"}
Sep 08 01:59:31.733303 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:31.733269    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:32.063855 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:32.063825    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:32.063855 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:32.063844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:32.064075 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:32.063971    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:32.064139 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:32.064082    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:32.336534 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:32.336434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:32.539794 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:32.539749    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:32.769044 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:32.768969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:33.065359 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:33.065325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:33.065509 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:33.065453    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:33.136860 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:33.136820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:33.547354 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:33.547319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:33.924450 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:33.924374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:33.975222 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:33.975188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:34.064539 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.064505    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:34.064711 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.064506    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:34.064711 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:34.064619    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:34.064842 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:34.064706    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:34.335888 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.335848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:34.538766 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.538724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:34.735091 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.735016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:34.785271 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.785231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:34.993935 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:34.993843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:35.064313 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:35.064278    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:35.064486 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.064414    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:35.094713 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:35.094672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:35.710703 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:35.710631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:35.710703 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:35.710675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:35.710937 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.710787    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:35.710937 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.710844    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs podName:478998cf-9541-4e4d-99af-b5768b9a387d nodeName:}" failed. No retries permitted until 2026-09-08 02:00:07.710828131 +0000 UTC m=+65.166443037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs") pod "network-metrics-daemon-f8rjv" (UID: "478998cf-9541-4e4d-99af-b5768b9a387d") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 01:59:35.710937 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.710789    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 01:59:35.710937 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.710885    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 01:59:35.710937 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.710895    2562 projected.go:196] Error preparing data for projected volume kube-api-access-vxtbn for pod openshift-network-diagnostics/network-check-target-bd4nc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:35.711179 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.710955    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn podName:be4a2d28-d4fe-4193-af2b-04d6c1868a52 nodeName:}" failed. No retries permitted until 2026-09-08 02:00:07.710942199 +0000 UTC m=+65.166557090 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vxtbn" (UniqueName: "kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn") pod "network-check-target-bd4nc" (UID: "be4a2d28-d4fe-4193-af2b-04d6c1868a52") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 01:59:35.811441 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:35.811410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:35.811823 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.811546    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:35.811823 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:35.811599    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret podName:81de7c44-fc49-4e80-bdf7-7006f275207c nodeName:}" failed. No retries permitted until 2026-09-08 02:00:07.811582319 +0000 UTC m=+65.267197227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret") pod "global-pull-secret-syncer-m4v75" (UID: "81de7c44-fc49-4e80-bdf7-7006f275207c") : object "kube-system"/"original-pull-secret" not registered
Sep 08 01:59:36.036153 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.036124    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:36.064351 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.064328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:36.064351 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.064347    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:36.064455 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:36.064435    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:36.064566 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:36.064548    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:36.136244 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.136217    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:36.335055 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.334987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:36.413923 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.413873    2562 generic.go:356] "Generic (PLEG): container finished" podID="71e5393a-88a0-4b82-9f4c-06421c623a80" containerID="9333ebd9f4628d70530e2a42b4dbe395b9af0a642ac4593df7b549de73b1e4e8" exitCode=0
Sep 08 01:59:36.414123 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.413926    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerDied","Data":"9333ebd9f4628d70530e2a42b4dbe395b9af0a642ac4593df7b549de73b1e4e8"}
Sep 08 01:59:36.534552 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.534527    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:36.736261 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.736188    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:36.936217 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:36.936190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:37.064532 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:37.064498    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:37.064714 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:37.064631    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:37.418899 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:37.418817    2562 generic.go:356] "Generic (PLEG): container finished" podID="71e5393a-88a0-4b82-9f4c-06421c623a80" containerID="a77ceb4727ba859c7415f30f15f21e3470fe1f578c9989d8eeab2824889e6d6b" exitCode=0
Sep 08 01:59:37.418899 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:37.418865    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerDied","Data":"a77ceb4727ba859c7415f30f15f21e3470fe1f578c9989d8eeab2824889e6d6b"}
Sep 08 01:59:37.936750 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:37.936570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:38.064029 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.064001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:38.064171 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.064001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:38.064171 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:38.064090    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:38.064281 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:38.064168    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:38.341029 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.341000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:38.424053 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.424019    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-czrbk" event={"ID":"71e5393a-88a0-4b82-9f4c-06421c623a80","Type":"ContainerStarted","Data":"24c4d205be98a2a006748dfcdd9c71c083f0ba65805522c650cd64b9ff39313f"}
Sep 08 01:59:38.444252 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.444215    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-czrbk" podStartSLOduration=6.485094922 podStartE2EDuration="35.444201783s" totalImagesPullingTime="28.959106861s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:38.443017266 +0000 UTC m=+35.898632191" watchObservedRunningTime="2026-09-08 01:59:38.444201783 +0000 UTC m=+35.899816695"
Sep 08 01:59:38.539860 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.539820    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:38.733972 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:38.733893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:39.064093 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:39.064066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:39.064508 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:39.064191    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:39.138008 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:39.137977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:39.936281 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:39.936212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:40.063811 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.063779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:40.064004 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:40.063877    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:40.064004 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.063931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:40.064090 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:40.064029    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:40.334948 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.334901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:40.542544 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.542499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:40.753348 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.753263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:40.888173 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.888132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:40.943419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:40.943390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.002821 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.002792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.064315 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.064289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:41.064448 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:41.064411    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:41.395369 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.395292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.570491 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.570449    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.620685 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.620655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.771274 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.771202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.874044 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.874014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:41.973281 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:41.973253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:42.064125 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:42.064094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:42.064291 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:42.064197    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:42.064291 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:42.064244    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:42.064360 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:42.064332    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:42.375725 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:42.375635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:42.579845 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:42.579813    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:42.680387 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:42.680320    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:43.064516 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:43.064491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:43.064671 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:43.064572    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:43.587426 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:43.587399    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:43.635109 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:43.635080    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:44.063995 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:44.063966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:44.064171 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:44.063965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:44.064171 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:44.064083    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:44.064171 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:44.064126    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:45.064215 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:45.064188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:45.064556 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:45.064292    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:45.653380 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:45.653324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:45.753388 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:45.753355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:45.844036 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:45.844003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:45.941857 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:45.941782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:46.043558 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.043526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:46.064372 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.064337    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:46.065490 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:46.064469    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:46.065490 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.064551    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:46.065490 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:46.064749    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:46.747043 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.747011    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m4v75"]
Sep 08 01:59:46.747207 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.747124    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:46.747262 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:46.747238    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:46.750112 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.750086    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f8rjv"]
Sep 08 01:59:46.750423 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.750403    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:46.750544 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:46.750527    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:46.750846 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.750823    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bd4nc"]
Sep 08 01:59:46.750970 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:46.750907    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:46.751045 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:46.751024    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:48.063977 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:48.063946    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:48.064466 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:48.064058    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:48.315488 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:48.315377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:48.415362 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:48.415333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:49.066889 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:49.066858    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:49.067320 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:49.066961    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:49.067320 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:49.066970    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:49.067320 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:49.067069    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:49.936499 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:49.936435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:50.036561 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:50.036529    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:50.064218 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:50.064192    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:50.064309 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:50.064293    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f8rjv" podUID="478998cf-9541-4e4d-99af-b5768b9a387d"
Sep 08 01:59:51.063652 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.063497    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:51.064036 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.063571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:51.064036 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:51.063783    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-m4v75" podUID="81de7c44-fc49-4e80-bdf7-7006f275207c"
Sep 08 01:59:51.064036 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:51.063824    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-bd4nc" podUID="be4a2d28-d4fe-4193-af2b-04d6c1868a52"
Sep 08 01:59:51.345021 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.344942    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-169.ec2.internal" event="NodeReady"
Sep 08 01:59:51.345185 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.345067    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 01:59:51.414884 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.414850    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fbcq5"]
Sep 08 01:59:51.435848 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.435813    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w2zl9"]
Sep 08 01:59:51.436014 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.435951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.438528 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.438499    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 01:59:51.438789 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.438762    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 01:59:51.438900 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.438883    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 01:59:51.438992 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.438883    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xc9ld\""
Sep 08 01:59:51.438992 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.438909    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 01:59:51.451839 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.451811    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbcq5"]
Sep 08 01:59:51.451991 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.451859    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2zl9"]
Sep 08 01:59:51.451991 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.451927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.456140 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.456107    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 01:59:51.456265 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.456156    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 01:59:51.456324 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.456272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6zllf\""
Sep 08 01:59:51.511847 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.511810    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fb2vg"]
Sep 08 01:59:51.515587 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.515550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:51.529185 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4424d2a4-36b2-4cb0-b11d-d045ba315048-tmp-dir\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.529309 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529197    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e3bf649-b208-419c-94a1-63c780dd8dab-crio-socket\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.529309 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp46w\" (UniqueName: \"kubernetes.io/projected/4424d2a4-36b2-4cb0-b11d-d045ba315048-kube-api-access-rp46w\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.529309 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e3bf649-b208-419c-94a1-63c780dd8dab-data-volume\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.529425 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e3bf649-b208-419c-94a1-63c780dd8dab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.529425 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhfrz\" (UniqueName: \"kubernetes.io/projected/6e3bf649-b208-419c-94a1-63c780dd8dab-kube-api-access-nhfrz\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.529425 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e3bf649-b208-419c-94a1-63c780dd8dab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.529425 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4424d2a4-36b2-4cb0-b11d-d045ba315048-config-volume\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.529425 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.529401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4424d2a4-36b2-4cb0-b11d-d045ba315048-metrics-tls\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.534248 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.534224    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fb2vg"]
Sep 08 01:59:51.534349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.534335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.537185 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.537163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 01:59:51.537268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.537196    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 01:59:51.537268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.537163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-r5fzh\""
Sep 08 01:59:51.537268 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.537211    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 01:59:51.578578 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.578548    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:51.629809 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629733    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4424d2a4-36b2-4cb0-b11d-d045ba315048-tmp-dir\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.629809 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a8ad92c-d83c-40c3-9956-5ab6b508ad53-cert\") pod \"ingress-canary-fb2vg\" (UID: \"4a8ad92c-d83c-40c3-9956-5ab6b508ad53\") " pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.629809 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e3bf649-b208-419c-94a1-63c780dd8dab-crio-socket\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630053 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp46w\" (UniqueName: \"kubernetes.io/projected/4424d2a4-36b2-4cb0-b11d-d045ba315048-kube-api-access-rp46w\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.630053 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e3bf649-b208-419c-94a1-63c780dd8dab-data-volume\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630053 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e3bf649-b208-419c-94a1-63c780dd8dab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630053 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.629976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhfrz\" (UniqueName: \"kubernetes.io/projected/6e3bf649-b208-419c-94a1-63c780dd8dab-kube-api-access-nhfrz\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630256 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6e3bf649-b208-419c-94a1-63c780dd8dab-crio-socket\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630256 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e3bf649-b208-419c-94a1-63c780dd8dab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630256 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630186    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4424d2a4-36b2-4cb0-b11d-d045ba315048-config-volume\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.630256 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csm9j\" (UniqueName: \"kubernetes.io/projected/4a8ad92c-d83c-40c3-9956-5ab6b508ad53-kube-api-access-csm9j\") pod \"ingress-canary-fb2vg\" (UID: \"4a8ad92c-d83c-40c3-9956-5ab6b508ad53\") " pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.630256 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4424d2a4-36b2-4cb0-b11d-d045ba315048-metrics-tls\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.630534 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4424d2a4-36b2-4cb0-b11d-d045ba315048-tmp-dir\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.630534 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6e3bf649-b208-419c-94a1-63c780dd8dab-data-volume\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630670 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6e3bf649-b208-419c-94a1-63c780dd8dab-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.630849 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.630832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4424d2a4-36b2-4cb0-b11d-d045ba315048-config-volume\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.633813 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.633793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4424d2a4-36b2-4cb0-b11d-d045ba315048-metrics-tls\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.633900 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.633836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6e3bf649-b208-419c-94a1-63c780dd8dab-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.637490 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.637470    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhfrz\" (UniqueName: \"kubernetes.io/projected/6e3bf649-b208-419c-94a1-63c780dd8dab-kube-api-access-nhfrz\") pod \"insights-runtime-extractor-fbcq5\" (UID: \"6e3bf649-b208-419c-94a1-63c780dd8dab\") " pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.637629 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.637608    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp46w\" (UniqueName: \"kubernetes.io/projected/4424d2a4-36b2-4cb0-b11d-d045ba315048-kube-api-access-rp46w\") pod \"dns-default-w2zl9\" (UID: \"4424d2a4-36b2-4cb0-b11d-d045ba315048\") " pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.655384 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.655358    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"]
Sep 08 01:59:51.658455 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.658436    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:51.696273 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.696244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"]
Sep 08 01:59:51.696402 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.696322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:51.698698 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.698680    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 01:59:51.699001 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.698985    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jcr8r\""
Sep 08 01:59:51.730581 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.730560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a8ad92c-d83c-40c3-9956-5ab6b508ad53-cert\") pod \"ingress-canary-fb2vg\" (UID: \"4a8ad92c-d83c-40c3-9956-5ab6b508ad53\") " pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.730658 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.730608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csm9j\" (UniqueName: \"kubernetes.io/projected/4a8ad92c-d83c-40c3-9956-5ab6b508ad53-kube-api-access-csm9j\") pod \"ingress-canary-fb2vg\" (UID: \"4a8ad92c-d83c-40c3-9956-5ab6b508ad53\") " pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.730658 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.730644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ecce13b-13d1-444d-a1c2-1efebb93051a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kkslp\" (UID: \"7ecce13b-13d1-444d-a1c2-1efebb93051a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:51.732762 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.732738    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a8ad92c-d83c-40c3-9956-5ab6b508ad53-cert\") pod \"ingress-canary-fb2vg\" (UID: \"4a8ad92c-d83c-40c3-9956-5ab6b508ad53\") " pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.737693 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.737667    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csm9j\" (UniqueName: \"kubernetes.io/projected/4a8ad92c-d83c-40c3-9956-5ab6b508ad53-kube-api-access-csm9j\") pod \"ingress-canary-fb2vg\" (UID: \"4a8ad92c-d83c-40c3-9956-5ab6b508ad53\") " pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.745503 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.745484    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fbcq5"
Sep 08 01:59:51.762780 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.762758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:51.831464 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.831288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ecce13b-13d1-444d-a1c2-1efebb93051a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kkslp\" (UID: \"7ecce13b-13d1-444d-a1c2-1efebb93051a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:51.831532 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:51.831497    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 01:59:51.831580 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:51.831568    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ecce13b-13d1-444d-a1c2-1efebb93051a-tls-certificates podName:7ecce13b-13d1-444d-a1c2-1efebb93051a nodeName:}" failed. No retries permitted until 2026-09-08 01:59:52.331548472 +0000 UTC m=+49.787163385 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/7ecce13b-13d1-444d-a1c2-1efebb93051a-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-kkslp" (UID: "7ecce13b-13d1-444d-a1c2-1efebb93051a") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 01:59:51.843277 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.843163    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fb2vg"
Sep 08 01:59:51.862740 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.862713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:51.963611 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:51.963580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:52.054540 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.054480    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w2zl9"]
Sep 08 01:59:52.055168 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.055149    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fbcq5"]
Sep 08 01:59:52.059031 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:52.059006    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4424d2a4_36b2_4cb0_b11d_d045ba315048.slice/crio-34b698e782105300108a2cb75c36f5239ad3d5f7a318bcb01994a93b4a0416d3 WatchSource:0}: Error finding container 34b698e782105300108a2cb75c36f5239ad3d5f7a318bcb01994a93b4a0416d3: Status 404 returned error can't find the container with id 34b698e782105300108a2cb75c36f5239ad3d5f7a318bcb01994a93b4a0416d3
Sep 08 01:59:52.059706 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:52.059684    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e3bf649_b208_419c_94a1_63c780dd8dab.slice/crio-c5e7eb92303215316da3bb6746bec62554cfedd841deb992fbdf0457ae4b6a8c WatchSource:0}: Error finding container c5e7eb92303215316da3bb6746bec62554cfedd841deb992fbdf0457ae4b6a8c: Status 404 returned error can't find the container with id c5e7eb92303215316da3bb6746bec62554cfedd841deb992fbdf0457ae4b6a8c
Sep 08 01:59:52.061177 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.061156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:52.064308 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.064292    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 01:59:52.066683 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.066666    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 01:59:52.066769 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.066754    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s2v8c\""
Sep 08 01:59:52.115236 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.115209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:52.129781 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.129761    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fb2vg"]
Sep 08 01:59:52.136812 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:52.136788    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a8ad92c_d83c_40c3_9956_5ab6b508ad53.slice/crio-0c558b32da2f454f74827d2de88afe215ad4dd50bd628bba599b8f6f74f296e7 WatchSource:0}: Error finding container 0c558b32da2f454f74827d2de88afe215ad4dd50bd628bba599b8f6f74f296e7: Status 404 returned error can't find the container with id 0c558b32da2f454f74827d2de88afe215ad4dd50bd628bba599b8f6f74f296e7
Sep 08 01:59:52.335340 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.335305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ecce13b-13d1-444d-a1c2-1efebb93051a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kkslp\" (UID: \"7ecce13b-13d1-444d-a1c2-1efebb93051a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:52.337808 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.337788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7ecce13b-13d1-444d-a1c2-1efebb93051a-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-kkslp\" (UID: \"7ecce13b-13d1-444d-a1c2-1efebb93051a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:52.456991 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.456893    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fb2vg" event={"ID":"4a8ad92c-d83c-40c3-9956-5ab6b508ad53","Type":"ContainerStarted","Data":"0c558b32da2f454f74827d2de88afe215ad4dd50bd628bba599b8f6f74f296e7"}
Sep 08 01:59:52.458034 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.458012    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2zl9" event={"ID":"4424d2a4-36b2-4cb0-b11d-d045ba315048","Type":"ContainerStarted","Data":"34b698e782105300108a2cb75c36f5239ad3d5f7a318bcb01994a93b4a0416d3"}
Sep 08 01:59:52.459347 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.459328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbcq5" event={"ID":"6e3bf649-b208-419c-94a1-63c780dd8dab","Type":"ContainerStarted","Data":"a17ae4e1ebfaa9df3b58a025254fe2f9c419c28aff442c7ed17e9329b35d7cb6"}
Sep 08 01:59:52.459418 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.459370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbcq5" event={"ID":"6e3bf649-b208-419c-94a1-63c780dd8dab","Type":"ContainerStarted","Data":"c5e7eb92303215316da3bb6746bec62554cfedd841deb992fbdf0457ae4b6a8c"}
Sep 08 01:59:52.605276 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.605238    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:52.891747 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:52.891491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"]
Sep 08 01:59:52.962605 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:52.962574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ecce13b_13d1_444d_a1c2_1efebb93051a.slice/crio-d13f996cd04c52c3ee432ec8b202d6bd73bf826ca113c18bcb20b00df70ca365 WatchSource:0}: Error finding container d13f996cd04c52c3ee432ec8b202d6bd73bf826ca113c18bcb20b00df70ca365: Status 404 returned error can't find the container with id d13f996cd04c52c3ee432ec8b202d6bd73bf826ca113c18bcb20b00df70ca365
Sep 08 01:59:53.067265 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.067228    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 01:59:53.068164 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.068141    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 01:59:53.070730 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.070704    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxnlh\""
Sep 08 01:59:53.072125 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.071726    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 01:59:53.072125 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.071867    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 01:59:53.072125 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.071987    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 01:59:53.465400 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.465330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp" event={"ID":"7ecce13b-13d1-444d-a1c2-1efebb93051a","Type":"ContainerStarted","Data":"d13f996cd04c52c3ee432ec8b202d6bd73bf826ca113c18bcb20b00df70ca365"}
Sep 08 01:59:53.467416 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.467384    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbcq5" event={"ID":"6e3bf649-b208-419c-94a1-63c780dd8dab","Type":"ContainerStarted","Data":"939eadd3694e8905e217f5e5de2a13334531b5b33e3e725bcf5306bb19b7f432"}
Sep 08 01:59:53.589691 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.589566    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:53.643030 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:53.642987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:55.478281 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.478023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp" event={"ID":"7ecce13b-13d1-444d-a1c2-1efebb93051a","Type":"ContainerStarted","Data":"39196dce0fc0d7d595dbcad1c3705118970ac9ce3fa92dcc41544b5aa41e544c"}
Sep 08 01:59:55.478893 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.478431    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:55.485419 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.485362    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2zl9" event={"ID":"4424d2a4-36b2-4cb0-b11d-d045ba315048","Type":"ContainerStarted","Data":"a81edb07c7f25bd96005e55499605603e6a1a22f87c3e0bad390609e5d42c544"}
Sep 08 01:59:55.488472 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.488439    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp"
Sep 08 01:59:55.489571 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.489548    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fbcq5" event={"ID":"6e3bf649-b208-419c-94a1-63c780dd8dab","Type":"ContainerStarted","Data":"462174f9a5621f8283b711045d42284a53e990dc44c1eb21655fc29cd082c49f"}
Sep 08 01:59:55.494291 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.494120    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-kkslp" podStartSLOduration=2.1402013699999998 podStartE2EDuration="4.494103458s" totalImagesPullingTime="2.353902088s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:55.494086712 +0000 UTC m=+52.949701647" watchObservedRunningTime="2026-09-08 01:59:55.494103458 +0000 UTC m=+52.949718369"
Sep 08 01:59:55.496451 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.496411    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fb2vg" event={"ID":"4a8ad92c-d83c-40c3-9956-5ab6b508ad53","Type":"ContainerStarted","Data":"25f8b361a6d179b14df718a0a0a1acca55384c605ddebf86b2c7411e57c00bec"}
Sep 08 01:59:55.512321 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.512274    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fbcq5" podStartSLOduration=1.470768728 podStartE2EDuration="4.512257843s" totalImagesPullingTime="3.041489115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:55.510761273 +0000 UTC m=+52.966376187" watchObservedRunningTime="2026-09-08 01:59:55.512257843 +0000 UTC m=+52.967872757"
Sep 08 01:59:55.544071 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.544020    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fb2vg" podStartSLOduration=1.363686782 podStartE2EDuration="4.544005785s" totalImagesPullingTime="3.180319003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:55.543264666 +0000 UTC m=+52.998879597" watchObservedRunningTime="2026-09-08 01:59:55.544005785 +0000 UTC m=+52.999620697"
Sep 08 01:59:55.679091 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.679004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:55.713563 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.713539    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-6vslf"]
Sep 08 01:59:55.715454 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.715439    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.717970 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.717943    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 01:59:55.717970 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.717972    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 01:59:55.718145 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.718095    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 01:59:55.718205 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.718186    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 01:59:55.718298 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.718285    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 01:59:55.718389 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.718377    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-m6m92\""
Sep 08 01:59:55.725096 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.725076    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-6vslf"]
Sep 08 01:59:55.743132 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.743107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:55.762262 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.762241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.762321 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.762275    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.762321 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.762293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cft5\" (UniqueName: \"kubernetes.io/projected/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-kube-api-access-9cft5\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.762385 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.762338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.863524 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.863483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.863631 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.863563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.863631 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.863601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.863631 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.863618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cft5\" (UniqueName: \"kubernetes.io/projected/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-kube-api-access-9cft5\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.863721 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:55.863706    2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 01:59:55.863781 ip-10-0-131-169 kubenswrapper[2562]: E0908 01:59:55.863770    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-tls podName:915506d2-c6a8-4b4e-8c33-3eea19ed1bf9 nodeName:}" failed. No retries permitted until 2026-09-08 01:59:56.363750873 +0000 UTC m=+53.819365766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-6vslf" (UID: "915506d2-c6a8-4b4e-8c33-3eea19ed1bf9") : secret "prometheus-operator-tls" not found
Sep 08 01:59:55.864370 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.864349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.867840 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.867816    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:55.872289 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:55.872270    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cft5\" (UniqueName: \"kubernetes.io/projected/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-kube-api-access-9cft5\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:56.367610 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.367583    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:56.369845 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.369825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/915506d2-c6a8-4b4e-8c33-3eea19ed1bf9-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-6vslf\" (UID: \"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:56.405976 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.405953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:56.501349 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.501317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w2zl9" event={"ID":"4424d2a4-36b2-4cb0-b11d-d045ba315048","Type":"ContainerStarted","Data":"ce86ed9aaf027b20497a7e0583978ea39af642d7219b2ad8e591fce743f9c1bd"}
Sep 08 01:59:56.501896 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.501413    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w2zl9"
Sep 08 01:59:56.516898 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.516853    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w2zl9" podStartSLOduration=2.259056555 podStartE2EDuration="5.516840306s" totalImagesPullingTime="3.257783751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:56.516791532 +0000 UTC m=+53.972406464" watchObservedRunningTime="2026-09-08 01:59:56.516840306 +0000 UTC m=+53.972455215"
Sep 08 01:59:56.624733 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.624641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf"
Sep 08 01:59:56.786803 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.786636    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fc749f995-f8qkm"]
Sep 08 01:59:56.789083 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.789054    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.791998 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.791975    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 01:59:56.792113 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.792011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 01:59:56.792113 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.791981    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 01:59:56.793219 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.793198    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9h72m\""
Sep 08 01:59:56.793323 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.793260    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 01:59:56.793412 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.793394    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 01:59:56.793757 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.793737    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 01:59:56.793840 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.793792    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 01:59:56.800607 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.800588    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc749f995-f8qkm"]
Sep 08 01:59:56.803056 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.802839    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 01:59:56.821569 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.821540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:56.871693 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871657    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-config\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.871693 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871692    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skkr5\" (UniqueName: \"kubernetes.io/projected/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-kube-api-access-skkr5\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.871900 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-trusted-ca-bundle\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.871900 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-oauth-serving-cert\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.871900 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871816    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-oauth-config\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.872059 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-serving-cert\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.872059 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.871958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-service-ca\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.873427 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.873407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:56.892158 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.892069    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-6vslf"]
Sep 08 01:59:56.895054 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:56.895030    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915506d2_c6a8_4b4e_8c33_3eea19ed1bf9.slice/crio-ef19ccca3e0578aa9f18042182faa41cc04dfacc88157c0ea8e4cc2b1b6a5c89 WatchSource:0}: Error finding container ef19ccca3e0578aa9f18042182faa41cc04dfacc88157c0ea8e4cc2b1b6a5c89: Status 404 returned error can't find the container with id ef19ccca3e0578aa9f18042182faa41cc04dfacc88157c0ea8e4cc2b1b6a5c89
Sep 08 01:59:56.972815 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.972790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-serving-cert\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.972815 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.972821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-service-ca\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973021 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.972850    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-config\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973021 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.972981    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skkr5\" (UniqueName: \"kubernetes.io/projected/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-kube-api-access-skkr5\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973112 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-trusted-ca-bundle\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973112 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973091    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-oauth-serving-cert\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973223 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-oauth-config\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973633 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973601    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-service-ca\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973633 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973621    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-config\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973786 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-oauth-serving-cert\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.973948 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.973903    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-trusted-ca-bundle\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.976057 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.976036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-oauth-config\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.976116 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.976044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-serving-cert\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:56.980110 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:56.980089    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skkr5\" (UniqueName: \"kubernetes.io/projected/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-kube-api-access-skkr5\") pod \"console-5fc749f995-f8qkm\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") " pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:57.100824 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.100793    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 01:59:57.366733 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.366698    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fc749f995-f8qkm"]
Sep 08 01:59:57.370198 ip-10-0-131-169 kubenswrapper[2562]: W0908 01:59:57.370156    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d886bc2_05d3_4e10_ac6a_5fc61166c95c.slice/crio-19cce8c22279f5ee3c754bafbb1d9bb5707da62d65b9e9072e5e181c9d01e31d WatchSource:0}: Error finding container 19cce8c22279f5ee3c754bafbb1d9bb5707da62d65b9e9072e5e181c9d01e31d: Status 404 returned error can't find the container with id 19cce8c22279f5ee3c754bafbb1d9bb5707da62d65b9e9072e5e181c9d01e31d
Sep 08 01:59:57.488546 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.488464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:57.505866 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.505839    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc749f995-f8qkm" event={"ID":"3d886bc2-05d3-4e10-ac6a-5fc61166c95c","Type":"ContainerStarted","Data":"19cce8c22279f5ee3c754bafbb1d9bb5707da62d65b9e9072e5e181c9d01e31d"}
Sep 08 01:59:57.506970 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.506946    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf" event={"ID":"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9","Type":"ContainerStarted","Data":"ef19ccca3e0578aa9f18042182faa41cc04dfacc88157c0ea8e4cc2b1b6a5c89"}
Sep 08 01:59:57.589716 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.589684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:57.639984 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:57.639954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:58.266285 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:58.266251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 01:59:58.512655 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:58.512619    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf" event={"ID":"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9","Type":"ContainerStarted","Data":"38136fc9e413e2ed550d9572ba5e1153d83026ff3fc16a03b1a10a81c1c3617e"}
Sep 08 01:59:58.513143 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:58.512681    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf" event={"ID":"915506d2-c6a8-4b4e-8c33-3eea19ed1bf9","Type":"ContainerStarted","Data":"9ed9024f246fe0c000e798b117f07aeb6169b624618cbb5223aa929442e3eaf7"}
Sep 08 01:59:58.528211 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:58.528169    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-6vslf" podStartSLOduration=2.396848839 podStartE2EDuration="3.528150233s" totalImagesPullingTime="1.131301394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 01:59:58.527834064 +0000 UTC m=+55.983449012" watchObservedRunningTime="2026-09-08 01:59:58.528150233 +0000 UTC m=+55.983765147"
Sep 08 01:59:59.804196 ip-10-0-131-169 kubenswrapper[2562]: I0908 01:59:59.804150    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.027379 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.027339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.055289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.055199    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"]
Sep 08 02:00:00.105800 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.105766    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wczcg"]
Sep 08 02:00:00.105995 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.105885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.108485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.108455    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 02:00:00.108626 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.108609    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-v5qnl\""
Sep 08 02:00:00.108706 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.108690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 02:00:00.114153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.114128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.139955 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.139929    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"]
Sep 08 02:00:00.140076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.139975    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"]
Sep 08 02:00:00.140076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.140027    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.142609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.142591    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9gddq\""
Sep 08 02:00:00.142723 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.142625    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 02:00:00.142723 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.142632    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 02:00:00.142723 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.142593    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 02:00:00.172826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.172692    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"]
Sep 08 02:00:00.172826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.172826    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.175495 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.175463    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 02:00:00.175610 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.175493    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 02:00:00.175610 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.175467    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 02:00:00.175610 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.175464    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-jnljv\""
Sep 08 02:00:00.191645 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.191621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.201905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.201882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-accelerators-collector-config\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.201937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.202022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.201966    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trbk5\" (UniqueName: \"kubernetes.io/projected/78be9256-7099-4c0b-aa69-e4ca02bd1523-kube-api-access-trbk5\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.201994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7lzc\" (UniqueName: \"kubernetes.io/projected/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-api-access-d7lzc\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.202022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202018    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-textfile\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202222 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202034    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3717c5aa-0b56-47dd-9f69-0a126aed8923-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.202222 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-tls\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202222 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202169    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202222 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8c8kw\" (UniqueName: \"kubernetes.io/projected/3717c5aa-0b56-47dd-9f69-0a126aed8923-kube-api-access-8c8kw\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.202377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3717c5aa-0b56-47dd-9f69-0a126aed8923-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.202377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202287    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-sys\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.202377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202324    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-root\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3717c5aa-0b56-47dd-9f69-0a126aed8923-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.202377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f2e0641-99e2-4811-989b-f0bca295fb8f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.202630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-wtmp\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78be9256-7099-4c0b-aa69-e4ca02bd1523-metrics-client-ca\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.202630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202500    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.202630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.202527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f2e0641-99e2-4811-989b-f0bca295fb8f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.289533 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.289492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.303606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303577    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-wtmp\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.303758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78be9256-7099-4c0b-aa69-e4ca02bd1523-metrics-client-ca\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.303758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.303874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f2e0641-99e2-4811-989b-f0bca295fb8f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.303874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-wtmp\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.303874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-accelerators-collector-config\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.303874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.304092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trbk5\" (UniqueName: \"kubernetes.io/projected/78be9256-7099-4c0b-aa69-e4ca02bd1523-kube-api-access-trbk5\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7lzc\" (UniqueName: \"kubernetes.io/projected/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-api-access-d7lzc\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.304092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-textfile\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.303992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3717c5aa-0b56-47dd-9f69-0a126aed8923-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.304092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-tls\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304058    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304093    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8c8kw\" (UniqueName: \"kubernetes.io/projected/3717c5aa-0b56-47dd-9f69-0a126aed8923-kube-api-access-8c8kw\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304133    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3717c5aa-0b56-47dd-9f69-0a126aed8923-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304161    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-sys\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-root\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304244    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3717c5aa-0b56-47dd-9f69-0a126aed8923-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f2e0641-99e2-4811-989b-f0bca295fb8f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.304363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/78be9256-7099-4c0b-aa69-e4ca02bd1523-metrics-client-ca\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.304728 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304589    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4f2e0641-99e2-4811-989b-f0bca295fb8f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.304850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-sys\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.305142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4f2e0641-99e2-4811-989b-f0bca295fb8f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.305378    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-accelerators-collector-config\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.305449    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/78be9256-7099-4c0b-aa69-e4ca02bd1523-root\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.305457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.305654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-textfile\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.306230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.306136    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3717c5aa-0b56-47dd-9f69-0a126aed8923-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.306896 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.306849    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.307983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.307939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.308264 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.308237    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3717c5aa-0b56-47dd-9f69-0a126aed8923-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.308399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.308362    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.308877 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.308853    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3717c5aa-0b56-47dd-9f69-0a126aed8923-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.309197 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.309166    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/78be9256-7099-4c0b-aa69-e4ca02bd1523-node-exporter-tls\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.312963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.312935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trbk5\" (UniqueName: \"kubernetes.io/projected/78be9256-7099-4c0b-aa69-e4ca02bd1523-kube-api-access-trbk5\") pod \"node-exporter-wczcg\" (UID: \"78be9256-7099-4c0b-aa69-e4ca02bd1523\") " pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.313662 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.313637    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8c8kw\" (UniqueName: \"kubernetes.io/projected/3717c5aa-0b56-47dd-9f69-0a126aed8923-kube-api-access-8c8kw\") pod \"openshift-state-metrics-657fd6c54-h22dm\" (UID: \"3717c5aa-0b56-47dd-9f69-0a126aed8923\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.313833 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.313814    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7lzc\" (UniqueName: \"kubernetes.io/projected/4f2e0641-99e2-4811-989b-f0bca295fb8f-kube-api-access-d7lzc\") pod \"kube-state-metrics-74cb57df7-jztz4\" (UID: \"4f2e0641-99e2-4811-989b-f0bca295fb8f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.388011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.387973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.417652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.417624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"
Sep 08 02:00:00.462690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.462662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wczcg"
Sep 08 02:00:00.483513 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.483491    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"
Sep 08 02:00:00.488766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.488746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.508597 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:00.508574    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78be9256_7099_4c0b_aa69_e4ca02bd1523.slice/crio-c43a31b72b86bc6837afb8a5d8022f61ce903a9bdf246a45dbb95fec81727d45 WatchSource:0}: Error finding container c43a31b72b86bc6837afb8a5d8022f61ce903a9bdf246a45dbb95fec81727d45: Status 404 returned error can't find the container with id c43a31b72b86bc6837afb8a5d8022f61ce903a9bdf246a45dbb95fec81727d45
Sep 08 02:00:00.521300 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.521256    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wczcg" event={"ID":"78be9256-7099-4c0b-aa69-e4ca02bd1523","Type":"ContainerStarted","Data":"c43a31b72b86bc6837afb8a5d8022f61ce903a9bdf246a45dbb95fec81727d45"}
Sep 08 02:00:00.589888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.589848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.780210 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.780183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-jztz4"]
Sep 08 02:00:00.781076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.781056    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm"]
Sep 08 02:00:00.783464 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:00.783434    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3717c5aa_0b56_47dd_9f69_0a126aed8923.slice/crio-101c9a1fdbda834ad912ec9e29849ef7ed47295f5619310240c83df1d8fcaef6 WatchSource:0}: Error finding container 101c9a1fdbda834ad912ec9e29849ef7ed47295f5619310240c83df1d8fcaef6: Status 404 returned error can't find the container with id 101c9a1fdbda834ad912ec9e29849ef7ed47295f5619310240c83df1d8fcaef6
Sep 08 02:00:00.783869 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:00.783854    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f2e0641_99e2_4811_989b_f0bca295fb8f.slice/crio-3bf6828cdb9d5b75cae06b43314475a4bf13026280170b74b0e9fd432bb1a086 WatchSource:0}: Error finding container 3bf6828cdb9d5b75cae06b43314475a4bf13026280170b74b0e9fd432bb1a086: Status 404 returned error can't find the container with id 3bf6828cdb9d5b75cae06b43314475a4bf13026280170b74b0e9fd432bb1a086
Sep 08 02:00:00.815564 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.815540    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:00.915262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:00.915232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:01.104647 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.104552    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:01.105351 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.105328    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 02:00:01.108400 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.108380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.110766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.110743    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 08 02:00:01.110997 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.110981    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 08 02:00:01.111195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.111130    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 08 02:00:01.111195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.111163    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 08 02:00:01.111195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.111171    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 08 02:00:01.111566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.111407    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 08 02:00:01.113816 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.113777    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 08 02:00:01.114967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.114123    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 08 02:00:01.114967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.114432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wvxjm\""
Sep 08 02:00:01.115124 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.114984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 08 02:00:01.121163 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.121143    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 02:00:01.215798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.215758    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.215970 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.215805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee87030-aa19-489e-bcae-d0c31f54866d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.215970 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.215948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.215994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee87030-aa19-489e-bcae-d0c31f54866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216027    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee87030-aa19-489e-bcae-d0c31f54866d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee87030-aa19-489e-bcae-d0c31f54866d-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216152    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216392 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee87030-aa19-489e-bcae-d0c31f54866d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.216392 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.216362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkmr2\" (UniqueName: \"kubernetes.io/projected/4ee87030-aa19-489e-bcae-d0c31f54866d-kube-api-access-kkmr2\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.294146 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.294108    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:01.317303 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee87030-aa19-489e-bcae-d0c31f54866d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317391    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkmr2\" (UniqueName: \"kubernetes.io/projected/4ee87030-aa19-489e-bcae-d0c31f54866d-kube-api-access-kkmr2\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317411    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317445 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:00:01.317434    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Sep 08 02:00:01.317704 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:00:01.317511    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-main-tls podName:4ee87030-aa19-489e-bcae-d0c31f54866d nodeName:}" failed. No retries permitted until 2026-09-08 02:00:01.817489029 +0000 UTC m=+59.273103935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "4ee87030-aa19-489e-bcae-d0c31f54866d") : secret "alertmanager-main-tls" not found
Sep 08 02:00:01.317704 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317435    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee87030-aa19-489e-bcae-d0c31f54866d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee87030-aa19-489e-bcae-d0c31f54866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317771    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.317818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317799    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee87030-aa19-489e-bcae-d0c31f54866d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.318035 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee87030-aa19-489e-bcae-d0c31f54866d-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.318035 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/4ee87030-aa19-489e-bcae-d0c31f54866d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.318035 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317851    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.318035 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.317887    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.318526 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.318498    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ee87030-aa19-489e-bcae-d0c31f54866d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.319251 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.319203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ee87030-aa19-489e-bcae-d0c31f54866d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.320801 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.320756    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-config-volume\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.321106 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.321086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.321581 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.321557    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.321657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.321567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.321657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.321567    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ee87030-aa19-489e-bcae-d0c31f54866d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.322761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.322742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-web-config\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.323229 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.323211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ee87030-aa19-489e-bcae-d0c31f54866d-config-out\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.323325 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.323217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.326325 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.326302    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkmr2\" (UniqueName: \"kubernetes.io/projected/4ee87030-aa19-489e-bcae-d0c31f54866d-kube-api-access-kkmr2\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.527298 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.527085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc749f995-f8qkm" event={"ID":"3d886bc2-05d3-4e10-ac6a-5fc61166c95c","Type":"ContainerStarted","Data":"5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a"}
Sep 08 02:00:01.528510 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.528475    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4" event={"ID":"4f2e0641-99e2-4811-989b-f0bca295fb8f","Type":"ContainerStarted","Data":"3bf6828cdb9d5b75cae06b43314475a4bf13026280170b74b0e9fd432bb1a086"}
Sep 08 02:00:01.530492 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.530468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm" event={"ID":"3717c5aa-0b56-47dd-9f69-0a126aed8923","Type":"ContainerStarted","Data":"7fe473a54f6c1263b2b79afb76a5332952b0e09551faaf4abe37b68cd68f9c29"}
Sep 08 02:00:01.530602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.530513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm" event={"ID":"3717c5aa-0b56-47dd-9f69-0a126aed8923","Type":"ContainerStarted","Data":"31b2e7233f3e8714a08ff2a13b24bfe692b42b92216faa3b9bb5f99ae4b82ca9"}
Sep 08 02:00:01.530602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.530537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm" event={"ID":"3717c5aa-0b56-47dd-9f69-0a126aed8923","Type":"ContainerStarted","Data":"101c9a1fdbda834ad912ec9e29849ef7ed47295f5619310240c83df1d8fcaef6"}
Sep 08 02:00:01.543798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.543755    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fc749f995-f8qkm" podStartSLOduration=2.385282909 podStartE2EDuration="5.543742767s" totalImagesPullingTime="3.158459858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:01.542791201 +0000 UTC m=+58.998406134" watchObservedRunningTime="2026-09-08 02:00:01.543742767 +0000 UTC m=+58.999357680"
Sep 08 02:00:01.754138 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.754112    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:01.822714 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.822682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.824983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.824964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/4ee87030-aa19-489e-bcae-d0c31f54866d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"4ee87030-aa19-489e-bcae-d0c31f54866d\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:01.853654 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:01.853628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:02.020946 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.020897    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 08 02:00:02.047906 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.047875    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"]
Sep 08 02:00:02.051218 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.051198    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.054132 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054105    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-f8zn2\""
Sep 08 02:00:02.054227 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054143    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 02:00:02.054430 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054412    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 02:00:02.054505 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054489    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 02:00:02.054572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054553    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-6q3ida4vs0jua\""
Sep 08 02:00:02.054651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 02:00:02.054826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.054810    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 02:00:02.063220 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.063146    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"]
Sep 08 02:00:02.125985 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.125957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhsgp\" (UniqueName: \"kubernetes.io/projected/304c572b-23e4-4c83-91bc-cb2e423eaabb-kube-api-access-qhsgp\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-grpc-tls\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304c572b-23e4-4c83-91bc-cb2e423eaabb-metrics-client-ca\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.126381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.126328    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-tls\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhsgp\" (UniqueName: \"kubernetes.io/projected/304c572b-23e4-4c83-91bc-cb2e423eaabb-kube-api-access-qhsgp\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227190    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227218    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-grpc-tls\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227302    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304c572b-23e4-4c83-91bc-cb2e423eaabb-metrics-client-ca\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227603 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.227603 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.227433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-tls\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.229131 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.229095    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/304c572b-23e4-4c83-91bc-cb2e423eaabb-metrics-client-ca\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.231598 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.231051    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.231598 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.231541    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-tls\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.231766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.231607    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-grpc-tls\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.232373 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.232347    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.232741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.232717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.233003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.232983    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/304c572b-23e4-4c83-91bc-cb2e423eaabb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.236196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.236162    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhsgp\" (UniqueName: \"kubernetes.io/projected/304c572b-23e4-4c83-91bc-cb2e423eaabb-kube-api-access-qhsgp\") pod \"thanos-querier-58fbbc6bc4-rqdqf\" (UID: \"304c572b-23e4-4c83-91bc-cb2e423eaabb\") " pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.306579 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.302949    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 08 02:00:02.362859 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.362779    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:02.415051 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.415024    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-27nx6"
Sep 08 02:00:02.522068 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.522035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:02.535831 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.535799    2562 generic.go:356] "Generic (PLEG): container finished" podID="78be9256-7099-4c0b-aa69-e4ca02bd1523" containerID="32278299b8f44088dcc2e1fbe1fdfa30901918b40822304b242f79160575fad8" exitCode=0
Sep 08 02:00:02.536020 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.535879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wczcg" event={"ID":"78be9256-7099-4c0b-aa69-e4ca02bd1523","Type":"ContainerDied","Data":"32278299b8f44088dcc2e1fbe1fdfa30901918b40822304b242f79160575fad8"}
Sep 08 02:00:02.585932 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:02.585888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:02.773304 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:02.773274    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee87030_aa19_489e_bcae_d0c31f54866d.slice/crio-f4eb0fd12f40639034f3bb27b40216e09b463f508fef1787b326669d609b01b2 WatchSource:0}: Error finding container f4eb0fd12f40639034f3bb27b40216e09b463f508fef1787b326669d609b01b2: Status 404 returned error can't find the container with id f4eb0fd12f40639034f3bb27b40216e09b463f508fef1787b326669d609b01b2
Sep 08 02:00:03.092121 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.092027    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"]
Sep 08 02:00:03.095639 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:03.095605    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod304c572b_23e4_4c83_91bc_cb2e423eaabb.slice/crio-f78bca0bb84071077a244d9f8bd78960682d927ce0c522daf77271b9c19c54d5 WatchSource:0}: Error finding container f78bca0bb84071077a244d9f8bd78960682d927ce0c522daf77271b9c19c54d5: Status 404 returned error can't find the container with id f78bca0bb84071077a244d9f8bd78960682d927ce0c522daf77271b9c19c54d5
Sep 08 02:00:03.123687 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.123658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:03.279324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.279236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:03.350266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.350234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:03.543206 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.543161    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wczcg" event={"ID":"78be9256-7099-4c0b-aa69-e4ca02bd1523","Type":"ContainerStarted","Data":"bb25b54c5dc556fc67b73907c3cb29939061cbb276b1b5c2ad700e7fe45d425e"}
Sep 08 02:00:03.543364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.543227    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wczcg" event={"ID":"78be9256-7099-4c0b-aa69-e4ca02bd1523","Type":"ContainerStarted","Data":"2ff3680923bed032d1dcc96632c4089d28146460bb4cab881ea7c73361da27c6"}
Sep 08 02:00:03.545428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.545399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4" event={"ID":"4f2e0641-99e2-4811-989b-f0bca295fb8f","Type":"ContainerStarted","Data":"ce33493819072942007cdd4f6f70f2863637673834c6770ae34dc9d223c01bc9"}
Sep 08 02:00:03.545536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.545460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4" event={"ID":"4f2e0641-99e2-4811-989b-f0bca295fb8f","Type":"ContainerStarted","Data":"88987e7e5726894ddc8ebda8601dbf9b29e8c9b8e1df408a5ec2ea7b6bb30c6e"}
Sep 08 02:00:03.545536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.545489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4" event={"ID":"4f2e0641-99e2-4811-989b-f0bca295fb8f","Type":"ContainerStarted","Data":"de97d3b2c5dad9cada9afb5ea7d75d7e3d1a42a984c73460ab4e52f4247c085c"}
Sep 08 02:00:03.547513 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.547493    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm" event={"ID":"3717c5aa-0b56-47dd-9f69-0a126aed8923","Type":"ContainerStarted","Data":"893810ebd20fdb58dd422b37fe06077bca147e5c6fba870d2f86e1c4f57c1445"}
Sep 08 02:00:03.548575 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.548556    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"f78bca0bb84071077a244d9f8bd78960682d927ce0c522daf77271b9c19c54d5"}
Sep 08 02:00:03.549555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.549540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"f4eb0fd12f40639034f3bb27b40216e09b463f508fef1787b326669d609b01b2"}
Sep 08 02:00:03.561633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.561592    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wczcg" podStartSLOduration=2.428194371 podStartE2EDuration="3.561575537s" totalImagesPullingTime="1.069607912s" totalInitContainerRuntime="63.773254ms" isStatefulPod=true podCreationTimestamp="2026-09-08 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:03.560800498 +0000 UTC m=+61.016415422" watchObservedRunningTime="2026-09-08 02:00:03.561575537 +0000 UTC m=+61.017190451"
Sep 08 02:00:03.577624 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.577583    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-jztz4" podStartSLOduration=1.538321554 podStartE2EDuration="3.577568971s" totalImagesPullingTime="2.039247417s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:03.576608963 +0000 UTC m=+61.032223902" watchObservedRunningTime="2026-09-08 02:00:03.577568971 +0000 UTC m=+61.033183887"
Sep 08 02:00:03.592215 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:03.592177    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-h22dm" podStartSLOduration=1.661509363 podStartE2EDuration="3.592164041s" totalImagesPullingTime="1.930654678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:03.591516506 +0000 UTC m=+61.047131455" watchObservedRunningTime="2026-09-08 02:00:03.592164041 +0000 UTC m=+61.047778953"
Sep 08 02:00:04.358606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.358569    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"]
Sep 08 02:00:04.362664 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.362643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.365078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.365052    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 02:00:04.366243 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.366218    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 02:00:04.366243 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.366232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-esit54p5i03be\""
Sep 08 02:00:04.366243 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.366238    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 02:00:04.366428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.366232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jt8hw\""
Sep 08 02:00:04.366428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.366224    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 02:00:04.376134 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.376105    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"]
Sep 08 02:00:04.446931 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.446884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfn5r\" (UniqueName: \"kubernetes.io/projected/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-kube-api-access-rfn5r\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.447077 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.446938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-client-ca-bundle\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.447077 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.447000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-audit-log\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.447077 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.447019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-secret-metrics-server-tls\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.447077 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.447068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.447246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.447120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-metrics-server-audit-profiles\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.447246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.447144    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-secret-metrics-server-client-certs\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547488 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-metrics-server-audit-profiles\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547488 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-secret-metrics-server-client-certs\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfn5r\" (UniqueName: \"kubernetes.io/projected/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-kube-api-access-rfn5r\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547558    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-client-ca-bundle\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-audit-log\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-secret-metrics-server-tls\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.547857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.547848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.548192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.548165    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-audit-log\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.548486 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.548462    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.548778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.548754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-metrics-server-audit-profiles\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.550641 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.550617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-secret-metrics-server-tls\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.550735 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.550665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-client-ca-bundle\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.550794 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.550772    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-secret-metrics-server-client-certs\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.555001 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.554981    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfn5r\" (UniqueName: \"kubernetes.io/projected/aa31503d-8f05-4ae5-b75a-bf271e6bdc8b-kube-api-access-rfn5r\") pod \"metrics-server-f9d4b48d4-mmjsl\" (UID: \"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b\") " pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.673874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.673806    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:04.839967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.839936    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"]
Sep 08 02:00:04.843502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.843400    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:04.845403 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.845376    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc749f995-f8qkm"]
Sep 08 02:00:04.846170 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.846080    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-pbpkc\""
Sep 08 02:00:04.846365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.846345    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 08 02:00:04.853025 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.853001    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"]
Sep 08 02:00:04.871109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.871078    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54f45f49d4-j62bf"]
Sep 08 02:00:04.874540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.874518    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.884547 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.884519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f45f49d4-j62bf"]
Sep 08 02:00:04.949265 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.949191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"]
Sep 08 02:00:04.952662 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:04.952625    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa31503d_8f05_4ae5_b75a_bf271e6bdc8b.slice/crio-1c2447e8503d2351b4dcbd7e493a44df9d2f40168a06aa0dfdf1c457f6035ec4 WatchSource:0}: Error finding container 1c2447e8503d2351b4dcbd7e493a44df9d2f40168a06aa0dfdf1c457f6035ec4: Status 404 returned error can't find the container with id 1c2447e8503d2351b4dcbd7e493a44df9d2f40168a06aa0dfdf1c457f6035ec4
Sep 08 02:00:04.955577 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc9rd\" (UniqueName: \"kubernetes.io/projected/64045453-d2bc-46b9-b3f8-225d4405ce67-kube-api-access-qc9rd\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:04.955577 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955561    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-trusted-ca-bundle\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.955710 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-service-ca\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.955710 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955701    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64045453-d2bc-46b9-b3f8-225d4405ce67-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:04.955812 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955720    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jvdp\" (UniqueName: \"kubernetes.io/projected/7b041381-b2bd-4ff5-b3e8-62177812f4fd-kube-api-access-7jvdp\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.955812 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955740    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-config\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.955936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955827    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-serving-cert\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.955936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-oauth-config\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:04.955936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:04.955892    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-oauth-serving-cert\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.002718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.002634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:05.050581 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.050539    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:05.056825 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.056795    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-serving-cert\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.056998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.056841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-oauth-config\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.056998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.056878    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-oauth-serving-cert\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.056998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.056950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc9rd\" (UniqueName: \"kubernetes.io/projected/64045453-d2bc-46b9-b3f8-225d4405ce67-kube-api-access-qc9rd\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:05.056998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.056990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-trusted-ca-bundle\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.057223 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.057081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-service-ca\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.057223 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.057142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64045453-d2bc-46b9-b3f8-225d4405ce67-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:05.057223 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.057193    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jvdp\" (UniqueName: \"kubernetes.io/projected/7b041381-b2bd-4ff5-b3e8-62177812f4fd-kube-api-access-7jvdp\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.057363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.057241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-config\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.057420 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:00:05.057397    2562 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 08 02:00:05.057477 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:00:05.057459    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64045453-d2bc-46b9-b3f8-225d4405ce67-monitoring-plugin-cert podName:64045453-d2bc-46b9-b3f8-225d4405ce67 nodeName:}" failed. No retries permitted until 2026-09-08 02:00:05.55743915 +0000 UTC m=+63.013054046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/64045453-d2bc-46b9-b3f8-225d4405ce67-monitoring-plugin-cert") pod "monitoring-plugin-85bbbbbf4-7qwpw" (UID: "64045453-d2bc-46b9-b3f8-225d4405ce67") : secret "monitoring-plugin-cert" not found
Sep 08 02:00:05.058230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.058160    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-oauth-serving-cert\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.058230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.058174    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-service-ca\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.058385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.058327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-config\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.058446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.058412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-trusted-ca-bundle\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.059877 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.059851    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-serving-cert\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.060120 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.060098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-oauth-config\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.066153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.066116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jvdp\" (UniqueName: \"kubernetes.io/projected/7b041381-b2bd-4ff5-b3e8-62177812f4fd-kube-api-access-7jvdp\") pod \"console-54f45f49d4-j62bf\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") " pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.066366 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.066342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc9rd\" (UniqueName: \"kubernetes.io/projected/64045453-d2bc-46b9-b3f8-225d4405ce67-kube-api-access-qc9rd\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:05.186055 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.186009    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:05.521978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.521832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54f45f49d4-j62bf"]
Sep 08 02:00:05.525366 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:05.525333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b041381_b2bd_4ff5_b3e8_62177812f4fd.slice/crio-7b65bf565d63e7f2b3f6b0225f2d27f424b2451d0634cd598abce0f800e2fdb4 WatchSource:0}: Error finding container 7b65bf565d63e7f2b3f6b0225f2d27f424b2451d0634cd598abce0f800e2fdb4: Status 404 returned error can't find the container with id 7b65bf565d63e7f2b3f6b0225f2d27f424b2451d0634cd598abce0f800e2fdb4
Sep 08 02:00:05.543576 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.543519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:05.560179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.560030    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ee87030-aa19-489e-bcae-d0c31f54866d" containerID="0279a5b3aeafa010f9eca61f6c84ac4c37325170ef2cb66d4def20d2e3a4f717" exitCode=0
Sep 08 02:00:05.560179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.560111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerDied","Data":"0279a5b3aeafa010f9eca61f6c84ac4c37325170ef2cb66d4def20d2e3a4f717"}
Sep 08 02:00:05.561670 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.561648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64045453-d2bc-46b9-b3f8-225d4405ce67-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:05.566688 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.566662    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f45f49d4-j62bf" event={"ID":"7b041381-b2bd-4ff5-b3e8-62177812f4fd","Type":"ContainerStarted","Data":"7b65bf565d63e7f2b3f6b0225f2d27f424b2451d0634cd598abce0f800e2fdb4"}
Sep 08 02:00:05.568335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.568288    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/64045453-d2bc-46b9-b3f8-225d4405ce67-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-7qwpw\" (UID: \"64045453-d2bc-46b9-b3f8-225d4405ce67\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:05.569560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.569492    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl" event={"ID":"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b","Type":"ContainerStarted","Data":"1c2447e8503d2351b4dcbd7e493a44df9d2f40168a06aa0dfdf1c457f6035ec4"}
Sep 08 02:00:05.757267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:05.757233    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:06.037362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.037227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"]
Sep 08 02:00:06.251516 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.251424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:06.257255 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.257151    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 02:00:06.275496 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.275463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.280203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.279896    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 08 02:00:06.280513 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.280008    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 08 02:00:06.280660 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.280087    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 08 02:00:06.280754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.280721    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.280881    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281037    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-5br2576gnujip\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281348    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-wt4n5\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281615    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281710    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281809    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281838    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.281996    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.282046    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.282103    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 08 02:00:06.282830 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.282217    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 08 02:00:06.283659 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.283400    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 08 02:00:06.370788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.370746    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.370992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.370824    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.370992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.370856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.370992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.370880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.370992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.370932    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ae59988-d270-4db1-b353-1f295138e46f-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8jd\" (UniqueName: \"kubernetes.io/projected/4ae59988-d270-4db1-b353-1f295138e46f-kube-api-access-6r8jd\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371308 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371182    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ae59988-d270-4db1-b353-1f295138e46f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371308 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371232    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371308 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-config\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371403    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371502    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371515    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.371637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.371546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472201    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472278    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472487    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ae59988-d270-4db1-b353-1f295138e46f-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472566    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8jd\" (UniqueName: \"kubernetes.io/projected/4ae59988-d270-4db1-b353-1f295138e46f-kube-api-access-6r8jd\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ae59988-d270-4db1-b353-1f295138e46f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-config\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472814    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.472841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.473580    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.474966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.474210    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.476246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.475239    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.476246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.475665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.476246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.476064    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.476246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.476237    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.477599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.477157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.477599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.477305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.477599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.477545    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.477816 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.477666    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.478090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.477969    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4ae59988-d270-4db1-b353-1f295138e46f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.478426 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.478359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.479168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.479140    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4ae59988-d270-4db1-b353-1f295138e46f-config-out\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.479435 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.479404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.479730 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.479671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4ae59988-d270-4db1-b353-1f295138e46f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.480706 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.480650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-config\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.481185 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.481155    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-web-config\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.481512 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.481493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.481651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.481630    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4ae59988-d270-4db1-b353-1f295138e46f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.482179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.482163    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8jd\" (UniqueName: \"kubernetes.io/projected/4ae59988-d270-4db1-b353-1f295138e46f-kube-api-access-6r8jd\") pod \"prometheus-k8s-0\" (UID: \"4ae59988-d270-4db1-b353-1f295138e46f\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:06.510248 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.510167    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w2zl9"
Sep 08 02:00:06.524249 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:06.524219    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64045453_d2bc_46b9_b3f8_225d4405ce67.slice/crio-dc6f765f9232d11257c8ee59afaca86bbd25ac572979356c10eeea7bb5ac4a94 WatchSource:0}: Error finding container dc6f765f9232d11257c8ee59afaca86bbd25ac572979356c10eeea7bb5ac4a94: Status 404 returned error can't find the container with id dc6f765f9232d11257c8ee59afaca86bbd25ac572979356c10eeea7bb5ac4a94
Sep 08 02:00:06.575987 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.575943    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f45f49d4-j62bf" event={"ID":"7b041381-b2bd-4ff5-b3e8-62177812f4fd","Type":"ContainerStarted","Data":"408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f"}
Sep 08 02:00:06.577297 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.577263    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw" event={"ID":"64045453-d2bc-46b9-b3f8-225d4405ce67","Type":"ContainerStarted","Data":"dc6f765f9232d11257c8ee59afaca86bbd25ac572979356c10eeea7bb5ac4a94"}
Sep 08 02:00:06.591058 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.590892    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54f45f49d4-j62bf" podStartSLOduration=2.590871211 podStartE2EDuration="2.590871211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:06.590287945 +0000 UTC m=+64.045902895" watchObservedRunningTime="2026-09-08 02:00:06.590871211 +0000 UTC m=+64.046486149"
Sep 08 02:00:06.593194 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:06.593153    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:07.101619 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.101588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 02:00:07.786242 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.785782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 02:00:07.786242 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.785894    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 02:00:07.788764 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.788747    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 02:00:07.789402 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.789367    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 02:00:07.798994 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.798898    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/478998cf-9541-4e4d-99af-b5768b9a387d-metrics-certs\") pod \"network-metrics-daemon-f8rjv\" (UID: \"478998cf-9541-4e4d-99af-b5768b9a387d\") " pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 02:00:07.799168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.799148    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 02:00:07.809617 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.809568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxtbn\" (UniqueName: \"kubernetes.io/projected/be4a2d28-d4fe-4193-af2b-04d6c1868a52-kube-api-access-vxtbn\") pod \"network-check-target-bd4nc\" (UID: \"be4a2d28-d4fe-4193-af2b-04d6c1868a52\") " pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 02:00:07.887650 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.887556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 02:00:07.890482 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.890391    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 02:00:07.900874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.900848    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81de7c44-fc49-4e80-bdf7-7006f275207c-original-pull-secret\") pod \"global-pull-secret-syncer-m4v75\" (UID: \"81de7c44-fc49-4e80-bdf7-7006f275207c\") " pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 02:00:07.905028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.905000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:07.975123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.975102    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s2v8c\""
Sep 08 02:00:07.982998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:07.982977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f8rjv"
Sep 08 02:00:08.005939 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.005176    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:08.016410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.016380    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 08 02:00:08.017529 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:08.017471    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae59988_d270_4db1_b353_1f295138e46f.slice/crio-c70bcee1f34a92be2aa3974b281cc623471ee9cfd0160a2f32948d756117afc5 WatchSource:0}: Error finding container c70bcee1f34a92be2aa3974b281cc623471ee9cfd0160a2f32948d756117afc5: Status 404 returned error can't find the container with id c70bcee1f34a92be2aa3974b281cc623471ee9cfd0160a2f32948d756117afc5
Sep 08 02:00:08.084855 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.084833    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lxnlh\""
Sep 08 02:00:08.089033 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.089013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-m4v75"
Sep 08 02:00:08.092705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.092605    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 02:00:08.262717 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.262646    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f8rjv"]
Sep 08 02:00:08.265089 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:08.265055    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod478998cf_9541_4e4d_99af_b5768b9a387d.slice/crio-1621546d40173e5f669c346df2bb0f80cb9bba6a931999bb02aabccc2a1b6d39 WatchSource:0}: Error finding container 1621546d40173e5f669c346df2bb0f80cb9bba6a931999bb02aabccc2a1b6d39: Status 404 returned error can't find the container with id 1621546d40173e5f669c346df2bb0f80cb9bba6a931999bb02aabccc2a1b6d39
Sep 08 02:00:08.377472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.376989    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-m4v75"]
Sep 08 02:00:08.379944 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:08.379287    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81de7c44_fc49_4e80_bdf7_7006f275207c.slice/crio-97a578b2cfa3982c3d1316e6ea260e06349b0d84f0c733daa3e8cffb60163863 WatchSource:0}: Error finding container 97a578b2cfa3982c3d1316e6ea260e06349b0d84f0c733daa3e8cffb60163863: Status 404 returned error can't find the container with id 97a578b2cfa3982c3d1316e6ea260e06349b0d84f0c733daa3e8cffb60163863
Sep 08 02:00:08.379944 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.379605    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-bd4nc"]
Sep 08 02:00:08.391891 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:00:08.391815    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe4a2d28_d4fe_4193_af2b_04d6c1868a52.slice/crio-f39b8ab886bdc8783b11d598f8dc0a1234697bf7cfcd10daf00f4948283e27d6 WatchSource:0}: Error finding container f39b8ab886bdc8783b11d598f8dc0a1234697bf7cfcd10daf00f4948283e27d6: Status 404 returned error can't find the container with id f39b8ab886bdc8783b11d598f8dc0a1234697bf7cfcd10daf00f4948283e27d6
Sep 08 02:00:08.590190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.590135    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl" event={"ID":"aa31503d-8f05-4ae5-b75a-bf271e6bdc8b","Type":"ContainerStarted","Data":"addc96d4d4b53bfb4212be3a812a56f62bd644ef4a8df7c5160c5c6f1972578b"}
Sep 08 02:00:08.594231 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.594202    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"4d234b31c05c958c37ff403a3505d3208ea774e7e67d412960a60c15f1344536"}
Sep 08 02:00:08.594381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.594275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"e88417008a40197c1252169dd116dde051bf43cf6b00378c890817f228c4520b"}
Sep 08 02:00:08.594381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.594311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"d998b76c2f23e49c696b3eeb4f5e2052bd654c7fb0e787175be406902a5c29d7"}
Sep 08 02:00:08.594381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.594349    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"1b495e68f0862680a4484bca121ab2c6fd2e291d4f068920dde5a320dbc0ebfc"}
Sep 08 02:00:08.594560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.594386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"b195c38272af435b84450c62f349c601609331df8d80632376ba3f5e6ea64b53"}
Sep 08 02:00:08.595821 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.595789    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m4v75" event={"ID":"81de7c44-fc49-4e80-bdf7-7006f275207c","Type":"ContainerStarted","Data":"97a578b2cfa3982c3d1316e6ea260e06349b0d84f0c733daa3e8cffb60163863"}
Sep 08 02:00:08.597795 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.597768    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ae59988-d270-4db1-b353-1f295138e46f" containerID="50b1998fcad75f8cefe7dfa77617c1d6e572951cb8398cbce57ffb1f0a76488a" exitCode=0
Sep 08 02:00:08.597875 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.597802    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerDied","Data":"50b1998fcad75f8cefe7dfa77617c1d6e572951cb8398cbce57ffb1f0a76488a"}
Sep 08 02:00:08.597951 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.597878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"c70bcee1f34a92be2aa3974b281cc623471ee9cfd0160a2f32948d756117afc5"}
Sep 08 02:00:08.600024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.600004    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bd4nc" event={"ID":"be4a2d28-d4fe-4193-af2b-04d6c1868a52","Type":"ContainerStarted","Data":"f39b8ab886bdc8783b11d598f8dc0a1234697bf7cfcd10daf00f4948283e27d6"}
Sep 08 02:00:08.601618 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.601594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8rjv" event={"ID":"478998cf-9541-4e4d-99af-b5768b9a387d","Type":"ContainerStarted","Data":"1621546d40173e5f669c346df2bb0f80cb9bba6a931999bb02aabccc2a1b6d39"}
Sep 08 02:00:08.604772 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.604617    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"f1b00e00837fd03aae66165c5b84776e29be061dfd5d53314d0fd9a4503f9433"}
Sep 08 02:00:08.604772 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.604685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"5861af811de3f2805ae3c48ba284565fa0779d905aef02d547a790a29ef5463e"}
Sep 08 02:00:08.604772 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.604725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"65d071c46bc39fc26f8407ede3f9cd2d97fc7405032e1b5313c6929a1d0e3713"}
Sep 08 02:00:08.610637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:08.610589    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl" podStartSLOduration=1.83176128 podStartE2EDuration="4.610571087s" totalImagesPullingTime="2.778809807s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:08.610477798 +0000 UTC m=+66.066092734" watchObservedRunningTime="2026-09-08 02:00:08.610571087 +0000 UTC m=+66.066186001"
Sep 08 02:00:09.413353 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.413290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:09.514717 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.514689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:09.615165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.615128    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8rjv" event={"ID":"478998cf-9541-4e4d-99af-b5768b9a387d","Type":"ContainerStarted","Data":"47c44b5c135df198b780d3e8bfd437a697d73e85516c091cd54000a33033f86f"}
Sep 08 02:00:09.619840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.619649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"dcb04504dd506522ee4f5bc9bd3fa1fc291853b591bdb49a81e525e400774bca"}
Sep 08 02:00:09.619840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.619725    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"6cc2aa392fb22839bd9c30266073ce6ba6b0abb3ae3f18382f35139f236c20a5"}
Sep 08 02:00:09.619840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.619765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" event={"ID":"304c572b-23e4-4c83-91bc-cb2e423eaabb","Type":"ContainerStarted","Data":"586ebd9963a88b91dc2f35010764ea39b9e1ef18402e87db0bf10857430ecbb3"}
Sep 08 02:00:09.620295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.620136    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:09.623682 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.623658    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw" event={"ID":"64045453-d2bc-46b9-b3f8-225d4405ce67","Type":"ContainerStarted","Data":"52fdfa985d2e987272d85a9fc494d4577d4ef8d30716ec234718e88a578fbd63"}
Sep 08 02:00:09.624146 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.624126    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:09.630093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.630038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"4ee87030-aa19-489e-bcae-d0c31f54866d","Type":"ContainerStarted","Data":"1d24fb7e5191b6fd6e0fa3d9ee78760d2fa6d302fc4f5fe21100b735176477a8"}
Sep 08 02:00:09.630516 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.630485    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw"
Sep 08 02:00:09.641819 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.641771    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf" podStartSLOduration=2.297251459 podStartE2EDuration="7.641751674s" totalImagesPullingTime="5.344500215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:09.640523684 +0000 UTC m=+67.096138622" watchObservedRunningTime="2026-09-08 02:00:09.641751674 +0000 UTC m=+67.097366588"
Sep 08 02:00:09.669136 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.669084    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.350788866 podStartE2EDuration="8.669064862s" totalImagesPullingTime="5.298297523s" totalInitContainerRuntime="19.978473ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:09.667173138 +0000 UTC m=+67.122788112" watchObservedRunningTime="2026-09-08 02:00:09.669064862 +0000 UTC m=+67.124679777"
Sep 08 02:00:09.686600 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.686268    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-7qwpw" podStartSLOduration=2.826803589 podStartE2EDuration="5.686246339s" totalImagesPullingTime="2.85944275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:09.685807716 +0000 UTC m=+67.141422645" watchObservedRunningTime="2026-09-08 02:00:09.686246339 +0000 UTC m=+67.141861255"
Sep 08 02:00:09.862493 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.862426    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:09.963828 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:09.963733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:10.639948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:10.638577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f8rjv" event={"ID":"478998cf-9541-4e4d-99af-b5768b9a387d","Type":"ContainerStarted","Data":"627b2e7681460dde46bfdeeb1f8acb3fe1ab3eabb883a37f3511b91d700bc1bc"}
Sep 08 02:00:10.657025 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:10.655646    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f8rjv" podStartSLOduration=66.532949272 podStartE2EDuration="1m7.655624836s" totalImagesPullingTime="1.122675564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:10.654785027 +0000 UTC m=+68.110399964" watchObservedRunningTime="2026-09-08 02:00:10.655624836 +0000 UTC m=+68.111239746"
Sep 08 02:00:10.734758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:10.734725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:10.834460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:10.834423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:10.943488 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:10.943374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:14.291072 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:14.291031    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:14.338152 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:14.338106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:15.186649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.186619    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:15.186775 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.186715    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:15.192110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.192087    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:15.644320 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.644250    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-58fbbc6bc4-rqdqf"
Sep 08 02:00:15.668198 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.668172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-m4v75" event={"ID":"81de7c44-fc49-4e80-bdf7-7006f275207c","Type":"ContainerStarted","Data":"635827e8018b218ca5a6cd7260db7d39dbdb9db91625f8120d8f58e4839cbb50"}
Sep 08 02:00:15.672360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.672334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"c6342a95e92169d4b5493d3d0e5d0097a3629b69336da4bf569f5ef58789bb43"}
Sep 08 02:00:15.672502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.672401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"32fc7117694b7c2c2b7afb9618b25777af87203808969cfe859875dc2546da11"}
Sep 08 02:00:15.672502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.672441    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"04e8b93e1b5e8b4feebde1e1b1eecf44df18033970c2667377b8a99da2cdc0a2"}
Sep 08 02:00:15.672502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.672480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"445850d3ba539cc77587ca75ceb7d5f7ff5d7501894e58b25d20b718e78e67a9"}
Sep 08 02:00:15.672656 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.672521    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"c75a2c50de1a593cf447a0afabd8cfdcc5315989757d1f311e53dbdeba297e0d"}
Sep 08 02:00:15.672656 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.672562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4ae59988-d270-4db1-b353-1f295138e46f","Type":"ContainerStarted","Data":"b524508d1ed732dcc1081c69828b7c1859449c54614cf60dbe806d557980ff67"}
Sep 08 02:00:15.674502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.674470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-bd4nc" event={"ID":"be4a2d28-d4fe-4193-af2b-04d6c1868a52","Type":"ContainerStarted","Data":"8e1d6e5c075dea6031d2e3eab5d42f13809270e26ecf37088418afdc9793e9d9"}
Sep 08 02:00:15.674649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.674627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 02:00:15.678407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.678384    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:00:15.686550 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.686510    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-m4v75" podStartSLOduration=65.931330169 podStartE2EDuration="1m12.686496991s" totalImagesPullingTime="6.755166822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:15.685956307 +0000 UTC m=+73.141571244" watchObservedRunningTime="2026-09-08 02:00:15.686496991 +0000 UTC m=+73.142111903"
Sep 08 02:00:15.701990 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.701902    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-bd4nc" podStartSLOduration=65.965422441 podStartE2EDuration="1m12.701881941s" totalImagesPullingTime="6.7364595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 01:59:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:15.698760246 +0000 UTC m=+73.154375181" watchObservedRunningTime="2026-09-08 02:00:15.701881941 +0000 UTC m=+73.157496856"
Sep 08 02:00:15.745460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.745389    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.181795023 podStartE2EDuration="9.745365724s" totalImagesPullingTime="6.538967774s" totalInitContainerRuntime="24.602927ms" isStatefulPod=false podCreationTimestamp="2026-09-08 02:00:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:00:15.744370752 +0000 UTC m=+73.199985718" watchObservedRunningTime="2026-09-08 02:00:15.745365724 +0000 UTC m=+73.200980639"
Sep 08 02:00:15.841238 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.841209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:15.941318 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:15.941184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:16.041365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:16.041318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:16.594480 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:16.594440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:00:17.102040 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:17.102005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:17.155637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:17.155594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:20.039494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:20.039461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:20.140633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:20.140598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:23.355080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:23.355044    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:23.406144 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:23.406093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:24.674573 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:24.674538    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:24.674947 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:24.674629    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:25.851313 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:25.851280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:29.873216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:29.873168    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fc749f995-f8qkm" podUID="3d886bc2-05d3-4e10-ac6a-5fc61166c95c" containerName="console" containerID="cri-o://5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a" gracePeriod=15
Sep 08 02:00:30.147372 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.147308    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 02:00:30.191989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.191948    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-serving-cert\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192010    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-service-ca\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-trusted-ca-bundle\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192091    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-oauth-config\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-skkr5\" (UniqueName: \"kubernetes.io/projected/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-kube-api-access-skkr5\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192344 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192164    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-config\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192344 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192188    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-oauth-serving-cert\") pod \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\" (UID: \"3d886bc2-05d3-4e10-ac6a-5fc61166c95c\") "
Sep 08 02:00:30.192491 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-service-ca" (OuterVolumeSpecName: "service-ca") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:00:30.192491 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192470    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:00:30.192734 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192539    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-config" (OuterVolumeSpecName: "console-config") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:00:30.192734 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.192722    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:00:30.194419 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.194390    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:00:30.194621 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.194603    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:00:30.194677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.194603    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-kube-api-access-skkr5" (OuterVolumeSpecName: "kube-api-access-skkr5") pod "3d886bc2-05d3-4e10-ac6a-5fc61166c95c" (UID: "3d886bc2-05d3-4e10-ac6a-5fc61166c95c"). InnerVolumeSpecName "kube-api-access-skkr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:00:30.293428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293395    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-serving-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.293428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293421    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.293428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293429    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-trusted-ca-bundle\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.293428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293438    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-oauth-config\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.293667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293447    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-skkr5\" (UniqueName: \"kubernetes.io/projected/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-kube-api-access-skkr5\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.293667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293457    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-console-config\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.293667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.293473    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3d886bc2-05d3-4e10-ac6a-5fc61166c95c-oauth-serving-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:00:30.740875 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.740838    2562 generic.go:356] "Generic (PLEG): container finished" podID="3d886bc2-05d3-4e10-ac6a-5fc61166c95c" containerID="5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a" exitCode=0
Sep 08 02:00:30.741094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.740883    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fc749f995-f8qkm"
Sep 08 02:00:30.741094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.740897    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc749f995-f8qkm" event={"ID":"3d886bc2-05d3-4e10-ac6a-5fc61166c95c","Type":"ContainerDied","Data":"5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a"}
Sep 08 02:00:30.741094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.740970    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fc749f995-f8qkm" event={"ID":"3d886bc2-05d3-4e10-ac6a-5fc61166c95c","Type":"ContainerDied","Data":"19cce8c22279f5ee3c754bafbb1d9bb5707da62d65b9e9072e5e181c9d01e31d"}
Sep 08 02:00:30.741094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.741014    2562 scope.go:117] "RemoveContainer" containerID="5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a"
Sep 08 02:00:30.750164 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.750144    2562 scope.go:117] "RemoveContainer" containerID="5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a"
Sep 08 02:00:30.750447 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:00:30.750428    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a\": container with ID starting with 5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a not found: ID does not exist" containerID="5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a"
Sep 08 02:00:30.750508 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.750454    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a"} err="failed to get container status \"5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a\": rpc error: code = NotFound desc = could not find container \"5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a\": container with ID starting with 5572be111f56430616bfe60759054286f9035059a65275e0ffed5efc2379049a not found: ID does not exist"
Sep 08 02:00:30.761809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.761763    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fc749f995-f8qkm"]
Sep 08 02:00:30.763444 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:30.763426    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fc749f995-f8qkm"]
Sep 08 02:00:31.068653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:31.068617    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d886bc2-05d3-4e10-ac6a-5fc61166c95c" path="/var/lib/kubelet/pods/3d886bc2-05d3-4e10-ac6a-5fc61166c95c/volumes"
Sep 08 02:00:34.934695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:34.934651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:35.027186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:35.027153    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:42.527582 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:42.527542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:42.579494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:42.579467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:00:44.680274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:44.680248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:44.684369 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:44.684342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-f9d4b48d4-mmjsl"
Sep 08 02:00:47.685410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:00:47.685379    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-bd4nc"
Sep 08 02:01:06.593784 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:06.593742    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:01:06.615005 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:06.614967    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:01:06.908630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:06.908552    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 08 02:01:19.257905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:19.257870    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:19.645496 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:19.645460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:29.278379 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:29.278342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:29.379743 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:29.379700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:34.417191 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:34.417156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:34.946460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:34.946424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:40.222356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:40.222322    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f45f49d4-j62bf"]
Sep 08 02:01:40.363413 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:40.363378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:40.413957 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:40.413905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:40.727239 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:40.727211    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:40.780539 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:40.780502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:41.335061 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:41.335029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:42.131446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:42.131418    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:42.178602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:42.178576    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:46.368793 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:46.368758    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:46.420648 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:46.420619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:49.938262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:49.938229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:50.038585 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:50.038555    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:51.376183 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:51.376149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:51.427353 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:51.427323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:01:51.480905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:01:51.480868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:01.644053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:01.644015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:04.402464 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:04.402430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:04.454768 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:04.454738    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:05.242057 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.242023    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54f45f49d4-j62bf" podUID="7b041381-b2bd-4ff5-b3e8-62177812f4fd" containerName="console" containerID="cri-o://408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f" gracePeriod=15
Sep 08 02:02:05.482384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.482360    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:02:05.605650 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605614    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-config\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.605650 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605648    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-oauth-config\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.605848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605705    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-trusted-ca-bundle\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.605848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605723    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-service-ca\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.605848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jvdp\" (UniqueName: \"kubernetes.io/projected/7b041381-b2bd-4ff5-b3e8-62177812f4fd-kube-api-access-7jvdp\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.605848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-serving-cert\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.605848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.605797    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-oauth-serving-cert\") pod \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\" (UID: \"7b041381-b2bd-4ff5-b3e8-62177812f4fd\") "
Sep 08 02:02:05.606175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.606146    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-service-ca" (OuterVolumeSpecName: "service-ca") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:02:05.606175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.606159    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:02:05.606268 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.606172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:02:05.606305 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.606267    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-config" (OuterVolumeSpecName: "console-config") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:02:05.608119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.608095    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:02:05.608119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.608102    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b041381-b2bd-4ff5-b3e8-62177812f4fd-kube-api-access-7jvdp" (OuterVolumeSpecName: "kube-api-access-7jvdp") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "kube-api-access-7jvdp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:02:05.608241 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.608152    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7b041381-b2bd-4ff5-b3e8-62177812f4fd" (UID: "7b041381-b2bd-4ff5-b3e8-62177812f4fd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:02:05.706561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706539    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-trusted-ca-bundle\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:05.706561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706560    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:05.706713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706570    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jvdp\" (UniqueName: \"kubernetes.io/projected/7b041381-b2bd-4ff5-b3e8-62177812f4fd-kube-api-access-7jvdp\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:05.706713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706579    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-serving-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:05.706713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706588    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-oauth-serving-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:05.706713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706596    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-config\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:05.706713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:05.706604    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7b041381-b2bd-4ff5-b3e8-62177812f4fd-console-oauth-config\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:02:06.126222 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.126189    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b041381-b2bd-4ff5-b3e8-62177812f4fd" containerID="408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f" exitCode=0
Sep 08 02:02:06.126385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.126232    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54f45f49d4-j62bf"
Sep 08 02:02:06.126385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.126269    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f45f49d4-j62bf" event={"ID":"7b041381-b2bd-4ff5-b3e8-62177812f4fd","Type":"ContainerDied","Data":"408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f"}
Sep 08 02:02:06.126385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.126315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54f45f49d4-j62bf" event={"ID":"7b041381-b2bd-4ff5-b3e8-62177812f4fd","Type":"ContainerDied","Data":"7b65bf565d63e7f2b3f6b0225f2d27f424b2451d0634cd598abce0f800e2fdb4"}
Sep 08 02:02:06.126385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.126335    2562 scope.go:117] "RemoveContainer" containerID="408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f"
Sep 08 02:02:06.139729 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.139711    2562 scope.go:117] "RemoveContainer" containerID="408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f"
Sep 08 02:02:06.140062 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:02:06.140040    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f\": container with ID starting with 408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f not found: ID does not exist" containerID="408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f"
Sep 08 02:02:06.140162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.140068    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f"} err="failed to get container status \"408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f\": rpc error: code = NotFound desc = could not find container \"408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f\": container with ID starting with 408ff7d768f4278a2e401152ad8b82caae466c3e931998eb0778f249b34d2c1f not found: ID does not exist"
Sep 08 02:02:06.148428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.148400    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54f45f49d4-j62bf"]
Sep 08 02:02:06.150483 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:06.150464    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54f45f49d4-j62bf"]
Sep 08 02:02:07.069090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:07.069056    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b041381-b2bd-4ff5-b3e8-62177812f4fd" path="/var/lib/kubelet/pods/7b041381-b2bd-4ff5-b3e8-62177812f4fd/volumes"
Sep 08 02:02:13.607167 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:13.607132    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:13.656611 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:13.656579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:14.646396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:14.646360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:14.868153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:14.868123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:36.208597 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:36.208560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:37.013502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:37.013463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:39.810234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:39.810200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:39.909926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:39.909889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:44.408752 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:44.408711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:44.897813 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:44.897776    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:45.419254 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:45.419218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:48.321588 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.321556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:48.410982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.410953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:48.414418 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414393    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lkxbh"]
Sep 08 02:02:48.414709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414697    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b041381-b2bd-4ff5-b3e8-62177812f4fd" containerName="console"
Sep 08 02:02:48.414751 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414711    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b041381-b2bd-4ff5-b3e8-62177812f4fd" containerName="console"
Sep 08 02:02:48.414751 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414730    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d886bc2-05d3-4e10-ac6a-5fc61166c95c" containerName="console"
Sep 08 02:02:48.414751 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414735    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d886bc2-05d3-4e10-ac6a-5fc61166c95c" containerName="console"
Sep 08 02:02:48.414848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414789    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b041381-b2bd-4ff5-b3e8-62177812f4fd" containerName="console"
Sep 08 02:02:48.414848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.414798    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d886bc2-05d3-4e10-ac6a-5fc61166c95c" containerName="console"
Sep 08 02:02:48.416540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.416525    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.419319 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.419299    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 02:02:48.420193 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.420175    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 02:02:48.420280 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.420175    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h45dn\""
Sep 08 02:02:48.426976 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.426957    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lkxbh"]
Sep 08 02:02:48.567447 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.567414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbpvz\" (UniqueName: \"kubernetes.io/projected/40853487-59aa-477e-94fc-f5cb408f5c72-kube-api-access-hbpvz\") pod \"cert-manager-webhook-6486ffd997-lkxbh\" (UID: \"40853487-59aa-477e-94fc-f5cb408f5c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.567602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.567464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40853487-59aa-477e-94fc-f5cb408f5c72-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lkxbh\" (UID: \"40853487-59aa-477e-94fc-f5cb408f5c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.668434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.668348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbpvz\" (UniqueName: \"kubernetes.io/projected/40853487-59aa-477e-94fc-f5cb408f5c72-kube-api-access-hbpvz\") pod \"cert-manager-webhook-6486ffd997-lkxbh\" (UID: \"40853487-59aa-477e-94fc-f5cb408f5c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.668434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.668402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40853487-59aa-477e-94fc-f5cb408f5c72-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lkxbh\" (UID: \"40853487-59aa-477e-94fc-f5cb408f5c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.676175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.676153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/40853487-59aa-477e-94fc-f5cb408f5c72-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lkxbh\" (UID: \"40853487-59aa-477e-94fc-f5cb408f5c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.676356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.676338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbpvz\" (UniqueName: \"kubernetes.io/projected/40853487-59aa-477e-94fc-f5cb408f5c72-kube-api-access-hbpvz\") pod \"cert-manager-webhook-6486ffd997-lkxbh\" (UID: \"40853487-59aa-477e-94fc-f5cb408f5c72\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.736869 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.736843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:48.803785 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.803726    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:48.909035 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:48.909004    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:49.020539 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:49.020516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lkxbh"]
Sep 08 02:02:49.022726 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:02:49.022699    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod40853487_59aa_477e_94fc_f5cb408f5c72.slice/crio-b5bcb4b9f39b194f5857652d1a0df381a294fd896f9a2a3ebf96b9ae36f94be9 WatchSource:0}: Error finding container b5bcb4b9f39b194f5857652d1a0df381a294fd896f9a2a3ebf96b9ae36f94be9: Status 404 returned error can't find the container with id b5bcb4b9f39b194f5857652d1a0df381a294fd896f9a2a3ebf96b9ae36f94be9
Sep 08 02:02:49.313234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:49.313200    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh" event={"ID":"40853487-59aa-477e-94fc-f5cb408f5c72","Type":"ContainerStarted","Data":"b5bcb4b9f39b194f5857652d1a0df381a294fd896f9a2a3ebf96b9ae36f94be9"}
Sep 08 02:02:50.520640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:50.520595    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:51.333476 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:51.333434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:53.334410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:53.334359    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh" event={"ID":"40853487-59aa-477e-94fc-f5cb408f5c72","Type":"ContainerStarted","Data":"f1c8d50e8ca077901e4442f4f5a47074174faf64dc58e12230b19edb5fc36500"}
Sep 08 02:02:53.334791 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:53.334496    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:02:53.351375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:53.351308    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh" podStartSLOduration=1.88094363 podStartE2EDuration="5.35129614s" totalImagesPullingTime="3.47035251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:02:53.350895888 +0000 UTC m=+230.806510802" watchObservedRunningTime="2026-09-08 02:02:53.35129614 +0000 UTC m=+230.806911053"
Sep 08 02:02:59.124784 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:59.124753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:02:59.341075 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:02:59.341042    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lkxbh"
Sep 08 02:03:00.325594 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:00.325560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:00.426167 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:00.426138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:02.501494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:02.501452    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:02.595834 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:02.595806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:04.515323 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.515290    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"]
Sep 08 02:03:04.521689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.521669    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.524626 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.524607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 02:03:04.525590 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.525555    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 02:03:04.525696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.525682    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-h8c5t\""
Sep 08 02:03:04.527643 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.527619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"]
Sep 08 02:03:04.605430 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.605405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0daa8dff-8796-4757-9fdf-688c00327bb3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wq682\" (UID: \"0daa8dff-8796-4757-9fdf-688c00327bb3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.605555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.605451    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjck2\" (UniqueName: \"kubernetes.io/projected/0daa8dff-8796-4757-9fdf-688c00327bb3-kube-api-access-cjck2\") pod \"openshift-lws-operator-fd8ccff4c-wq682\" (UID: \"0daa8dff-8796-4757-9fdf-688c00327bb3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.706810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.706779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjck2\" (UniqueName: \"kubernetes.io/projected/0daa8dff-8796-4757-9fdf-688c00327bb3-kube-api-access-cjck2\") pod \"openshift-lws-operator-fd8ccff4c-wq682\" (UID: \"0daa8dff-8796-4757-9fdf-688c00327bb3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.706949 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.706849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0daa8dff-8796-4757-9fdf-688c00327bb3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wq682\" (UID: \"0daa8dff-8796-4757-9fdf-688c00327bb3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.707208 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.707191    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0daa8dff-8796-4757-9fdf-688c00327bb3-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wq682\" (UID: \"0daa8dff-8796-4757-9fdf-688c00327bb3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.714495 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.714476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjck2\" (UniqueName: \"kubernetes.io/projected/0daa8dff-8796-4757-9fdf-688c00327bb3-kube-api-access-cjck2\") pod \"openshift-lws-operator-fd8ccff4c-wq682\" (UID: \"0daa8dff-8796-4757-9fdf-688c00327bb3\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:04.831465 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:04.831440    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"
Sep 08 02:03:05.100953 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:05.100928    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682"]
Sep 08 02:03:05.103501 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:03:05.103474    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0daa8dff_8796_4757_9fdf_688c00327bb3.slice/crio-f1f4837fb4792148baab40717ed34fea3b27749dc6381171b4a018176d740d58 WatchSource:0}: Error finding container f1f4837fb4792148baab40717ed34fea3b27749dc6381171b4a018176d740d58: Status 404 returned error can't find the container with id f1f4837fb4792148baab40717ed34fea3b27749dc6381171b4a018176d740d58
Sep 08 02:03:05.382990 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:05.382891    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682" event={"ID":"0daa8dff-8796-4757-9fdf-688c00327bb3","Type":"ContainerStarted","Data":"f1f4837fb4792148baab40717ed34fea3b27749dc6381171b4a018176d740d58"}
Sep 08 02:03:08.398212 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:08.398173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682" event={"ID":"0daa8dff-8796-4757-9fdf-688c00327bb3","Type":"ContainerStarted","Data":"f31fc746780b5fca65c7da13009c3dc8377459e1f5e451e5817310fa38f20879"}
Sep 08 02:03:08.415485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:08.415436    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wq682" podStartSLOduration=1.934489445 podStartE2EDuration="4.41542151s" totalImagesPullingTime="2.480932065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:03:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:03:08.41399624 +0000 UTC m=+245.869611156" watchObservedRunningTime="2026-09-08 02:03:08.41542151 +0000 UTC m=+245.871036423"
Sep 08 02:03:09.114098 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:09.114050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:09.214809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:09.214772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:10.862487 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:10.862457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:27.057895 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:27.057808    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:27.156897 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:27.156866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:27.679789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:27.679750    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:27.978102 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:27.978014    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.089474 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.089438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.150021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.149985    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"]
Sep 08 02:03:28.153426 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.153406    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.156545 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.156511    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 02:03:28.156706 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.156626    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 02:03:28.156880 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.156855    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 02:03:28.157332 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.157305    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dzwkl\""
Sep 08 02:03:28.157419 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.157381    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 02:03:28.174672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.174638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"]
Sep 08 02:03:28.201949 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.201902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f57ef65e-8fc6-4b7d-ab89-666b129073ee-tmp\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.202099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.201985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f57ef65e-8fc6-4b7d-ab89-666b129073ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.202099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.202015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f57ef65e-8fc6-4b7d-ab89-666b129073ee-manifests\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.202099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.202031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f57ef65e-8fc6-4b7d-ab89-666b129073ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.202099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.202093    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bww8\" (UniqueName: \"kubernetes.io/projected/f57ef65e-8fc6-4b7d-ab89-666b129073ee-kube-api-access-2bww8\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.303137 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.303104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bww8\" (UniqueName: \"kubernetes.io/projected/f57ef65e-8fc6-4b7d-ab89-666b129073ee-kube-api-access-2bww8\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.303342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.303176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f57ef65e-8fc6-4b7d-ab89-666b129073ee-tmp\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.303342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.303240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f57ef65e-8fc6-4b7d-ab89-666b129073ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.303342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.303275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f57ef65e-8fc6-4b7d-ab89-666b129073ee-manifests\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.303342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.303298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f57ef65e-8fc6-4b7d-ab89-666b129073ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.303746 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.303718    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f57ef65e-8fc6-4b7d-ab89-666b129073ee-manifests\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.305511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.305489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f57ef65e-8fc6-4b7d-ab89-666b129073ee-tmp\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.305753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.305735    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f57ef65e-8fc6-4b7d-ab89-666b129073ee-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.305753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.305748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f57ef65e-8fc6-4b7d-ab89-666b129073ee-webhook-cert\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.312253 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.312228    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bww8\" (UniqueName: \"kubernetes.io/projected/f57ef65e-8fc6-4b7d-ab89-666b129073ee-kube-api-access-2bww8\") pod \"opendatahub-operator-controller-manager-6566bd6ff-tfv76\" (UID: \"f57ef65e-8fc6-4b7d-ab89-666b129073ee\") " pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.316127 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.316100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.463972 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.463932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:28.490386 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.490350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.587576 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.587501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.684489 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.684452    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.747248 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.747221    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"]
Sep 08 02:03:28.752963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.752903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.852712 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.852599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:28.955644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:28.955613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:29.059853 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:29.059822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:29.487217 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:29.487179    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76" event={"ID":"f57ef65e-8fc6-4b7d-ab89-666b129073ee","Type":"ContainerStarted","Data":"dfc8622f4793d49544269383941b97f8f20844f51622c0b49a9634e71e49f10f"}
Sep 08 02:03:32.506094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:32.506060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76" event={"ID":"f57ef65e-8fc6-4b7d-ab89-666b129073ee","Type":"ContainerStarted","Data":"dadb048257731aaba56bb8086c71ee81a07a0796d124ce0b755657af810c9dda"}
Sep 08 02:03:33.512343 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:33.512310    2562 generic.go:356] "Generic (PLEG): container finished" podID="f57ef65e-8fc6-4b7d-ab89-666b129073ee" containerID="dadb048257731aaba56bb8086c71ee81a07a0796d124ce0b755657af810c9dda" exitCode=0
Sep 08 02:03:33.512716 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:33.512396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76" event={"ID":"f57ef65e-8fc6-4b7d-ab89-666b129073ee","Type":"ContainerDied","Data":"dadb048257731aaba56bb8086c71ee81a07a0796d124ce0b755657af810c9dda"}
Sep 08 02:03:34.518599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:34.518563    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76" event={"ID":"f57ef65e-8fc6-4b7d-ab89-666b129073ee","Type":"ContainerStarted","Data":"7374f6b9d5029fcbbcd1393674a945cd03dfec1b87758f9adf9df99f7dcdf4b7"}
Sep 08 02:03:34.519047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:34.518702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:34.543058 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:34.543009    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76" podStartSLOduration=2.019993203 podStartE2EDuration="6.542995139s" totalImagesPullingTime="3.520323253s" totalInitContainerRuntime="1.002678683s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:03:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:03:34.541083614 +0000 UTC m=+271.996698546" watchObservedRunningTime="2026-09-08 02:03:34.542995139 +0000 UTC m=+271.998610051"
Sep 08 02:03:35.167796 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:35.167756    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:35.275763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:35.275731    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:39.675481 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:39.675428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:39.780371 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:39.780341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:41.535907 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:41.535869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:41.667753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:41.667719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:45.526803 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:45.526771    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6566bd6ff-tfv76"
Sep 08 02:03:47.511514 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:47.511474    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:47.671199 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:47.671159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:47.863743 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:47.863705    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:49.302903 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:49.302871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:49.393334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:49.393307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:50.546390 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:50.546354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:54.782483 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:54.782448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:54.885154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:54.885127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:55.431258 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.431223    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"]
Sep 08 02:03:55.433909 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.433886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.436558 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.436537    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-zhbht\""
Sep 08 02:03:55.437379 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.437359    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 02:03:55.437492 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.437431    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 02:03:55.437661 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.437646    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 02:03:55.442757 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.442726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.442866 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.442774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.442866 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.442840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.443029 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.442933    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.443029 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.443007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.443117 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.443036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kghf7\" (UniqueName: \"kubernetes.io/projected/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-kube-api-access-kghf7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.443117 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.443073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.443117 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.443114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.443241 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.443140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.447861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.447838    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"]
Sep 08 02:03:55.467960 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.467939    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:55.544556 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.544726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.544726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.544726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544632    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kghf7\" (UniqueName: \"kubernetes.io/projected/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-kube-api-access-kghf7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.544726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.544726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544716    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.544992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.545049    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.545132    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.545144    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545416 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.545391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.545514 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.545499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.547351 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.547324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.547580 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.547560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.554421 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.554392    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kghf7\" (UniqueName: \"kubernetes.io/projected/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-kube-api-access-kghf7\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.554421 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.554405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64\" (UID: \"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:55.565187 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.565157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:55.664095 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.664056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:55.743956 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:55.743844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:03:56.021378 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:56.021280    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"]
Sep 08 02:03:56.023622 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:03:56.023593    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73b4d0e_f7d0_4502_a5ba_4a30aa11ff95.slice/crio-4364b269c827a03912793934d4f42dfc11a5622fbe6af77b1246e4edaf388e83 WatchSource:0}: Error finding container 4364b269c827a03912793934d4f42dfc11a5622fbe6af77b1246e4edaf388e83: Status 404 returned error can't find the container with id 4364b269c827a03912793934d4f42dfc11a5622fbe6af77b1246e4edaf388e83
Sep 08 02:03:56.622047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:56.621966    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64" event={"ID":"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95","Type":"ContainerStarted","Data":"4364b269c827a03912793934d4f42dfc11a5622fbe6af77b1246e4edaf388e83"}
Sep 08 02:03:57.445385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:57.445333    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:58.457234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.456855    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-h5csc"]
Sep 08 02:03:58.463094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.463069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.466629 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.466517    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 02:03:58.479760 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.479733    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-85vvc\""
Sep 08 02:03:58.537754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.537714    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:58.538291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.538262    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-h5csc"]
Sep 08 02:03:58.574274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.574244    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb2nh\" (UniqueName: \"kubernetes.io/projected/b633329d-0fa9-4544-85c7-2f061a4ab0e2-kube-api-access-jb2nh\") pod \"odh-model-controller-7998c67dc4-h5csc\" (UID: \"b633329d-0fa9-4544-85c7-2f061a4ab0e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.574458 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.574322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b633329d-0fa9-4544-85c7-2f061a4ab0e2-cert\") pod \"odh-model-controller-7998c67dc4-h5csc\" (UID: \"b633329d-0fa9-4544-85c7-2f061a4ab0e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.674871 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.674837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b633329d-0fa9-4544-85c7-2f061a4ab0e2-cert\") pod \"odh-model-controller-7998c67dc4-h5csc\" (UID: \"b633329d-0fa9-4544-85c7-2f061a4ab0e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.675058 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.674957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb2nh\" (UniqueName: \"kubernetes.io/projected/b633329d-0fa9-4544-85c7-2f061a4ab0e2-kube-api-access-jb2nh\") pod \"odh-model-controller-7998c67dc4-h5csc\" (UID: \"b633329d-0fa9-4544-85c7-2f061a4ab0e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.677570 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.677543    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b633329d-0fa9-4544-85c7-2f061a4ab0e2-cert\") pod \"odh-model-controller-7998c67dc4-h5csc\" (UID: \"b633329d-0fa9-4544-85c7-2f061a4ab0e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.688370 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.688342    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb2nh\" (UniqueName: \"kubernetes.io/projected/b633329d-0fa9-4544-85c7-2f061a4ab0e2-kube-api-access-jb2nh\") pod \"odh-model-controller-7998c67dc4-h5csc\" (UID: \"b633329d-0fa9-4544-85c7-2f061a4ab0e2\") " pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.692243 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.692177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:58.776604 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.776531    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:03:58.798458 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:58.798429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:59.163039 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.163002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:59.246192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.245437    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:03:59.246192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.245530    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:03:59.246192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.245574    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:03:59.281473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.281401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:03:59.484389 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.484365    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-h5csc"]
Sep 08 02:03:59.486836 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:03:59.486811    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb633329d_0fa9_4544_85c7_2f061a4ab0e2.slice/crio-1efb25c27e9c83881ae8b9ef9886c437b261cd4569afc1754f9fe64f9a3b496e WatchSource:0}: Error finding container 1efb25c27e9c83881ae8b9ef9886c437b261cd4569afc1754f9fe64f9a3b496e: Status 404 returned error can't find the container with id 1efb25c27e9c83881ae8b9ef9886c437b261cd4569afc1754f9fe64f9a3b496e
Sep 08 02:03:59.638667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.638628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64" event={"ID":"b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95","Type":"ContainerStarted","Data":"0b12b2d7849eb6719ab32146c95ded771fb8398b4d62a4543a8948dcf2b8c625"}
Sep 08 02:03:59.640010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.639977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc" event={"ID":"b633329d-0fa9-4544-85c7-2f061a4ab0e2","Type":"ContainerStarted","Data":"1efb25c27e9c83881ae8b9ef9886c437b261cd4569afc1754f9fe64f9a3b496e"}
Sep 08 02:03:59.666544 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.666489    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64" podStartSLOduration=1.447080199 podStartE2EDuration="4.666470154s" totalImagesPullingTime="3.219389955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:03:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:03:59.665870316 +0000 UTC m=+297.121485230" watchObservedRunningTime="2026-09-08 02:03:59.666470154 +0000 UTC m=+297.122085069"
Sep 08 02:03:59.744170 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:03:59.744073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:04:00.750336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:00.750301    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:04:01.650791 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:01.650742    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:04:01.651897 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:01.651871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64"
Sep 08 02:04:02.656778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:02.656745    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc" event={"ID":"b633329d-0fa9-4544-85c7-2f061a4ab0e2","Type":"ContainerStarted","Data":"605b5e22be56a27b36c595dc7bd53b676c0b22f689cd6dc20aaf9639a330f651"}
Sep 08 02:04:02.657263 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:02.656902    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:04:02.678358 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:02.678310    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc" podStartSLOduration=1.93457307 podStartE2EDuration="4.678293737s" totalImagesPullingTime="2.743720667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:03:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:04:02.676423515 +0000 UTC m=+300.132038459" watchObservedRunningTime="2026-09-08 02:04:02.678293737 +0000 UTC m=+300.133908650"
Sep 08 02:04:02.969110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:02.969045    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:04:02.970471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:02.970447    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:04:02.976312 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:02.976293    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 02:04:05.689621 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.689591    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"]
Sep 08 02:04:05.694337 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.694319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.698371 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.698341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 02:04:05.698371 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.698341    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 02:04:05.698549 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.698348    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 02:04:05.698549 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.698350    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nwh77\""
Sep 08 02:04:05.705455 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.705434    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"]
Sep 08 02:04:05.743944 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.743897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-manager-config\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.744081 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.743956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcdxf\" (UniqueName: \"kubernetes.io/projected/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-kube-api-access-tcdxf\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.744081 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.744052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-metrics-cert\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.744196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.744161    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-cert\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.845198 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.845168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-cert\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.845365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.845214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-manager-config\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.845365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.845249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcdxf\" (UniqueName: \"kubernetes.io/projected/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-kube-api-access-tcdxf\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.845365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.845301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-metrics-cert\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.846872 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.846849    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-manager-config\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.848620 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.848456    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-metrics-cert\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.848620 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.848558    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-cert\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:05.854724 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:05.854704    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcdxf\" (UniqueName: \"kubernetes.io/projected/c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98-kube-api-access-tcdxf\") pod \"lws-controller-manager-5777c545f5-4mrjn\" (UID: \"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98\") " pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:06.005503 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.005414    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:06.011116 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.011091    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"]
Sep 08 02:04:06.015765 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.015745    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.020531 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.020501    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 02:04:06.020673 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.020579    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-drqj9\""
Sep 08 02:04:06.020770 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.020663    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 02:04:06.020899 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.020784    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 02:04:06.031664 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.031637    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"]
Sep 08 02:04:06.048642 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.048600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6l4g\" (UniqueName: \"kubernetes.io/projected/6256e63c-28d4-462d-a128-e574a2a4e814-kube-api-access-t6l4g\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.048789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.048722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6256e63c-28d4-462d-a128-e574a2a4e814-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.048789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.048762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.048998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.048815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6256e63c-28d4-462d-a128-e574a2a4e814-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.048998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.048845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6256e63c-28d4-462d-a128-e574a2a4e814-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.048998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.048879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.049234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.049040    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.149868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.149833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6256e63c-28d4-462d-a128-e574a2a4e814-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.149868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.149873    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.150112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.149900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6256e63c-28d4-462d-a128-e574a2a4e814-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.150112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.149943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6256e63c-28d4-462d-a128-e574a2a4e814-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.150112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.150005    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.150112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.150056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.150112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.150101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6l4g\" (UniqueName: \"kubernetes.io/projected/6256e63c-28d4-462d-a128-e574a2a4e814-kube-api-access-t6l4g\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.150635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.150612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6256e63c-28d4-462d-a128-e574a2a4e814-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.152322 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.152298    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.152400 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.152359    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.153164 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.153145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6256e63c-28d4-462d-a128-e574a2a4e814-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.153233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.153215    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6256e63c-28d4-462d-a128-e574a2a4e814-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.168854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.168834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6256e63c-28d4-462d-a128-e574a2a4e814-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.169232 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.169212    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6l4g\" (UniqueName: \"kubernetes.io/projected/6256e63c-28d4-462d-a128-e574a2a4e814-kube-api-access-t6l4g\") pod \"istiod-openshift-gateway-5677ccb49b-6w5vp\" (UID: \"6256e63c-28d4-462d-a128-e574a2a4e814\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.296187 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.296150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"]
Sep 08 02:04:06.298854 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:04:06.298830    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08fca8b_15d2_4bb2_8f23_ecd5cb8cdd98.slice/crio-f3985f6c6d527b895f8087c6ac486fccb0f51e1348afff9e77a26650886469ff WatchSource:0}: Error finding container f3985f6c6d527b895f8087c6ac486fccb0f51e1348afff9e77a26650886469ff: Status 404 returned error can't find the container with id f3985f6c6d527b895f8087c6ac486fccb0f51e1348afff9e77a26650886469ff
Sep 08 02:04:06.300840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.300826    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 02:04:06.354126 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.354102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:06.638248 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.638145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"]
Sep 08 02:04:06.640624 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:04:06.640598    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6256e63c_28d4_462d_a128_e574a2a4e814.slice/crio-194320c9e7a6b095420e11093730aba2fec6a232a59952ef5b4c012abfa247bb WatchSource:0}: Error finding container 194320c9e7a6b095420e11093730aba2fec6a232a59952ef5b4c012abfa247bb: Status 404 returned error can't find the container with id 194320c9e7a6b095420e11093730aba2fec6a232a59952ef5b4c012abfa247bb
Sep 08 02:04:06.675350 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.675316    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp" event={"ID":"6256e63c-28d4-462d-a128-e574a2a4e814","Type":"ContainerStarted","Data":"194320c9e7a6b095420e11093730aba2fec6a232a59952ef5b4c012abfa247bb"}
Sep 08 02:04:06.676565 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:06.676542    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn" event={"ID":"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98","Type":"ContainerStarted","Data":"f3985f6c6d527b895f8087c6ac486fccb0f51e1348afff9e77a26650886469ff"}
Sep 08 02:04:07.242091 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:07.242048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:07.370530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:07.370341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:09.110155 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.110118    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:04:09.110512 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.110189    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:04:09.497696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.497612    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:09.655010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.654976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:09.695876 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.695468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp" event={"ID":"6256e63c-28d4-462d-a128-e574a2a4e814","Type":"ContainerStarted","Data":"5980a47001e3918385e63140acd0ffdfd6e33a7f55b2cb7b17ca93e1d5d6c512"}
Sep 08 02:04:09.696300 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.696244    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:09.698295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.698276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn" event={"ID":"c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98","Type":"ContainerStarted","Data":"db3515c8a7a7aeceb074f2ea4754a685b123c2439c880a5bfc71664b5da5f916"}
Sep 08 02:04:09.698384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.698327    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:09.780498 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.780239    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp" podStartSLOduration=2.3131898140000002 podStartE2EDuration="4.780216394s" totalImagesPullingTime="2.46702658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:04:09.778801827 +0000 UTC m=+307.234416765" watchObservedRunningTime="2026-09-08 02:04:09.780216394 +0000 UTC m=+307.235831308"
Sep 08 02:04:09.820651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.820566    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn" podStartSLOduration=2.016092354 podStartE2EDuration="4.820546462s" totalImagesPullingTime="2.804454108s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:04:09.816585777 +0000 UTC m=+307.272200718" watchObservedRunningTime="2026-09-08 02:04:09.820546462 +0000 UTC m=+307.276161374"
Sep 08 02:04:09.889429 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:09.889384    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:10.192316 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:10.192280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:10.704503 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:10.704476    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-6w5vp"
Sep 08 02:04:10.887128 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:10.887094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:11.035024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:11.034994    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:11.133006 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:11.132972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:13.663896 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:13.663863    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-h5csc"
Sep 08 02:04:20.704973 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:20.704934    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5777c545f5-4mrjn"
Sep 08 02:04:28.639010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:28.638977    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:28.689064 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:28.689028    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:51.469659 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:51.469624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:51.541577 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:51.541545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:59.576595 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:59.576524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:04:59.674759 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:04:59.674727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:02.275809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:02.275773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:02.376315 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:02.376287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:02.429967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:02.429937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:12.357274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:12.357234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:15.174502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:15.174464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:16.957832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:16.957794    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:17.361528 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:17.361492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:17.608132 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:17.608099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:17.777586 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:17.777510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:18.995317 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:18.995285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:20.062867 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:20.062833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:20.253527 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:20.253495    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:20.975127 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:20.975097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:21.354264 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:21.354233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:21.625799 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:21.625721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:24.760100 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:24.760065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:24.861589 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:24.861554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:25.289937 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:25.289880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:25.390278 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:25.390242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:27.766726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:27.766691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:27.864750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:27.864708    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:28.671657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:28.671629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:28.842177 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:28.842147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:32.524416 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:32.524383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:32.623699 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:32.623660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:32.682534 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:32.682502    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:39.443707 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.443667    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"]
Sep 08 02:05:39.447565 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.447544    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.450560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.450533    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 02:05:39.450832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.450812    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 02:05:39.450966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.450942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mc6hv\""
Sep 08 02:05:39.458622 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.458468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxwq4\" (UniqueName: \"kubernetes.io/projected/77c19b82-2bde-4cd6-9365-4b63a5c010c7-kube-api-access-zxwq4\") pod \"kuadrant-operator-controller-manager-58fc56757c-npml8\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.458622 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.458527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c19b82-2bde-4cd6-9365-4b63a5c010c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-npml8\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.461485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.461462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"]
Sep 08 02:05:39.559384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.559350    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxwq4\" (UniqueName: \"kubernetes.io/projected/77c19b82-2bde-4cd6-9365-4b63a5c010c7-kube-api-access-zxwq4\") pod \"kuadrant-operator-controller-manager-58fc56757c-npml8\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.559558 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.559400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c19b82-2bde-4cd6-9365-4b63a5c010c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-npml8\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.559853 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.559830    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c19b82-2bde-4cd6-9365-4b63a5c010c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-npml8\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.568953 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.568900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxwq4\" (UniqueName: \"kubernetes.io/projected/77c19b82-2bde-4cd6-9365-4b63a5c010c7-kube-api-access-zxwq4\") pod \"kuadrant-operator-controller-manager-58fc56757c-npml8\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:39.760876 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:39.760790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:40.036820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:40.036791    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"]
Sep 08 02:05:40.040018 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:05:40.039984    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77c19b82_2bde_4cd6_9365_4b63a5c010c7.slice/crio-659224e922d9c77030ccb765b4cc880a84656894fb8120ceb3f6e97fdfec2644 WatchSource:0}: Error finding container 659224e922d9c77030ccb765b4cc880a84656894fb8120ceb3f6e97fdfec2644: Status 404 returned error can't find the container with id 659224e922d9c77030ccb765b4cc880a84656894fb8120ceb3f6e97fdfec2644
Sep 08 02:05:40.120642 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:40.120610    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8" event={"ID":"77c19b82-2bde-4cd6-9365-4b63a5c010c7","Type":"ContainerStarted","Data":"659224e922d9c77030ccb765b4cc880a84656894fb8120ceb3f6e97fdfec2644"}
Sep 08 02:05:40.895819 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:40.895775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:40.995901 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:40.995863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:41.382083 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:41.382023    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:41.486213 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:41.486174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:45.147789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:45.147745    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8" event={"ID":"77c19b82-2bde-4cd6-9365-4b63a5c010c7","Type":"ContainerStarted","Data":"e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b"}
Sep 08 02:05:45.148200 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:45.147864    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:45.168754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:45.168707    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8" podStartSLOduration=1.989102411 podStartE2EDuration="6.168693024s" totalImagesPullingTime="4.179590613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:05:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:05:45.167543554 +0000 UTC m=+402.623158488" watchObservedRunningTime="2026-09-08 02:05:45.168693024 +0000 UTC m=+402.624307937"
Sep 08 02:05:46.155524 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:46.155493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:46.259122 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:46.259090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:50.560143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:50.560109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:50.658384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:50.658354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:51.466931 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.466873    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"]
Sep 08 02:05:51.467169 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.467119    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8" podUID="77c19b82-2bde-4cd6-9365-4b63a5c010c7" containerName="manager" containerID="cri-o://e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b" gracePeriod=10
Sep 08 02:05:51.468930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.468898    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:51.725606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.725547    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:51.768790 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.768764    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c19b82-2bde-4cd6-9365-4b63a5c010c7-extensions-socket-volume\") pod \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") "
Sep 08 02:05:51.768967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.768822    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zxwq4\" (UniqueName: \"kubernetes.io/projected/77c19b82-2bde-4cd6-9365-4b63a5c010c7-kube-api-access-zxwq4\") pod \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\" (UID: \"77c19b82-2bde-4cd6-9365-4b63a5c010c7\") "
Sep 08 02:05:51.769651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.769324    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77c19b82-2bde-4cd6-9365-4b63a5c010c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77c19b82-2bde-4cd6-9365-4b63a5c010c7" (UID: "77c19b82-2bde-4cd6-9365-4b63a5c010c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:05:51.771128 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.771100    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77c19b82-2bde-4cd6-9365-4b63a5c010c7-kube-api-access-zxwq4" (OuterVolumeSpecName: "kube-api-access-zxwq4") pod "77c19b82-2bde-4cd6-9365-4b63a5c010c7" (UID: "77c19b82-2bde-4cd6-9365-4b63a5c010c7"). InnerVolumeSpecName "kube-api-access-zxwq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:05:51.870079 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.870039    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zxwq4\" (UniqueName: \"kubernetes.io/projected/77c19b82-2bde-4cd6-9365-4b63a5c010c7-kube-api-access-zxwq4\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:05:51.870079 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:51.870075    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77c19b82-2bde-4cd6-9365-4b63a5c010c7-extensions-socket-volume\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:05:52.181509 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.181476    2562 generic.go:356] "Generic (PLEG): container finished" podID="77c19b82-2bde-4cd6-9365-4b63a5c010c7" containerID="e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b" exitCode=0
Sep 08 02:05:52.181689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.181522    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"
Sep 08 02:05:52.181689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.181526    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8" event={"ID":"77c19b82-2bde-4cd6-9365-4b63a5c010c7","Type":"ContainerDied","Data":"e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b"}
Sep 08 02:05:52.181689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.181655    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8" event={"ID":"77c19b82-2bde-4cd6-9365-4b63a5c010c7","Type":"ContainerDied","Data":"659224e922d9c77030ccb765b4cc880a84656894fb8120ceb3f6e97fdfec2644"}
Sep 08 02:05:52.181689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.181685    2562 scope.go:117] "RemoveContainer" containerID="e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b"
Sep 08 02:05:52.191093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.191075    2562 scope.go:117] "RemoveContainer" containerID="e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b"
Sep 08 02:05:52.191341 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:05:52.191323    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b\": container with ID starting with e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b not found: ID does not exist" containerID="e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b"
Sep 08 02:05:52.191405 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.191347    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b"} err="failed to get container status \"e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b\": rpc error: code = NotFound desc = could not find container \"e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b\": container with ID starting with e5f23c592607b4006b653a29b367af8e14fc074b0e731ae3064263ce0e27c04b not found: ID does not exist"
Sep 08 02:05:52.209513 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.209483    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"]
Sep 08 02:05:52.218090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:52.218060    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-npml8"]
Sep 08 02:05:53.070764 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:53.070730    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77c19b82-2bde-4cd6-9365-4b63a5c010c7" path="/var/lib/kubelet/pods/77c19b82-2bde-4cd6-9365-4b63a5c010c7/volumes"
Sep 08 02:05:55.350300 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:55.350264    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:55.450956 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:55.450905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:55.759283 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:55.759199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:55.816190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:55.816154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:55.950720 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:55.950674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:05:56.051104 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:05:56.051078    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:01.067323 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:01.067285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:01.116596 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:01.116569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:03.018272 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:03.018240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:03.070864 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:03.070830    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:03.989282 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:03.989243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:04.089190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:04.089154    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:07.729893 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.729855    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"]
Sep 08 02:06:07.730415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.730398    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77c19b82-2bde-4cd6-9365-4b63a5c010c7" containerName="manager"
Sep 08 02:06:07.730464 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.730418    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77c19b82-2bde-4cd6-9365-4b63a5c010c7" containerName="manager"
Sep 08 02:06:07.730535 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.730523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="77c19b82-2bde-4cd6-9365-4b63a5c010c7" containerName="manager"
Sep 08 02:06:07.734103 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.734080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.736856 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.736835    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-5jccl\""
Sep 08 02:06:07.743535 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.743509    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"]
Sep 08 02:06:07.755105 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.755084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:07.808047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz6bx\" (UniqueName: \"kubernetes.io/projected/ea9e7152-e1e9-4c84-9b39-a045f055fc02-kube-api-access-jz6bx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808073    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.808471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.808361    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909124    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz6bx\" (UniqueName: \"kubernetes.io/projected/ea9e7152-e1e9-4c84-9b39-a045f055fc02-kube-api-access-jz6bx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909298    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909384    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909423    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909542    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909842 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909808    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.909908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.909892    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.910206 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.910183    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.911552 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.911533    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.911773 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.911746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.917368 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.917346    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea9e7152-e1e9-4c84-9b39-a045f055fc02-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.917976 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.917959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz6bx\" (UniqueName: \"kubernetes.io/projected/ea9e7152-e1e9-4c84-9b39-a045f055fc02-kube-api-access-jz6bx\") pod \"maas-default-gateway-openshift-default-78bb78ff78-wz4nb\" (UID: \"ea9e7152-e1e9-4c84-9b39-a045f055fc02\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:07.950523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:07.950491    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:08.045093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:08.045057    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:08.317578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:08.317552    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"]
Sep 08 02:06:08.319237 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:06:08.319206    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea9e7152_e1e9_4c84_9b39_a045f055fc02.slice/crio-1f1347a48f226b3821d980c0fc0091c1cbe3eaab360098b2b3abcd64efced779 WatchSource:0}: Error finding container 1f1347a48f226b3821d980c0fc0091c1cbe3eaab360098b2b3abcd64efced779: Status 404 returned error can't find the container with id 1f1347a48f226b3821d980c0fc0091c1cbe3eaab360098b2b3abcd64efced779
Sep 08 02:06:08.325930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:08.321981    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:06:08.325930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:08.322129    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:06:08.325930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:08.322247    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:06:09.262255 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:09.262216    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" event={"ID":"ea9e7152-e1e9-4c84-9b39-a045f055fc02","Type":"ContainerStarted","Data":"4471958b3dcee20997f72d088ecd950aabcd5a9d0226c25e75f9646a80d7eba6"}
Sep 08 02:06:09.262626 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:09.262283    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" event={"ID":"ea9e7152-e1e9-4c84-9b39-a045f055fc02","Type":"ContainerStarted","Data":"1f1347a48f226b3821d980c0fc0091c1cbe3eaab360098b2b3abcd64efced779"}
Sep 08 02:06:09.281800 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:09.281756    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podStartSLOduration=2.281741553 podStartE2EDuration="2.281741553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:06:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:06:09.2802292 +0000 UTC m=+426.735844135" watchObservedRunningTime="2026-09-08 02:06:09.281741553 +0000 UTC m=+426.737356544"
Sep 08 02:06:10.045993 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:10.045952    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:10.050713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:10.050689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:10.266582 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:10.266542    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:10.267547 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:10.267531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:06:23.457461 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.457419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:23.594310 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.594271    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:23.648926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.648887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:23.922761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.922727    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:06:23.925522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.925500    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:23.928277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.928248    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 02:06:23.928277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.928257    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 02:06:23.929311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.929293    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 02:06:23.929384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.929328    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dsb4k\""
Sep 08 02:06:23.936262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.936239    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:06:23.964901 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:23.964872    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:06:24.054809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.054780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8c0f92c-89f5-445a-9d26-38032e2ca16d-config-file\") pod \"limitador-limitador-85d9db4d5d-6q2x6\" (UID: \"b8c0f92c-89f5-445a-9d26-38032e2ca16d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.054989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.054831    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68pws\" (UniqueName: \"kubernetes.io/projected/b8c0f92c-89f5-445a-9d26-38032e2ca16d-kube-api-access-68pws\") pod \"limitador-limitador-85d9db4d5d-6q2x6\" (UID: \"b8c0f92c-89f5-445a-9d26-38032e2ca16d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.156299 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.156270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8c0f92c-89f5-445a-9d26-38032e2ca16d-config-file\") pod \"limitador-limitador-85d9db4d5d-6q2x6\" (UID: \"b8c0f92c-89f5-445a-9d26-38032e2ca16d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.156432 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.156318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68pws\" (UniqueName: \"kubernetes.io/projected/b8c0f92c-89f5-445a-9d26-38032e2ca16d-kube-api-access-68pws\") pod \"limitador-limitador-85d9db4d5d-6q2x6\" (UID: \"b8c0f92c-89f5-445a-9d26-38032e2ca16d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.156862 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.156843    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b8c0f92c-89f5-445a-9d26-38032e2ca16d-config-file\") pod \"limitador-limitador-85d9db4d5d-6q2x6\" (UID: \"b8c0f92c-89f5-445a-9d26-38032e2ca16d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.164787 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.164760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68pws\" (UniqueName: \"kubernetes.io/projected/b8c0f92c-89f5-445a-9d26-38032e2ca16d-kube-api-access-68pws\") pod \"limitador-limitador-85d9db4d5d-6q2x6\" (UID: \"b8c0f92c-89f5-445a-9d26-38032e2ca16d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.237549 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.237482    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:24.292572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.292521    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:24.392340 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.392308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:24.507220 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:24.507125    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:06:24.509803 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:06:24.509776    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8c0f92c_89f5_445a_9d26_38032e2ca16d.slice/crio-07147e845a32847cbb22287092b0e47cdbc92d22da68aab464b5fc3c4f5a6429 WatchSource:0}: Error finding container 07147e845a32847cbb22287092b0e47cdbc92d22da68aab464b5fc3c4f5a6429: Status 404 returned error can't find the container with id 07147e845a32847cbb22287092b0e47cdbc92d22da68aab464b5fc3c4f5a6429
Sep 08 02:06:25.336568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:25.336491    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6" event={"ID":"b8c0f92c-89f5-445a-9d26-38032e2ca16d","Type":"ContainerStarted","Data":"07147e845a32847cbb22287092b0e47cdbc92d22da68aab464b5fc3c4f5a6429"}
Sep 08 02:06:26.342566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:26.342534    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6" event={"ID":"b8c0f92c-89f5-445a-9d26-38032e2ca16d","Type":"ContainerStarted","Data":"fa5fb34aafe859aec4a73a6c546e118c53f9b8ce7e69392c467e3fb3a3f8085d"}
Sep 08 02:06:26.342929 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:26.342599    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:26.360139 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:26.360095    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6" podStartSLOduration=1.951634546 podStartE2EDuration="3.360079216s" totalImagesPullingTime="1.40844467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:06:26.358798097 +0000 UTC m=+443.814413018" watchObservedRunningTime="2026-09-08 02:06:26.360079216 +0000 UTC m=+443.815694185"
Sep 08 02:06:37.348307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:37.348272    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"
Sep 08 02:06:41.663443 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:41.663409    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:41.765579 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:41.765535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:42.115167 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:42.115139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:54.128386 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:54.128330    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:06:54.543375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:06:54.543345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:05.777273 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:05.777236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:07.485511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:07.485477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:07.587940 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:07.587886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:07.672868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:07.672833    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:07.733211 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:07.733168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:07.929267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:07.929237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:11.508904 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:11.508871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:11.613150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:11.613115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:43.846397 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:43.846355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:43.941095 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:43.941058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:45.161007 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:45.160970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:45.262289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:45.262255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:45.363518 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:45.363485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:45.476519 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:45.476432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:45.820590 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:45.820557    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:45.916356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:45.916305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:46.016687 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:46.016651    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:07:55.189684 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.189641    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:55.267519 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.267489    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wz4nb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 02:07:55.267619 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.267557    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podUID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 02:07:55.373249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.373216    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:07:55.777005 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.776969    2562 generic.go:356] "Generic (PLEG): container finished" podID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerID="4471958b3dcee20997f72d088ecd950aabcd5a9d0226c25e75f9646a80d7eba6" exitCode=0
Sep 08 02:07:55.777174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.777016    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" event={"ID":"ea9e7152-e1e9-4c84-9b39-a045f055fc02","Type":"ContainerDied","Data":"4471958b3dcee20997f72d088ecd950aabcd5a9d0226c25e75f9646a80d7eba6"}
Sep 08 02:07:55.777389 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.777375    2562 scope.go:117] "RemoveContainer" containerID="4471958b3dcee20997f72d088ecd950aabcd5a9d0226c25e75f9646a80d7eba6"
Sep 08 02:07:55.778339 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.778311    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:07:55.778431 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.778375    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:07:55.778431 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:55.778409    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:07:56.783983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:56.783881    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" event={"ID":"ea9e7152-e1e9-4c84-9b39-a045f055fc02","Type":"ContainerStarted","Data":"3bb6444574832a2c776a9c5c7217507f76d24d04e0f564af4c5d7bdeb3509e28"}
Sep 08 02:07:57.046097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:57.045356    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:07:57.046097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:57.045769    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wz4nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 02:07:57.046097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:57.045816    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podUID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 02:07:58.046372 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:58.046334    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wz4nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 02:07:58.047003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:58.046967    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podUID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 02:07:59.045792 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:59.045752    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wz4nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 02:07:59.046134 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:07:59.046103    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podUID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 02:08:00.046336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:00.046288    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wz4nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 02:08:00.046861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:00.046380    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podUID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 02:08:01.045596 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:01.045549    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-wz4nb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 08 02:08:01.045811 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:01.045638    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb" podUID="ea9e7152-e1e9-4c84-9b39-a045f055fc02" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 08 02:08:02.049745 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:02.049714    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:08:02.050198 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:02.049964    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:08:02.050740 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:02.050719    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-wz4nb"
Sep 08 02:08:06.146669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:06.146632    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:08:06.517523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:06.517435    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:08:31.250279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:31.250247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:08:32.010124 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:08:32.010089    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:09:03.001280 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:03.001253    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:09:03.001785 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:03.001263    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:09:05.555230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:05.555194    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:09:06.308407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:06.308374    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:09:20.146370 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:20.146336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:09:21.312992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:21.312956    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:09:28.504115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.504034    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"]
Sep 08 02:09:28.507578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.507556    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.511443 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.511417    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 02:09:28.511571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.511417    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 02:09:28.511571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.511480    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 08 02:09:28.511571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.511486    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x2jnv\""
Sep 08 02:09:28.516533 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.516512    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"]
Sep 08 02:09:28.608897 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.608864    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.609073 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.608905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.609073 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.608987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6542bf9-2373-4222-880e-7df50c7b8d23-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.609073 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.609054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gmvv\" (UniqueName: \"kubernetes.io/projected/a6542bf9-2373-4222-880e-7df50c7b8d23-kube-api-access-7gmvv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.609324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.609096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.609324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.609113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.622146 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.622109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:09:28.710078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710083    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710294 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6542bf9-2373-4222-880e-7df50c7b8d23-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710294 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710145    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gmvv\" (UniqueName: \"kubernetes.io/projected/a6542bf9-2373-4222-880e-7df50c7b8d23-kube-api-access-7gmvv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710294 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710451 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710600 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710670 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710627    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.710670 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.710654    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.712449 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.712429    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a6542bf9-2373-4222-880e-7df50c7b8d23-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.712775 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.712756    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a6542bf9-2373-4222-880e-7df50c7b8d23-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.717598 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.717574    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gmvv\" (UniqueName: \"kubernetes.io/projected/a6542bf9-2373-4222-880e-7df50c7b8d23-kube-api-access-7gmvv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84\" (UID: \"a6542bf9-2373-4222-880e-7df50c7b8d23\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:28.819249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:28.819213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:29.095135 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:29.095112    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"]
Sep 08 02:09:29.097318 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:09:29.097291    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6542bf9_2373_4222_880e_7df50c7b8d23.slice/crio-76433238f8e1455631665025e58db8c593410520b6b7c31b04f9e9c9a00de621 WatchSource:0}: Error finding container 76433238f8e1455631665025e58db8c593410520b6b7c31b04f9e9c9a00de621: Status 404 returned error can't find the container with id 76433238f8e1455631665025e58db8c593410520b6b7c31b04f9e9c9a00de621
Sep 08 02:09:29.098587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:29.098566    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 02:09:29.223672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:29.223634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84" event={"ID":"a6542bf9-2373-4222-880e-7df50c7b8d23","Type":"ContainerStarted","Data":"76433238f8e1455631665025e58db8c593410520b6b7c31b04f9e9c9a00de621"}
Sep 08 02:09:30.229929 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:30.229886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84" event={"ID":"a6542bf9-2373-4222-880e-7df50c7b8d23","Type":"ContainerStarted","Data":"4f403ae3d96c45095f3c7f94716d5c4f243b9f158fa85a6687bc045db4d411cb"}
Sep 08 02:09:30.248742 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:30.248694    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84" podStartSLOduration=1.289400018 podStartE2EDuration="2.248678753s" totalImagesPullingTime="959.278735ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:09:30.246775367 +0000 UTC m=+627.702390312" watchObservedRunningTime="2026-09-08 02:09:30.248678753 +0000 UTC m=+627.704293666"
Sep 08 02:09:30.305034 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:30.304997    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:09:38.819543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:38.819505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:38.820075 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:38.819685    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:38.831873 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:38.831849    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:39.286747 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:39.286721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84"
Sep 08 02:09:40.311004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.310971    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"]
Sep 08 02:09:40.315443 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.315308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.318147 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.318122    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 02:09:40.325944 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.325890    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"]
Sep 08 02:09:40.342938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.342893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:09:40.424008 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.423981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.424175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.424053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.424175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.424147    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.424271 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.424253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr97q\" (UniqueName: \"kubernetes.io/projected/7939e3e1-76ab-4098-8481-53be5266ddfc-kube-api-access-fr97q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.424335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.424317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7939e3e1-76ab-4098-8481-53be5266ddfc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.424415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.424400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525086 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525047    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525086 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525085    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr97q\" (UniqueName: \"kubernetes.io/projected/7939e3e1-76ab-4098-8481-53be5266ddfc-kube-api-access-fr97q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525330 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7939e3e1-76ab-4098-8481-53be5266ddfc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525330 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525330 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525330 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525505    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525518    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.525637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.525618    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.527466 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.527433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7939e3e1-76ab-4098-8481-53be5266ddfc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.527721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.527698    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7939e3e1-76ab-4098-8481-53be5266ddfc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.534240 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.534222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr97q\" (UniqueName: \"kubernetes.io/projected/7939e3e1-76ab-4098-8481-53be5266ddfc-kube-api-access-fr97q\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cm5zp\" (UID: \"7939e3e1-76ab-4098-8481-53be5266ddfc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.628423 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.628333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:40.901615 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:40.901591    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"]
Sep 08 02:09:40.903682 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:09:40.903652    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7939e3e1_76ab_4098_8481_53be5266ddfc.slice/crio-f387682155503b18090963085e61691446c4dc6e9a93f081d9796327908d87e3 WatchSource:0}: Error finding container f387682155503b18090963085e61691446c4dc6e9a93f081d9796327908d87e3: Status 404 returned error can't find the container with id f387682155503b18090963085e61691446c4dc6e9a93f081d9796327908d87e3
Sep 08 02:09:41.286502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:41.286458    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp" event={"ID":"7939e3e1-76ab-4098-8481-53be5266ddfc","Type":"ContainerStarted","Data":"efd911650c8dd07e8711ebe4ff72a870380f9f49d6f304a2866d96b681bd4d09"}
Sep 08 02:09:41.286698 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:41.286522    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp" event={"ID":"7939e3e1-76ab-4098-8481-53be5266ddfc","Type":"ContainerStarted","Data":"f387682155503b18090963085e61691446c4dc6e9a93f081d9796327908d87e3"}
Sep 08 02:09:41.304835 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:41.304778    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp" podStartSLOduration=1.112742529 podStartE2EDuration="1.304760475s" totalImagesPullingTime="192.017946ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:09:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:09:41.302705552 +0000 UTC m=+638.758320494" watchObservedRunningTime="2026-09-08 02:09:41.304760475 +0000 UTC m=+638.760375381"
Sep 08 02:09:42.311703 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:42.311669    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:09:50.629083 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:50.629042    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:50.629556 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:50.629110    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:50.641825 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:50.641803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:51.353895 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:51.353864    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cm5zp"
Sep 08 02:09:58.039949 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:09:58.039889    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:10:00.218388 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:10:00.218351    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:10:15.048900 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:10:15.048861    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:00.834419 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:00.834387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:00.929110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:00.929076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:01.960348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:01.960311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:02.060609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:02.060581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:17.613509 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:17.613470    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:17.750214 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:17.750182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:18.010568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.010481    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"]
Sep 08 02:11:18.014026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.014006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.017152 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.017134    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-5d27de-openshift-default-dockercfg-5ghjc\""
Sep 08 02:11:18.025055 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.025030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:18.029377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-certs\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-podinfo\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-envoy\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-credential-socket\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-socket\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-token\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istiod-ca-cert\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzwgn\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-kube-api-access-dzwgn\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.029683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.029660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-data\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.036076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.036048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"]
Sep 08 02:11:18.130178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-certs\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-podinfo\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-envoy\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-credential-socket\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-socket\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130287    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-token\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istiod-ca-cert\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzwgn\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-kube-api-access-dzwgn\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-data\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-credential-socket\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-socket\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130858 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-certs\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.130900 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.130855    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-data\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.131096 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.131073    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istiod-ca-cert\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.132638 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.132619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-envoy\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.133050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.133033    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-podinfo\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.138552 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.138529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-token\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.139158 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.139141    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzwgn\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-kube-api-access-dzwgn\") pod \"e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") " pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.219393 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.219357    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:18.324240 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.324205    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:18.596362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.596336    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"]
Sep 08 02:11:18.599046 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:11:18.599018    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9042c1a_1dd4_481b_b1ab_522d29813ab3.slice/crio-474ef844c3550291704b3b403df4b68a8279500a0617ff0654d174b10a54010b WatchSource:0}: Error finding container 474ef844c3550291704b3b403df4b68a8279500a0617ff0654d174b10a54010b: Status 404 returned error can't find the container with id 474ef844c3550291704b3b403df4b68a8279500a0617ff0654d174b10a54010b
Sep 08 02:11:18.601279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.601246    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:18.601355 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.601316    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:18.601355 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.601343    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:18.798737 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.798702    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" event={"ID":"f9042c1a-1dd4-481b-b1ab-522d29813ab3","Type":"ContainerStarted","Data":"7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"}
Sep 08 02:11:18.799279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.798752    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" event={"ID":"f9042c1a-1dd4-481b-b1ab-522d29813ab3","Type":"ContainerStarted","Data":"474ef844c3550291704b3b403df4b68a8279500a0617ff0654d174b10a54010b"}
Sep 08 02:11:18.819511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:18.819454    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podStartSLOduration=1.819432331 podStartE2EDuration="1.819432331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:11:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:11:18.816885525 +0000 UTC m=+736.272500463" watchObservedRunningTime="2026-09-08 02:11:18.819432331 +0000 UTC m=+736.275047245"
Sep 08 02:11:19.032771 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.032691    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:19.134591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.134559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:19.324535 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.324500    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:19.329365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.329338    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:19.471628 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.471589    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:19.803845 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.803816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:19.804860 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:19.804840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:20.746313 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:20.746282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:20.844171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:20.844130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:21.527424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:21.527387    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:11:21.898101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:21.898071    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:21.999868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:21.999835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:22.249999 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:22.249903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:22.497613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:22.497579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:22.569070 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:22.569042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.001643 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.001610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.054059 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.054029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.217324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.217294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.317405 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.317372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.440500 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.440468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.738704 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.738626    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"]
Sep 08 02:11:25.743171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.743149    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.746186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.746165    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-213d54df-openshift-default-dockercfg-4dplz\""
Sep 08 02:11:25.755179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.755156    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"]
Sep 08 02:11:25.767753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.767718    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:25.807150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-envoy\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807278 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-credential-socket\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807278 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807218    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-token\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807278 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp5m6\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-kube-api-access-jp5m6\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807427 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-certs\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807427 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-socket\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807427 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807393    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istiod-ca-cert\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807427 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-data\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.807564 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.807478    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-podinfo\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908053    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-envoy\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-credential-socket\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-token\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908162    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jp5m6\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-kube-api-access-jp5m6\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-certs\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908230    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-socket\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istiod-ca-cert\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-data\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908701 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908344    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-podinfo\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908701 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-credential-socket\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908701 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908693    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-socket\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908761    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-data\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.908897 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.908880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-certs\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.909036 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.909017    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istiod-ca-cert\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.910412 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.910391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-envoy\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.910780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.910762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-podinfo\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.917485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.917457    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-token\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:25.918156 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:25.918138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp5m6\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-kube-api-access-jp5m6\") pod \"e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") " pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:26.056171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.056140    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:26.333690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.333661    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"]
Sep 08 02:11:26.335955 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:11:26.335929    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba305cd_5f22_4048_9a17_3d31c9fa27f3.slice/crio-3da8f7463a66f8cc80cba9ac7f2dbf7d3f0d3cb248a824866c8b26e719f91c39 WatchSource:0}: Error finding container 3da8f7463a66f8cc80cba9ac7f2dbf7d3f0d3cb248a824866c8b26e719f91c39: Status 404 returned error can't find the container with id 3da8f7463a66f8cc80cba9ac7f2dbf7d3f0d3cb248a824866c8b26e719f91c39
Sep 08 02:11:26.338067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.338033    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:26.338140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.338106    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:26.338140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.338136    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:26.508446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.508408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:26.850936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.850881    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" event={"ID":"7ba305cd-5f22-4048-9a17-3d31c9fa27f3","Type":"ContainerStarted","Data":"5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"}
Sep 08 02:11:26.851103 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.850960    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" event={"ID":"7ba305cd-5f22-4048-9a17-3d31c9fa27f3","Type":"ContainerStarted","Data":"3da8f7463a66f8cc80cba9ac7f2dbf7d3f0d3cb248a824866c8b26e719f91c39"}
Sep 08 02:11:26.876024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:26.875973    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podStartSLOduration=1.87595846 podStartE2EDuration="1.87595846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:11:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:11:26.873718642 +0000 UTC m=+744.329333596" watchObservedRunningTime="2026-09-08 02:11:26.87595846 +0000 UTC m=+744.331573373"
Sep 08 02:11:27.056537 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.056505    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:27.061402 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.061376    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:27.115097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.115008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:27.378961 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.378858    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"]
Sep 08 02:11:27.382262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.382240    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.384817 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.384792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-308137-openshift-default-dockercfg-wh54r\""
Sep 08 02:11:27.394647 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.394623    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"]
Sep 08 02:11:27.418094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.418070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:27.424132 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-socket\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424250 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-token\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424250 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-certs\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424250 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-data\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424279    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-podinfo\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istiod-ca-cert\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvx2f\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-kube-api-access-gvx2f\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424354    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-credential-socket\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.424587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.424487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-envoy\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525306 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-envoy\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-socket\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525433    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-token\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525557 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-certs\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525557 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-data\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525576    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-podinfo\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525608    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istiod-ca-cert\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525646    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-socket\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvx2f\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-kube-api-access-gvx2f\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-credential-socket\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525762    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-certs\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.525996 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.525871    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-data\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.526093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.526072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-credential-socket\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.526334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.526305    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istiod-ca-cert\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.527702 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.527682    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-envoy\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.528140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.528120    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-podinfo\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.534165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.534137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-token\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.534376 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.534358    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvx2f\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-kube-api-access-gvx2f\") pod \"e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") " pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.694469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.694382    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:27.796927 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.796879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:27.857552 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.857450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:27.859570 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.858965    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:27.968872 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.968844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"]
Sep 08 02:11:27.970499 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:11:27.970465    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44f5b707_4dc6_4c92_84a8_ec658bc6a44e.slice/crio-4732083f231a885d953efa28b150c481d1799e42f9a2693166f625d7f5289049 WatchSource:0}: Error finding container 4732083f231a885d953efa28b150c481d1799e42f9a2693166f625d7f5289049: Status 404 returned error can't find the container with id 4732083f231a885d953efa28b150c481d1799e42f9a2693166f625d7f5289049
Sep 08 02:11:27.973032 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.972997    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:27.973105 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.973080    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:27.973150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:27.973125    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:28.010119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.010093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:28.113134 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.113091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:28.219482 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.219336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:28.314131 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.314094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:28.863277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.863248    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" event={"ID":"44f5b707-4dc6-4c92-84a8-ec658bc6a44e","Type":"ContainerStarted","Data":"0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"}
Sep 08 02:11:28.863466 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.863297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" event={"ID":"44f5b707-4dc6-4c92-84a8-ec658bc6a44e","Type":"ContainerStarted","Data":"4732083f231a885d953efa28b150c481d1799e42f9a2693166f625d7f5289049"}
Sep 08 02:11:28.887393 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:28.887346    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podStartSLOduration=1.887330048 podStartE2EDuration="1.887330048s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:11:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:11:28.886869755 +0000 UTC m=+746.342484668" watchObservedRunningTime="2026-09-08 02:11:28.887330048 +0000 UTC m=+746.342944960"
Sep 08 02:11:29.506276 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.506237    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:29.603487 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.603450    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:29.695367 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.695332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:29.700974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.700946    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:29.752757 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.752725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:29.868326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.868300    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:29.869317 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.869292    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:29.979096 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:29.979058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:30.070323 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:30.070287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:30.851780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:30.851721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:30.939975 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:30.939935    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:32.241938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:32.239671    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:32.340409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:32.340368    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:32.478572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:32.478541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:32.687373 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:32.687344    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:32.784118 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:32.784087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:33.400481 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:33.400453    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:36.555471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:36.555437    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:36.704523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:36.704477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:36.801580 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:36.801539    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:36.900359 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:36.900261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:37.018529 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:37.018493    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:11:38.923243 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:38.923202    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerID="7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e" exitCode=0
Sep 08 02:11:38.923658 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:38.923253    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" event={"ID":"f9042c1a-1dd4-481b-b1ab-522d29813ab3","Type":"ContainerDied","Data":"7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"}
Sep 08 02:11:38.923861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:38.923841    2562 scope.go:117] "RemoveContainer" containerID="7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"
Sep 08 02:11:38.925202 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:38.925166    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:38.925349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:38.925256    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:38.925349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:38.925302    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:39.603736 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:39.603700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:39.933568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:39.932689    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" event={"ID":"f9042c1a-1dd4-481b-b1ab-522d29813ab3","Type":"ContainerStarted","Data":"74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a"}
Sep 08 02:11:40.324835 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:40.324803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:40.325276 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:40.325244    2562 patch_prober.go:28] interesting pod/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 02:11:40.325387 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:40.325302    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 02:11:41.170946 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:41.170896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:41.325399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:41.325361    2562 patch_prober.go:28] interesting pod/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 02:11:41.325705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:41.325674    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 02:11:42.043180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:42.043141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:42.144680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:42.144545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:42.325053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:42.324945    2562 patch_prober.go:28] interesting pod/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 02:11:42.325053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:42.325021    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 02:11:43.036684 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:43.036635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:43.325154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:43.325052    2562 patch_prober.go:28] interesting pod/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 02:11:43.325154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:43.325127    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 02:11:44.325494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:44.325452    2562 patch_prober.go:28] interesting pod/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 02:11:44.326109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:44.326074    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 02:11:45.329939 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:45.324908    2562 patch_prober.go:28] interesting pod/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 08 02:11:45.329939 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:45.325003    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 08 02:11:45.675413 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:45.675379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:45.911124 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:45.911066    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:11:45.911318 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:45.911148    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:11:45.943395 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:45.943288    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:46.225419 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.225321    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"]
Sep 08 02:11:46.235067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.234796    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"]
Sep 08 02:11:46.235067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.234963    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.240558 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.240531    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-8d800a-openshift-default-dockercfg-r64nc\""
Sep 08 02:11:46.244333 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.244268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:46.259398 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-envoy\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-podinfo\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-token\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259513    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-socket\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259552    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-credential-socket\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259584    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9pmq\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-kube-api-access-h9pmq\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-data\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259691    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-certs\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.259962 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.259722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istiod-ca-cert\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.360709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360544    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9pmq\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-kube-api-access-h9pmq\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.360709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360614    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-data\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.360709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-certs\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istiod-ca-cert\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360786    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-envoy\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-podinfo\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360871    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-token\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.360989    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-socket\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.361032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-credential-socket\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.361114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-data\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.361734 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.361561    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istiod-ca-cert\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.362039 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.361881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-credential-socket\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.362188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.362042    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-socket\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.362254 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.362198    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-certs\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.365814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.365788    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-podinfo\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.367111 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.367089    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-envoy\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.392768 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.392731    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-token\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.392957 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.392834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9pmq\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-kube-api-access-h9pmq\") pod \"e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") " pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.499473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.499365    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:46.547121 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.547085    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:46.547656 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.547620    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:46.548948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.548892    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:11:46.558339 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.558304    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:46.860963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.860936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"]
Sep 08 02:11:46.864627 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:11:46.864594    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaed437e3_e7e7_4b22_baa4_88aaba2feeae.slice/crio-20da5c4dd115430898c2750cd28971f706517095ecf7a90df00aecc8e2955403 WatchSource:0}: Error finding container 20da5c4dd115430898c2750cd28971f706517095ecf7a90df00aecc8e2955403: Status 404 returned error can't find the container with id 20da5c4dd115430898c2750cd28971f706517095ecf7a90df00aecc8e2955403
Sep 08 02:11:46.867716 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.867679    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:46.867827 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.867772    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:46.867891 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.867823    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:46.989469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.989335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" event={"ID":"aed437e3-e7e7-4b22-baa4-88aaba2feeae","Type":"ContainerStarted","Data":"837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"}
Sep 08 02:11:46.989469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:46.989408    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" event={"ID":"aed437e3-e7e7-4b22-baa4-88aaba2feeae","Type":"ContainerStarted","Data":"20da5c4dd115430898c2750cd28971f706517095ecf7a90df00aecc8e2955403"}
Sep 08 02:11:47.014773 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:47.013546    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podStartSLOduration=1.013524544 podStartE2EDuration="1.013524544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:11:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:11:47.011336159 +0000 UTC m=+764.466951091" watchObservedRunningTime="2026-09-08 02:11:47.013524544 +0000 UTC m=+764.469139460"
Sep 08 02:11:47.559227 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:47.559182    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:47.567336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:47.567304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:47.996478 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:47.996363    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:47.997158 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:47.997130    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:11:48.879174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:48.879138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:48.978960 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:48.978925    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:49.003464 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.003435    2562 generic.go:356] "Generic (PLEG): container finished" podID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerID="5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39" exitCode=0
Sep 08 02:11:49.003651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.003506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" event={"ID":"7ba305cd-5f22-4048-9a17-3d31c9fa27f3","Type":"ContainerDied","Data":"5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"}
Sep 08 02:11:49.004021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.004003    2562 scope.go:117] "RemoveContainer" containerID="5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"
Sep 08 02:11:49.005217 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.005195    2562 generic.go:356] "Generic (PLEG): container finished" podID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerID="0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8" exitCode=0
Sep 08 02:11:49.005317 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.005266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" event={"ID":"44f5b707-4dc6-4c92-84a8-ec658bc6a44e","Type":"ContainerDied","Data":"0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"}
Sep 08 02:11:49.005317 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.005268    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:49.005420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.005342    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:49.005420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.005376    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:49.005646 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.005630    2562 scope.go:117] "RemoveContainer" containerID="0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"
Sep 08 02:11:49.006635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.006608    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:49.006721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.006683    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:49.006777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.006731    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:11:49.646298 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.646260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:49.746460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:49.746428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:50.013938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.013837    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" event={"ID":"7ba305cd-5f22-4048-9a17-3d31c9fa27f3","Type":"ContainerStarted","Data":"d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23"}
Sep 08 02:11:50.016160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.016129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" event={"ID":"44f5b707-4dc6-4c92-84a8-ec658bc6a44e","Type":"ContainerStarted","Data":"4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07"}
Sep 08 02:11:50.057102 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.057068    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:50.057412 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.057376    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:50.057562 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.057425    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:50.057562 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.057475    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:50.135442 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.135339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:50.231430 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.231374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:50.593609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.593561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:50.680544 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.680509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:50.695363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.695294    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:50.695704 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.695656    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 02:11:50.695972 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:50.695938    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 02:11:51.029045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.028952    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:51.056976 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.056932    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:51.057176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.057017    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:51.617151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.617116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:11:51.694728 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.694691    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 02:11:51.694900 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.694741    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 02:11:51.736332 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:51.736293    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:52.056974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:52.056930    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:52.057484 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:52.057003    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:52.423351 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:52.423255    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:52.694886 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:52.694807    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 02:11:52.695119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:52.695088    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 02:11:53.057145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.057101    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:53.057703 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.057173    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:53.115196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.115158    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:53.689359 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.689320    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"]
Sep 08 02:11:53.692807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.692790    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:11:53.695176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.695152    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 02:11:53.695262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.695193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:11:53.695262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.695211    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:11:53.695262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.695215    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 02:11:53.700346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.700324    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"]
Sep 08 02:11:53.769937 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.768632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acaf172-4868-40ff-850c-75c23db96636-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-213d54df-n5mkv\" (UID: \"7acaf172-4868-40ff-850c-75c23db96636\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:11:53.870960 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.870220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acaf172-4868-40ff-850c-75c23db96636-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-213d54df-n5mkv\" (UID: \"7acaf172-4868-40ff-850c-75c23db96636\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:11:53.871198 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:53.871149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acaf172-4868-40ff-850c-75c23db96636-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-213d54df-n5mkv\" (UID: \"7acaf172-4868-40ff-850c-75c23db96636\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:11:54.004964 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.004841    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:11:54.061999 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.060325    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:54.061999 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.060399    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:54.320868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.320841    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"]
Sep 08 02:11:54.322259 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:11:54.322215    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acaf172_4868_40ff_850c_75c23db96636.slice/crio-5890ebffb864a35765f6283f9db370493bc7f008f073595e4220059928e0fce6 WatchSource:0}: Error finding container 5890ebffb864a35765f6283f9db370493bc7f008f073595e4220059928e0fce6: Status 404 returned error can't find the container with id 5890ebffb864a35765f6283f9db370493bc7f008f073595e4220059928e0fce6
Sep 08 02:11:54.361544 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.361499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:54.695419 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.695330    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 08 02:11:54.695419 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.695389    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 08 02:11:54.992139 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:54.992048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:55.057190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.057138    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:55.057402 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.057215    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:55.079089 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.079046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv" event={"ID":"7acaf172-4868-40ff-850c-75c23db96636","Type":"ContainerStarted","Data":"5890ebffb864a35765f6283f9db370493bc7f008f073595e4220059928e0fce6"}
Sep 08 02:11:55.684890 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.684853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:11:55.699123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.699093    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:55.699472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.699424    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:55.700112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:55.700092    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:11:56.057409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:56.057368    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused" start-of-body=
Sep 08 02:11:56.057595 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:56.057441    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.33:15021/healthz/ready\": dial tcp 10.134.0.33:15021: connect: connection refused"
Sep 08 02:11:57.062068 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:57.062036    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:57.062512 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:57.062420    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:57.063229 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:57.063205    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:11:58.096886 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:58.096794    2562 generic.go:356] "Generic (PLEG): container finished" podID="7acaf172-4868-40ff-850c-75c23db96636" containerID="6606ce6eddfa46e1573a1b4bd957f6899e88977ab81a07819e8b7eb4ca5b9c40" exitCode=0
Sep 08 02:11:58.097257 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:58.096886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv" event={"ID":"7acaf172-4868-40ff-850c-75c23db96636","Type":"ContainerDied","Data":"6606ce6eddfa46e1573a1b4bd957f6899e88977ab81a07819e8b7eb4ca5b9c40"}
Sep 08 02:11:59.275744 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:59.275717    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:11:59.353574 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:59.353488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acaf172-4868-40ff-850c-75c23db96636-maas-api-service-ca\") pod \"7acaf172-4868-40ff-850c-75c23db96636\" (UID: \"7acaf172-4868-40ff-850c-75c23db96636\") "
Sep 08 02:11:59.353811 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:59.353789    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7acaf172-4868-40ff-850c-75c23db96636-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7acaf172-4868-40ff-850c-75c23db96636" (UID: "7acaf172-4868-40ff-850c-75c23db96636"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:11:59.455026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:11:59.454986    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acaf172-4868-40ff-850c-75c23db96636-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:00.107953 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:00.107907    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"
Sep 08 02:12:00.108151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:00.107947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv" event={"ID":"7acaf172-4868-40ff-850c-75c23db96636","Type":"ContainerDied","Data":"5890ebffb864a35765f6283f9db370493bc7f008f073595e4220059928e0fce6"}
Sep 08 02:12:00.108151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:00.108001    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5890ebffb864a35765f6283f9db370493bc7f008f073595e4220059928e0fce6"
Sep 08 02:12:03.411027 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:03.410939    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:12:06.141205 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:06.141116    2562 generic.go:356] "Generic (PLEG): container finished" podID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerID="837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184" exitCode=0
Sep 08 02:12:06.141205 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:06.141175    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" event={"ID":"aed437e3-e7e7-4b22-baa4-88aaba2feeae","Type":"ContainerDied","Data":"837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"}
Sep 08 02:12:06.141630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:06.141597    2562 scope.go:117] "RemoveContainer" containerID="837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"
Sep 08 02:12:06.142744 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:06.142718    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:06.142806 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:06.142795    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:06.142854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:06.142843    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:07.152072 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:07.152035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" event={"ID":"aed437e3-e7e7-4b22-baa4-88aaba2feeae","Type":"ContainerStarted","Data":"81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257"}
Sep 08 02:12:07.559026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:07.558990    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:12:07.559249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:07.559227    2562 patch_prober.go:28] interesting pod/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 02:12:07.559297 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:07.559275    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 02:12:08.559268 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:08.559230    2562 patch_prober.go:28] interesting pod/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 02:12:08.559660 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:08.559291    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 02:12:09.558930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:09.558882    2562 patch_prober.go:28] interesting pod/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 02:12:09.559114 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:09.558983    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 02:12:09.678523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:09.678488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:10.225089 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.225051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:10.291668 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.291641    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:10.354550 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.354516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:10.409497 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.409457    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"]
Sep 08 02:12:10.411678 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.411653    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-213d54df-n5mkv"]
Sep 08 02:12:10.418633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.418610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:10.478059 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.477974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:10.560939 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.560271    2562 patch_prober.go:28] interesting pod/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 02:12:10.560939 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.560333    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 02:12:10.569763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.568453    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"]
Sep 08 02:12:10.569763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.568743    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" containerID="cri-o://d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23" gracePeriod=30
Sep 08 02:12:10.582063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:10.582025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.009749 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.009706    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.070017 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.069983    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7acaf172-4868-40ff-850c-75c23db96636" path="/var/lib/kubelet/pods/7acaf172-4868-40ff-850c-75c23db96636/volumes"
Sep 08 02:12:11.110233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.110199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.204649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.204618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.271672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.271570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.520209 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.520177    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"]
Sep 08 02:12:11.520707 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.520689    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7acaf172-4868-40ff-850c-75c23db96636" containerName="revoke-keys"
Sep 08 02:12:11.520707 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.520707    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7acaf172-4868-40ff-850c-75c23db96636" containerName="revoke-keys"
Sep 08 02:12:11.520843 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.520774    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7acaf172-4868-40ff-850c-75c23db96636" containerName="revoke-keys"
Sep 08 02:12:11.524269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.524220    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.531147 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.529076    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-ea979531-gw-openshift-default-dockercfg-gpwxm\""
Sep 08 02:12:11.554254 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.554223    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"]
Sep 08 02:12:11.559609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.559578    2562 patch_prober.go:28] interesting pod/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused" start-of-body=
Sep 08 02:12:11.559839 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.559810    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.35:15021/healthz/ready\": dial tcp 10.134.0.35:15021: connect: connection refused"
Sep 08 02:12:11.585969 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.585935    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-socket\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.585969 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.585970    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-certs\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.585987    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-data\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.586042    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a68570b-1348-4224-a69c-29b4a7fcf36c-istiod-ca-cert\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.586114    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-envoy\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586251 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.586184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-credential-socket\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586251 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.586215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-podinfo\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.586249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-token\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.586314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.586269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dk7c\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-kube-api-access-8dk7c\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.624524 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.624467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.686942 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.686879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-credential-socket\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.686957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-podinfo\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-token\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dk7c\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-kube-api-access-8dk7c\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-socket\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687142    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-certs\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687169    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-data\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687207    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a68570b-1348-4224-a69c-29b4a7fcf36c-istiod-ca-cert\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-envoy\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.687905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687878    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-certs\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.688105 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.687953    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-data\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.688214 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.688152    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-socket\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.688344 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.688320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-credential-socket\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.688391 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.688371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a68570b-1348-4224-a69c-29b4a7fcf36c-istiod-ca-cert\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.689761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.689742    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-envoy\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.690123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.690104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-podinfo\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.697011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.696982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-token\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.697761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.697739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dk7c\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-kube-api-access-8dk7c\") pod \"e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") " pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:11.835529 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.835483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:11.856923 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:11.856881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:12.064744 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.064704    2562 patch_prober.go:28] interesting pod/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:12:12.065131 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.064774    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:12:12.138195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.138085    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"]
Sep 08 02:12:12.148040 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:12:12.148015    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a68570b_1348_4224_a69c_29b4a7fcf36c.slice/crio-f78ebedd86b691181da184a960c80a41537774cc56917956e9bd3396f5d2223f WatchSource:0}: Error finding container f78ebedd86b691181da184a960c80a41537774cc56917956e9bd3396f5d2223f: Status 404 returned error can't find the container with id f78ebedd86b691181da184a960c80a41537774cc56917956e9bd3396f5d2223f
Sep 08 02:12:12.154044 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.154007    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:12.154157 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.154101    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:12.154216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.154170    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:12.179532 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.179506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" event={"ID":"6a68570b-1348-4224-a69c-29b4a7fcf36c","Type":"ContainerStarted","Data":"f78ebedd86b691181da184a960c80a41537774cc56917956e9bd3396f5d2223f"}
Sep 08 02:12:12.666960 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.666926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:12:12.667347 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.667325    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:12:12.668117 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:12.668086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:12:13.186107 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:13.186073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" event={"ID":"6a68570b-1348-4224-a69c-29b4a7fcf36c","Type":"ContainerStarted","Data":"08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"}
Sep 08 02:12:13.207770 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:13.207714    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podStartSLOduration=2.207698445 podStartE2EDuration="2.207698445s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:12:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:12:13.206388109 +0000 UTC m=+790.662003043" watchObservedRunningTime="2026-09-08 02:12:13.207698445 +0000 UTC m=+790.663313358"
Sep 08 02:12:13.839909 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:13.839874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:13.857816 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:13.857795    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:13.863170 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:13.863147    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:14.191326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:14.191237    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:14.192116 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:14.192095    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:14.636300 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:14.636265    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:14.731258 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:14.731225    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:14.791008 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:14.790972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:15.212069 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.212037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:15.370572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.370541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:15.522257 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.522174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:15.836788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.836764    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:12:15.937669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937637    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jp5m6\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-kube-api-access-jp5m6\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.937851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937700    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-credential-socket\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.937851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-podinfo\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.937851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937768    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-envoy\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.937851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istiod-ca-cert\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.937851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937831    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-token\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.937851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937853    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-data\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.938190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.937898    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-socket\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.938190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938028    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-certs\") pod \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\" (UID: \"7ba305cd-5f22-4048-9a17-3d31c9fa27f3\") "
Sep 08 02:12:15.938190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938048    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:15.938361 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938287    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:15.938361 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938321    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:12:15.938471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938395    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:15.938471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938415    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:15.938471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938428    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:15.938471 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938466    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:15.938677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.938526    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:15.940119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.940087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:12:15.940119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.940106    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-kube-api-access-jp5m6" (OuterVolumeSpecName: "kube-api-access-jp5m6") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "kube-api-access-jp5m6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:12:15.940285 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.940266    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:15.940501 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:15.940480    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "7ba305cd-5f22-4048-9a17-3d31c9fa27f3" (UID: "7ba305cd-5f22-4048-9a17-3d31c9fa27f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:12:16.039731 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.039700    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:16.039731 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.039725    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jp5m6\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-kube-api-access-jp5m6\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:16.039731 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.039736    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:16.039983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.039746    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:16.039983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.039754    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:16.039983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.039761    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7ba305cd-5f22-4048-9a17-3d31c9fa27f3-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:16.203680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.203600    2562 generic.go:356] "Generic (PLEG): container finished" podID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerID="d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23" exitCode=0
Sep 08 02:12:16.203680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.203649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"
Sep 08 02:12:16.203868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.203680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" event={"ID":"7ba305cd-5f22-4048-9a17-3d31c9fa27f3","Type":"ContainerDied","Data":"d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23"}
Sep 08 02:12:16.203868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.203730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d" event={"ID":"7ba305cd-5f22-4048-9a17-3d31c9fa27f3","Type":"ContainerDied","Data":"3da8f7463a66f8cc80cba9ac7f2dbf7d3f0d3cb248a824866c8b26e719f91c39"}
Sep 08 02:12:16.203868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.203756    2562 scope.go:117] "RemoveContainer" containerID="d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23"
Sep 08 02:12:16.213671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.213654    2562 scope.go:117] "RemoveContainer" containerID="5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"
Sep 08 02:12:16.221672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.221658    2562 scope.go:117] "RemoveContainer" containerID="d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23"
Sep 08 02:12:16.221944 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:12:16.221902    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23\": container with ID starting with d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23 not found: ID does not exist" containerID="d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23"
Sep 08 02:12:16.222044 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.221973    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23"} err="failed to get container status \"d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23\": rpc error: code = NotFound desc = could not find container \"d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23\": container with ID starting with d2f374e28b8c4975b60ab644c7db2040c8c87041cf33de792bb551e0c2e1fe23 not found: ID does not exist"
Sep 08 02:12:16.222044 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.221995    2562 scope.go:117] "RemoveContainer" containerID="5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"
Sep 08 02:12:16.222394 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:12:16.222367    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39\": container with ID starting with 5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39 not found: ID does not exist" containerID="5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"
Sep 08 02:12:16.222569 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.222401    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39"} err="failed to get container status \"5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39\": rpc error: code = NotFound desc = could not find container \"5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39\": container with ID starting with 5fccae476ec30510432a46e5feb4a37628ea6db612ab32f8dc4af6b54e98cd39 not found: ID does not exist"
Sep 08 02:12:16.225161 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.225141    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"]
Sep 08 02:12:16.228905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:16.228885    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-213d54df-openshift-default-5456fdfd6-rm62d"]
Sep 08 02:12:17.072028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:17.071997    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" path="/var/lib/kubelet/pods/7ba305cd-5f22-4048-9a17-3d31c9fa27f3/volumes"
Sep 08 02:12:17.513073 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:17.512982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:12:26.007213 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:26.007168    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:27.901165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:27.901126    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:28.000784 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:28.000746    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:28.116407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:28.116371    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:29.193025 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.192991    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 02:12:29.193443 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.193051    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 02:12:29.283331 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.283296    2562 generic.go:356] "Generic (PLEG): container finished" podID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerID="08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab" exitCode=0
Sep 08 02:12:29.283573 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.283371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" event={"ID":"6a68570b-1348-4224-a69c-29b4a7fcf36c","Type":"ContainerDied","Data":"08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"}
Sep 08 02:12:29.283930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.283893    2562 scope.go:117] "RemoveContainer" containerID="08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"
Sep 08 02:12:29.285063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.285026    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:29.285177 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.285091    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:29.285177 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:29.285123    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:30.292360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:30.292327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" event={"ID":"6a68570b-1348-4224-a69c-29b4a7fcf36c","Type":"ContainerStarted","Data":"12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a"}
Sep 08 02:12:30.343478 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:30.343440    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:30.858011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:30.857977    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:30.858262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:30.858241    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 02:12:30.858310 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:30.858285    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 02:12:31.857874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:31.857834    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 02:12:31.858394 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:31.857934    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 02:12:32.012713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:32.012675    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:12:32.858076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:32.858037    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 02:12:32.858446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:32.858093    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 02:12:33.585094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.585057    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:33.649586 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.649537    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:33.723682 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.723645    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:33.823755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.823725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:33.857782 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.857690    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 02:12:33.857782 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.857764    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 02:12:33.928179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:33.928138    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:34.857710 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:34.857673    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 08 02:12:34.857892 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:34.857729    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 08 02:12:35.861195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:35.861164    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:35.861589 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:35.861434    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:35.862180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:35.862164    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:39.599019 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.598977    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"]
Sep 08 02:12:39.599583 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.599562    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy"
Sep 08 02:12:39.599675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.599586    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy"
Sep 08 02:12:39.599675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.599611    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy"
Sep 08 02:12:39.599675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.599621    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy"
Sep 08 02:12:39.599833 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.599719    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy"
Sep 08 02:12:39.599833 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.599733    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba305cd-5f22-4048-9a17-3d31c9fa27f3" containerName="istio-proxy"
Sep 08 02:12:39.603149 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.603127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:39.605862 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.605836    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:12:39.606339 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.605865    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:12:39.610263 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.610240    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"]
Sep 08 02:12:39.799486 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.799453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ea979531-d4q89\" (UID: \"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:39.867329 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.867234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:39.900485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.900454    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ea979531-d4q89\" (UID: \"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:39.901093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.901074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-ea979531-d4q89\" (UID: \"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:39.917416 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.917393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:39.968098 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:39.968020    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:40.197674 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:40.197643    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"]
Sep 08 02:12:40.199054 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:12:40.199027    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b0b3b60_eeb6_41d9_9f2c_6e27de5a6a22.slice/crio-1da3f9daf809d56d5295067e8868e6106c726bc061c342b639c9a02873c7aad9 WatchSource:0}: Error finding container 1da3f9daf809d56d5295067e8868e6106c726bc061c342b639c9a02873c7aad9: Status 404 returned error can't find the container with id 1da3f9daf809d56d5295067e8868e6106c726bc061c342b639c9a02873c7aad9
Sep 08 02:12:40.350498 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:40.350463    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89" event={"ID":"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22","Type":"ContainerStarted","Data":"1da3f9daf809d56d5295067e8868e6106c726bc061c342b639c9a02873c7aad9"}
Sep 08 02:12:41.358047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:41.358006    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22" containerID="65ba845d3088a5c4e9876ce4a14c838e3da682cfb841b5b5dcb66044d69dcfdd" exitCode=0
Sep 08 02:12:41.358047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:41.358050    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89" event={"ID":"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22","Type":"ContainerDied","Data":"65ba845d3088a5c4e9876ce4a14c838e3da682cfb841b5b5dcb66044d69dcfdd"}
Sep 08 02:12:42.495904 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:42.495877    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:42.524304 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:42.524272    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22-maas-api-service-ca\") pod \"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22\" (UID: \"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22\") "
Sep 08 02:12:42.524633 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:42.524606    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22" (UID: "2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:12:42.524738 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:42.524723    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:43.369693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:43.369526    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"
Sep 08 02:12:43.369693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:43.369537    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89" event={"ID":"2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22","Type":"ContainerDied","Data":"1da3f9daf809d56d5295067e8868e6106c726bc061c342b639c9a02873c7aad9"}
Sep 08 02:12:43.369693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:43.369591    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1da3f9daf809d56d5295067e8868e6106c726bc061c342b639c9a02873c7aad9"
Sep 08 02:12:46.117226 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.117192    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:12:46.261142 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.261093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:46.325636 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.325599    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:46.422660 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.422567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:46.449084 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.449055    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"]
Sep 08 02:12:46.450960 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.450937    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-ea979531-d4q89"]
Sep 08 02:12:46.523908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.523874    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:46.570421 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.570392    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"]
Sep 08 02:12:46.570683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.570644    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" containerID="cri-o://12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a" gracePeriod=30
Sep 08 02:12:46.595663 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:46.595619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:47.035050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.035015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:47.070125 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.070097    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22" path="/var/lib/kubelet/pods/2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22/volumes"
Sep 08 02:12:47.317461 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.317372    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"]
Sep 08 02:12:47.318066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.318048    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22" containerName="revoke-keys"
Sep 08 02:12:47.318117 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.318070    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22" containerName="revoke-keys"
Sep 08 02:12:47.318178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.318167    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b0b3b60-eeb6-41d9-9f2c-6e27de5a6a22" containerName="revoke-keys"
Sep 08 02:12:47.322803 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.322755    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.325518 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.325490    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c5f95cf0-openshift-default-dockercfg-t5789\""
Sep 08 02:12:47.332377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.332348    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"]
Sep 08 02:12:47.350022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.349978    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:47.449413 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.449378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:47.467808 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.467765    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a804698e-dcc3-4493-9265-770a6c7934ee-istiod-ca-cert\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.467978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.467812    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-envoy\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.467978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.467880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-certs\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.467978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.467947    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nxr9\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-kube-api-access-7nxr9\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.468115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.468028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a804698e-dcc3-4493-9265-770a6c7934ee-istio-podinfo\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.468115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.468059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-socket\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.468115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.468097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-credential-socket\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.468266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.468181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-data\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.468266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.468240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-istio-token\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.568954 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.568843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a804698e-dcc3-4493-9265-770a6c7934ee-istio-podinfo\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.568954 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.568889    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-socket\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.568954 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.568953    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-credential-socket\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569242 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.568985    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-data\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569242 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569160    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-istio-token\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569437 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-credential-socket\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-socket\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a804698e-dcc3-4493-9265-770a6c7934ee-istiod-ca-cert\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-envoy\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-certs\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569713    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-data\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.569820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.569732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nxr9\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-kube-api-access-7nxr9\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.570067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.570008    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a804698e-dcc3-4493-9265-770a6c7934ee-istiod-ca-cert\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.570143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.570118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-certs\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.571675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.571653    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a804698e-dcc3-4493-9265-770a6c7934ee-istio-podinfo\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.572010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.571990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-envoy\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.577276 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.577246    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-istio-token\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.577452 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.577435    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nxr9\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-kube-api-access-7nxr9\") pod \"e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") " pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.636414 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.636378    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:47.913613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.913586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"]
Sep 08 02:12:47.914879 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:12:47.914847    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda804698e_dcc3_4493_9265_770a6c7934ee.slice/crio-717a2c04bdbfc2dc90192ff0b1d9fafd81b8de051d24e33b52c8b465faed942b WatchSource:0}: Error finding container 717a2c04bdbfc2dc90192ff0b1d9fafd81b8de051d24e33b52c8b465faed942b: Status 404 returned error can't find the container with id 717a2c04bdbfc2dc90192ff0b1d9fafd81b8de051d24e33b52c8b465faed942b
Sep 08 02:12:47.917213 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.917184    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:47.917287 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.917252    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:47.917287 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:47.917282    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:12:48.400263 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:48.400232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" event={"ID":"a804698e-dcc3-4493-9265-770a6c7934ee","Type":"ContainerStarted","Data":"ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"}
Sep 08 02:12:48.400639 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:48.400279    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" event={"ID":"a804698e-dcc3-4493-9265-770a6c7934ee","Type":"ContainerStarted","Data":"717a2c04bdbfc2dc90192ff0b1d9fafd81b8de051d24e33b52c8b465faed942b"}
Sep 08 02:12:48.418816 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:48.418765    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podStartSLOduration=1.418747994 podStartE2EDuration="1.418747994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:12:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:12:48.417784513 +0000 UTC m=+825.873399486" watchObservedRunningTime="2026-09-08 02:12:48.418747994 +0000 UTC m=+825.874362966"
Sep 08 02:12:48.637612 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:48.637577    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:48.642597 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:48.642573    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:49.406705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:49.406678    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:49.407766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:49.407748    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:12:49.754076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:49.753998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:49.852653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:49.852621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:50.863461 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:50.863420    2562 patch_prober.go:28] interesting pod/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:12:50.863951 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:50.863494    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:12:50.904493 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:50.904465    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:51.002089 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.002054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:51.102137 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.102102    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:51.383118 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.383072    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:51.474690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.474655    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:12:51.831223 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.831197    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:51.919744 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.919717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a68570b-1348-4224-a69c-29b4a7fcf36c-istiod-ca-cert\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.919760    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-token\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.919881    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-data\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.919944    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-socket\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.919981    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-podinfo\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920008    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-credential-socket\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920049    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-certs\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920096    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-envoy\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dk7c\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-kube-api-access-8dk7c\") pod \"6a68570b-1348-4224-a69c-29b4a7fcf36c\" (UID: \"6a68570b-1348-4224-a69c-29b4a7fcf36c\") "
Sep 08 02:12:51.920180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920175    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:51.920673 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920094    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a68570b-1348-4224-a69c-29b4a7fcf36c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:12:51.920673 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920221    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:51.920673 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.920369    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:51.921266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.921009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:51.921266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.921166    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a68570b-1348-4224-a69c-29b4a7fcf36c-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:51.921266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.921189    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:51.921266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.921204    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:51.921266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.921226    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:51.921266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.921241    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:51.922275 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.922253    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:12:51.922418 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.922395    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:12:51.922470 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.922450    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-kube-api-access-8dk7c" (OuterVolumeSpecName: "kube-api-access-8dk7c") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "kube-api-access-8dk7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:12:51.922504 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:51.922482    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a68570b-1348-4224-a69c-29b4a7fcf36c" (UID: "6a68570b-1348-4224-a69c-29b4a7fcf36c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:12:52.022741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.022663    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:52.022741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.022691    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:52.022741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.022701    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a68570b-1348-4224-a69c-29b4a7fcf36c-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:52.022741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.022709    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dk7c\" (UniqueName: \"kubernetes.io/projected/6a68570b-1348-4224-a69c-29b4a7fcf36c-kube-api-access-8dk7c\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:12:52.424063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.424028    2562 generic.go:356] "Generic (PLEG): container finished" podID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerID="12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a" exitCode=0
Sep 08 02:12:52.424234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.424083    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"
Sep 08 02:12:52.424234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.424097    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" event={"ID":"6a68570b-1348-4224-a69c-29b4a7fcf36c","Type":"ContainerDied","Data":"12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a"}
Sep 08 02:12:52.424234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.424154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l" event={"ID":"6a68570b-1348-4224-a69c-29b4a7fcf36c","Type":"ContainerDied","Data":"f78ebedd86b691181da184a960c80a41537774cc56917956e9bd3396f5d2223f"}
Sep 08 02:12:52.424234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.424186    2562 scope.go:117] "RemoveContainer" containerID="12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a"
Sep 08 02:12:52.433824 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.433805    2562 scope.go:117] "RemoveContainer" containerID="08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"
Sep 08 02:12:52.441971 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.441951    2562 scope.go:117] "RemoveContainer" containerID="12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a"
Sep 08 02:12:52.442231 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:12:52.442215    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a\": container with ID starting with 12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a not found: ID does not exist" containerID="12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a"
Sep 08 02:12:52.442279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.442240    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a"} err="failed to get container status \"12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a\": rpc error: code = NotFound desc = could not find container \"12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a\": container with ID starting with 12df266e335df0794c16e8ac0719516b9190488f90e21046157e2d67a83e837a not found: ID does not exist"
Sep 08 02:12:52.442279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.442257    2562 scope.go:117] "RemoveContainer" containerID="08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"
Sep 08 02:12:52.442483 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:12:52.442464    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab\": container with ID starting with 08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab not found: ID does not exist" containerID="08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"
Sep 08 02:12:52.442518 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.442490    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab"} err="failed to get container status \"08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab\": rpc error: code = NotFound desc = could not find container \"08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab\": container with ID starting with 08b32433ad93234f5f53c2bbfa871c7f1d6c767717a3a9fd469f08a5afeb82ab not found: ID does not exist"
Sep 08 02:12:52.446100 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.446074    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"]
Sep 08 02:12:52.449559 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:52.449537    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-ea979531-gw-openshift-default-79f774d984-8x47l"]
Sep 08 02:12:53.070736 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:12:53.070702    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" path="/var/lib/kubelet/pods/6a68570b-1348-4224-a69c-29b4a7fcf36c/volumes"
Sep 08 02:13:01.004575 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:01.004517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:04.413374 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:04.413338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:13:05.448141 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:05.448083    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:13:05.448625 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:05.448190    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:13:06.102352 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:06.102316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:07.125637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.125602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:07.518090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.518001    2562 generic.go:356] "Generic (PLEG): container finished" podID="a804698e-dcc3-4493-9265-770a6c7934ee" containerID="ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab" exitCode=0
Sep 08 02:13:07.518090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.518041    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" event={"ID":"a804698e-dcc3-4493-9265-770a6c7934ee","Type":"ContainerDied","Data":"ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"}
Sep 08 02:13:07.518489 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.518475    2562 scope.go:117] "RemoveContainer" containerID="ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"
Sep 08 02:13:07.519654 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.519622    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:07.519755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.519710    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:07.519826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:07.519761    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:08.527445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:08.527405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" event={"ID":"a804698e-dcc3-4493-9265-770a6c7934ee","Type":"ContainerStarted","Data":"c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d"}
Sep 08 02:13:08.637527 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:08.637485    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:13:08.637732 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:08.637619    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 02:13:08.637732 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:08.637665    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 02:13:09.637498 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:09.637461    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 02:13:09.638109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:09.638075    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 02:13:10.637187 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:10.637144    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 02:13:10.637395 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:10.637214    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 02:13:11.647186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:11.647136    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 02:13:11.647682 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:11.647222    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 02:13:11.825874 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:11.825832    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:12.637255 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:12.637209    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 02:13:12.637472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:12.637291    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 02:13:13.637804 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:13.637755    2562 patch_prober.go:28] interesting pod/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 08 02:13:13.638326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:13.637836    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 08 02:13:14.640666 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:14.640634    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:13:14.641163 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:14.641023    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:13:14.641591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:14.641570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:13:15.469868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.469834    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"]
Sep 08 02:13:15.470263 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.470250    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy"
Sep 08 02:13:15.470324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.470265    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy"
Sep 08 02:13:15.470359 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.470339    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy"
Sep 08 02:13:15.473163 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.473147    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:15.475833 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.475811    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:13:15.475990 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.475894    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:13:15.482076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.482050    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"]
Sep 08 02:13:15.483987 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.483958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/894be00e-ef35-418d-ad56-262457fa68db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66\" (UID: \"894be00e-ef35-418d-ad56-262457fa68db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:15.585640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.585605    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/894be00e-ef35-418d-ad56-262457fa68db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66\" (UID: \"894be00e-ef35-418d-ad56-262457fa68db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:15.586227 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.586209    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/894be00e-ef35-418d-ad56-262457fa68db-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66\" (UID: \"894be00e-ef35-418d-ad56-262457fa68db\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:15.786399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:15.786371    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:16.073412 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:16.073384    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"]
Sep 08 02:13:16.075610 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:13:16.075582    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod894be00e_ef35_418d_ad56_262457fa68db.slice/crio-923a1d0d5a5dbd7eca4e853d9af0269bf01c491062379b2e5cea7c37f1844df4 WatchSource:0}: Error finding container 923a1d0d5a5dbd7eca4e853d9af0269bf01c491062379b2e5cea7c37f1844df4: Status 404 returned error can't find the container with id 923a1d0d5a5dbd7eca4e853d9af0269bf01c491062379b2e5cea7c37f1844df4
Sep 08 02:13:16.588850 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:16.588815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66" event={"ID":"894be00e-ef35-418d-ad56-262457fa68db","Type":"ContainerStarted","Data":"108ce4a8d4ac7f305c370c2248d44a4e5515170c87ceb2cdf10d40a33f660a07"}
Sep 08 02:13:16.589066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:16.588872    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66" event={"ID":"894be00e-ef35-418d-ad56-262457fa68db","Type":"ContainerStarted","Data":"923a1d0d5a5dbd7eca4e853d9af0269bf01c491062379b2e5cea7c37f1844df4"}
Sep 08 02:13:16.609578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:16.609523    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66" podStartSLOduration=1.609506474 podStartE2EDuration="1.609506474s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:13:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:13:16.608694789 +0000 UTC m=+854.064309727" watchObservedRunningTime="2026-09-08 02:13:16.609506474 +0000 UTC m=+854.065121387"
Sep 08 02:13:16.714455 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:16.714419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:17.595387 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:17.595348    2562 generic.go:356] "Generic (PLEG): container finished" podID="894be00e-ef35-418d-ad56-262457fa68db" containerID="108ce4a8d4ac7f305c370c2248d44a4e5515170c87ceb2cdf10d40a33f660a07" exitCode=0
Sep 08 02:13:17.595802 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:17.595445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66" event={"ID":"894be00e-ef35-418d-ad56-262457fa68db","Type":"ContainerDied","Data":"108ce4a8d4ac7f305c370c2248d44a4e5515170c87ceb2cdf10d40a33f660a07"}
Sep 08 02:13:18.734195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:18.734166    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:18.819497 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:18.819459    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/894be00e-ef35-418d-ad56-262457fa68db-maas-api-service-ca\") pod \"894be00e-ef35-418d-ad56-262457fa68db\" (UID: \"894be00e-ef35-418d-ad56-262457fa68db\") "
Sep 08 02:13:18.819888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:18.819853    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/894be00e-ef35-418d-ad56-262457fa68db-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "894be00e-ef35-418d-ad56-262457fa68db" (UID: "894be00e-ef35-418d-ad56-262457fa68db"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:13:18.920718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:18.920642    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/894be00e-ef35-418d-ad56-262457fa68db-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:19.223725 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:19.223642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:19.611732 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:19.611695    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66" event={"ID":"894be00e-ef35-418d-ad56-262457fa68db","Type":"ContainerDied","Data":"923a1d0d5a5dbd7eca4e853d9af0269bf01c491062379b2e5cea7c37f1844df4"}
Sep 08 02:13:19.611948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:19.611741    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"
Sep 08 02:13:19.611948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:19.611770    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="923a1d0d5a5dbd7eca4e853d9af0269bf01c491062379b2e5cea7c37f1844df4"
Sep 08 02:13:19.924074 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:19.923993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:20.023029 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.022993    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"]
Sep 08 02:13:20.023618 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.023595    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy"
Sep 08 02:13:20.023781 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.023768    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy"
Sep 08 02:13:20.023938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.023904    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="894be00e-ef35-418d-ad56-262457fa68db" containerName="revoke-keys"
Sep 08 02:13:20.023938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.023937    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="894be00e-ef35-418d-ad56-262457fa68db" containerName="revoke-keys"
Sep 08 02:13:20.024103 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.024088    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a68570b-1348-4224-a69c-29b4a7fcf36c" containerName="istio-proxy"
Sep 08 02:13:20.024161 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.024113    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="894be00e-ef35-418d-ad56-262457fa68db" containerName="revoke-keys"
Sep 08 02:13:20.027743 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.027714    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:20.030530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.030500    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:13:20.030530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.030502    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:13:20.034971 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.034946    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"]
Sep 08 02:13:20.134565 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.134533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27035a27-3547-4254-afd1-75bfa0e71b5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-308137-nx86f\" (UID: \"27035a27-3547-4254-afd1-75bfa0e71b5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:20.235533 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.235456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27035a27-3547-4254-afd1-75bfa0e71b5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-308137-nx86f\" (UID: \"27035a27-3547-4254-afd1-75bfa0e71b5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:20.236120 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.236102    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27035a27-3547-4254-afd1-75bfa0e71b5b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-308137-nx86f\" (UID: \"27035a27-3547-4254-afd1-75bfa0e71b5b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:20.253872 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.253845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:20.342011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.341976    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:20.611718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:20.611691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"]
Sep 08 02:13:20.613681 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:13:20.613648    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27035a27_3547_4254_afd1_75bfa0e71b5b.slice/crio-570683aba4a1c0f3fdaa94ea8193ddfd6b16ec1b7d6e2e8b86cf422ceb0f2455 WatchSource:0}: Error finding container 570683aba4a1c0f3fdaa94ea8193ddfd6b16ec1b7d6e2e8b86cf422ceb0f2455: Status 404 returned error can't find the container with id 570683aba4a1c0f3fdaa94ea8193ddfd6b16ec1b7d6e2e8b86cf422ceb0f2455
Sep 08 02:13:21.143278 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.143245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:21.271234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.271149    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:21.344505 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.344461    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:21.402276 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.402242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:21.453080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.453055    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"]
Sep 08 02:13:21.456924 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.456875    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c5f95cf0-27r66"]
Sep 08 02:13:21.460640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.460615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:21.625407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.625367    2562 generic.go:356] "Generic (PLEG): container finished" podID="27035a27-3547-4254-afd1-75bfa0e71b5b" containerID="849f60a5a537be316f619b49bddda76b9187384a079a9b84cc991841e37d1992" exitCode=0
Sep 08 02:13:21.625565 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.625445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f" event={"ID":"27035a27-3547-4254-afd1-75bfa0e71b5b","Type":"ContainerDied","Data":"849f60a5a537be316f619b49bddda76b9187384a079a9b84cc991841e37d1992"}
Sep 08 02:13:21.625565 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:21.625503    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f" event={"ID":"27035a27-3547-4254-afd1-75bfa0e71b5b","Type":"ContainerStarted","Data":"570683aba4a1c0f3fdaa94ea8193ddfd6b16ec1b7d6e2e8b86cf422ceb0f2455"}
Sep 08 02:13:22.572269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.572240    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"]
Sep 08 02:13:22.572725 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.572469    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy" containerID="cri-o://c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d" gracePeriod=30
Sep 08 02:13:22.595176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.595143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:22.779818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.779793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:22.865399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.865318    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27035a27-3547-4254-afd1-75bfa0e71b5b-maas-api-service-ca\") pod \"27035a27-3547-4254-afd1-75bfa0e71b5b\" (UID: \"27035a27-3547-4254-afd1-75bfa0e71b5b\") "
Sep 08 02:13:22.865661 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.865639    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27035a27-3547-4254-afd1-75bfa0e71b5b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27035a27-3547-4254-afd1-75bfa0e71b5b" (UID: "27035a27-3547-4254-afd1-75bfa0e71b5b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:13:22.966605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:22.966571    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27035a27-3547-4254-afd1-75bfa0e71b5b-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:23.038112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.038079    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:23.070326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.070292    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="894be00e-ef35-418d-ad56-262457fa68db" path="/var/lib/kubelet/pods/894be00e-ef35-418d-ad56-262457fa68db/volumes"
Sep 08 02:13:23.224599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.224523    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:13:23.303024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.302987    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"]
Sep 08 02:13:23.303599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.303580    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27035a27-3547-4254-afd1-75bfa0e71b5b" containerName="revoke-keys"
Sep 08 02:13:23.303719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.303601    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="27035a27-3547-4254-afd1-75bfa0e71b5b" containerName="revoke-keys"
Sep 08 02:13:23.303766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.303748    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="27035a27-3547-4254-afd1-75bfa0e71b5b" containerName="revoke-keys"
Sep 08 02:13:23.307548 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.307521    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.309967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.309942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b1ffefe6-openshift-default-dockercfg-629np\""
Sep 08 02:13:23.319734 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.319713    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"]
Sep 08 02:13:23.341227 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.341196    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:23.370154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370131    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-credential-socket\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370177    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istiod-ca-cert\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-envoy\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-certs\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98xf7\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-kube-api-access-98xf7\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-token\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370453 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-data\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370453 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-podinfo\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.370520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.370467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-socket\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471042 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istiod-ca-cert\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471211 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-envoy\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471211 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471088    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-certs\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471211 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98xf7\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-kube-api-access-98xf7\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471211 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-token\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471406 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-data\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471406 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-podinfo\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471406 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471337    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-socket\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471406 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-credential-socket\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471614 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-certs\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471614 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-data\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471729 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471694    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-credential-socket\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.471816 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.471782    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-socket\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.472154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.472137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istiod-ca-cert\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.473425 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.473401    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-envoy\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.473751 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.473730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-podinfo\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.479197 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.479142    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-token\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.479197 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.479149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98xf7\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-kube-api-access-98xf7\") pod \"e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") " pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.618935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.618877    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:23.639676 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.639656    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"
Sep 08 02:13:23.639807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.639656    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f" event={"ID":"27035a27-3547-4254-afd1-75bfa0e71b5b","Type":"ContainerDied","Data":"570683aba4a1c0f3fdaa94ea8193ddfd6b16ec1b7d6e2e8b86cf422ceb0f2455"}
Sep 08 02:13:23.639807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.639777    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="570683aba4a1c0f3fdaa94ea8193ddfd6b16ec1b7d6e2e8b86cf422ceb0f2455"
Sep 08 02:13:23.697658 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.697329    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:23.897926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.897886    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"]
Sep 08 02:13:23.899479 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:13:23.899453    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8badd3d8_50a1_4e79_b38d_b1909bd39b0b.slice/crio-3a5fbde7186dabe1afe1098c2feed915234723a1742102941ffb6cf7f77bfa9b WatchSource:0}: Error finding container 3a5fbde7186dabe1afe1098c2feed915234723a1742102941ffb6cf7f77bfa9b: Status 404 returned error can't find the container with id 3a5fbde7186dabe1afe1098c2feed915234723a1742102941ffb6cf7f77bfa9b
Sep 08 02:13:23.901888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.901858    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:23.901966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.901942    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:23.902002 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:23.901980    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:24.648669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:24.648630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" event={"ID":"8badd3d8-50a1-4e79-b38d-b1909bd39b0b","Type":"ContainerStarted","Data":"2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"}
Sep 08 02:13:24.649155 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:24.648699    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" event={"ID":"8badd3d8-50a1-4e79-b38d-b1909bd39b0b","Type":"ContainerStarted","Data":"3a5fbde7186dabe1afe1098c2feed915234723a1742102941ffb6cf7f77bfa9b"}
Sep 08 02:13:24.670107 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:24.670046    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podStartSLOduration=1.6700230010000001 podStartE2EDuration="1.670023001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:13:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:13:24.669073043 +0000 UTC m=+862.124688013" watchObservedRunningTime="2026-09-08 02:13:24.670023001 +0000 UTC m=+862.125637925"
Sep 08 02:13:25.620067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:25.620011    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:25.625176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:25.625151    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:25.654942 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:25.654900    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:25.655776 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:25.655756    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:25.988249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:25.988163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:26.091275 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:26.091240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:27.130294 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.130261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:27.232754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.232719    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:27.289304 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.289268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:27.585238 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.585207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:27.685992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.685966    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:27.863543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.863519    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:13:27.921065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921039    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-certs\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921217 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921074    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-credential-socket\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921217 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921101    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-istio-token\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921217 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nxr9\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-kube-api-access-7nxr9\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921400 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921251    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-socket\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921400 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921306    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-envoy\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921400 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921357    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:27.921400 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921387    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:27.921608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921415    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a804698e-dcc3-4493-9265-770a6c7934ee-istiod-ca-cert\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a804698e-dcc3-4493-9265-770a6c7934ee-istio-podinfo\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-data\") pod \"a804698e-dcc3-4493-9265-770a6c7934ee\" (UID: \"a804698e-dcc3-4493-9265-770a6c7934ee\") "
Sep 08 02:13:27.921608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921505    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:27.921820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921761    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a804698e-dcc3-4493-9265-770a6c7934ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:13:27.921820 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921801    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:27.922063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.921978    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a804698e-dcc3-4493-9265-770a6c7934ee-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:27.922063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.922002    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:27.922063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.922016    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:27.922063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.922028    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:27.922063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.922043    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:27.923485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.923461    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:27.923560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.923487    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:13:27.923560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.923487    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-kube-api-access-7nxr9" (OuterVolumeSpecName: "kube-api-access-7nxr9") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "kube-api-access-7nxr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:13:27.923751 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:27.923737    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a804698e-dcc3-4493-9265-770a6c7934ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a804698e-dcc3-4493-9265-770a6c7934ee" (UID: "a804698e-dcc3-4493-9265-770a6c7934ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:13:28.023032 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.023001    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a804698e-dcc3-4493-9265-770a6c7934ee-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:28.023032 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.023027    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:28.023032 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.023037    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nxr9\" (UniqueName: \"kubernetes.io/projected/a804698e-dcc3-4493-9265-770a6c7934ee-kube-api-access-7nxr9\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:28.023230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.023047    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a804698e-dcc3-4493-9265-770a6c7934ee-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:28.673707 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.673675    2562 generic.go:356] "Generic (PLEG): container finished" podID="a804698e-dcc3-4493-9265-770a6c7934ee" containerID="c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d" exitCode=0
Sep 08 02:13:28.674165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.673718    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" event={"ID":"a804698e-dcc3-4493-9265-770a6c7934ee","Type":"ContainerDied","Data":"c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d"}
Sep 08 02:13:28.674165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.673729    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"
Sep 08 02:13:28.674165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.673762    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk" event={"ID":"a804698e-dcc3-4493-9265-770a6c7934ee","Type":"ContainerDied","Data":"717a2c04bdbfc2dc90192ff0b1d9fafd81b8de051d24e33b52c8b465faed942b"}
Sep 08 02:13:28.674165 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.673783    2562 scope.go:117] "RemoveContainer" containerID="c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d"
Sep 08 02:13:28.683764 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.683746    2562 scope.go:117] "RemoveContainer" containerID="ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"
Sep 08 02:13:28.691891 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.691731    2562 scope.go:117] "RemoveContainer" containerID="c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d"
Sep 08 02:13:28.692286 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:13:28.692131    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d\": container with ID starting with c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d not found: ID does not exist" containerID="c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d"
Sep 08 02:13:28.692286 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.692175    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d"} err="failed to get container status \"c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d\": rpc error: code = NotFound desc = could not find container \"c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d\": container with ID starting with c056a911af255b40e54f3f04c5fcb1075820d2634b0362970f9593d851c33a9d not found: ID does not exist"
Sep 08 02:13:28.692286 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.692199    2562 scope.go:117] "RemoveContainer" containerID="ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"
Sep 08 02:13:28.692900 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:13:28.692870    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab\": container with ID starting with ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab not found: ID does not exist" containerID="ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"
Sep 08 02:13:28.693012 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.692907    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab"} err="failed to get container status \"ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab\": rpc error: code = NotFound desc = could not find container \"ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab\": container with ID starting with ea9bddca9e0bb57a9803ecda925a7b97be21790b3c98c1bdf9bd10dab4fa58ab not found: ID does not exist"
Sep 08 02:13:28.695602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.695580    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"]
Sep 08 02:13:28.697727 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:28.697706    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c5f95cf0-openshift-default-557f7f946b-vbgwk"]
Sep 08 02:13:29.070033 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:29.069999    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" path="/var/lib/kubelet/pods/a804698e-dcc3-4493-9265-770a6c7934ee/volumes"
Sep 08 02:13:30.142081 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.142050    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:30.691730 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.691701    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:30.755657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.755619    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:30.818194 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.818152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:30.866252 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.866215    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"]
Sep 08 02:13:30.868175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.868150    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-308137-nx86f"]
Sep 08 02:13:30.874995 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:30.874974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:31.070360 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:31.070328    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27035a27-3547-4254-afd1-75bfa0e71b5b" path="/var/lib/kubelet/pods/27035a27-3547-4254-afd1-75bfa0e71b5b/volumes"
Sep 08 02:13:31.190106 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:31.190074    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:37.100202 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:37.100166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:37.167096 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:37.167066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:37.319512 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:37.319478    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"]
Sep 08 02:13:37.319754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:37.319710    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" containerID="cri-o://4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07" gracePeriod=30
Sep 08 02:13:37.343398 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:37.343364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:37.743380 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:37.743323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:38.012868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.012789    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"]
Sep 08 02:13:38.013489 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.013465    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy"
Sep 08 02:13:38.013543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.013494    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy"
Sep 08 02:13:38.013543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.013536    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy"
Sep 08 02:13:38.013607 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.013546    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy"
Sep 08 02:13:38.013663 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.013651    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy"
Sep 08 02:13:38.013699 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.013668    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a804698e-dcc3-4493-9265-770a6c7934ee" containerName="istio-proxy"
Sep 08 02:13:38.017408 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.017389    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.020016 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.019995    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-173970-openshift-default-dockercfg-ctxrl\""
Sep 08 02:13:38.043942 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.030665    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"]
Sep 08 02:13:38.044205 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.039653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:38.130082 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.130035    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-socket\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.130696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.130672    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-certs\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.130894 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.130861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-envoy\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.131093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.131064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-data\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.131246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.131225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msq8q\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-kube-api-access-msq8q\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.131469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.131450    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-credential-socket\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.131635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.131617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-podinfo\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.131777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.131760    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-token\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.131942 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.131901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istiod-ca-cert\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.233594 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.233553    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-socket\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.234326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.234300    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-certs\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.234560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.234541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-envoy\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.235044 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.235026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-data\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.235205 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.235182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msq8q\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-kube-api-access-msq8q\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.235724 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.235704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-credential-socket\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.236200 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.236182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-podinfo\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.236720 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.236701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-token\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.236853 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.236837    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istiod-ca-cert\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.237240 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.235107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-certs\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.237357 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.236383    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-credential-socket\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.237454 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.235450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-data\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.237605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.237538    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istiod-ca-cert\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.237784 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.234205    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-socket\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.238319 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.238300    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-envoy\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.243423 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.243391    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-podinfo\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.253504 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.253416    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-token\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.256770 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.256747    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msq8q\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-kube-api-access-msq8q\") pod \"e2e-explicit-173970-openshift-default-6986dd5f68-nljxx\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") " pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.332387 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.332355    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:38.590390 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.590307    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:38.614681 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.614653    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"]
Sep 08 02:13:38.616626 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:13:38.616584    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod259b2ee3_d1ba_4c60_8241_c2aa8594be15.slice/crio-22b19829d2e6c6bdad35e6d02b745e06889cdfb83d2c74a8df1ef933a5ea3230 WatchSource:0}: Error finding container 22b19829d2e6c6bdad35e6d02b745e06889cdfb83d2c74a8df1ef933a5ea3230: Status 404 returned error can't find the container with id 22b19829d2e6c6bdad35e6d02b745e06889cdfb83d2c74a8df1ef933a5ea3230
Sep 08 02:13:38.618819 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.618788    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:38.618902 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.618850    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:38.618902 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.618880    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:38.743122 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.743078    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" event={"ID":"259b2ee3-d1ba-4c60-8241-c2aa8594be15","Type":"ContainerStarted","Data":"fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"}
Sep 08 02:13:38.743316 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.743152    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" event={"ID":"259b2ee3-d1ba-4c60-8241-c2aa8594be15","Type":"ContainerStarted","Data":"22b19829d2e6c6bdad35e6d02b745e06889cdfb83d2c74a8df1ef933a5ea3230"}
Sep 08 02:13:38.765784 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:38.765726    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podStartSLOduration=1.7657084219999999 podStartE2EDuration="1.765708422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:13:38.763597093 +0000 UTC m=+876.219212025" watchObservedRunningTime="2026-09-08 02:13:38.765708422 +0000 UTC m=+876.221323334"
Sep 08 02:13:39.333814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:39.333765    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:39.341209 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:39.341172    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:39.751112 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:39.751025    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:39.752091 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:39.752070    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:13:40.636635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:40.636598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:40.701884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:40.701844    2562 patch_prober.go:28] interesting pod/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:13:40.702067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:40.701940    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:13:40.735647 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:40.735561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:41.950772 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:41.950737    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:42.076439 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.076400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:42.176358 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.176308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:42.459092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.459051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:42.561794 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.561744    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:42.592605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.592533    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:13:42.593329 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593301    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-credential-socket\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-certs\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593366    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvx2f\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-kube-api-access-gvx2f\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-podinfo\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593446    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-envoy\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593491    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-socket\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593520    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-data\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593559    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istiod-ca-cert\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:42.593693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593610    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-token\") pod \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\" (UID: \"44f5b707-4dc6-4c92-84a8-ec658bc6a44e\") "
Sep 08 02:13:42.593975 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593792    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-data" (OuterVolumeSpecName: "istio-data") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:42.593975 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.593897    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:42.594108 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.594089    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.594173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.594116    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.594173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.594135    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.594173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.594135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:42.594350 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.594236    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:13:42.596271 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.596211    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-kube-api-access-gvx2f" (OuterVolumeSpecName: "kube-api-access-gvx2f") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "kube-api-access-gvx2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:13:42.596488 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.596443    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-token" (OuterVolumeSpecName: "istio-token") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:13:42.596605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.596558    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:13:42.596969 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.596909    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "44f5b707-4dc6-4c92-84a8-ec658bc6a44e" (UID: "44f5b707-4dc6-4c92-84a8-ec658bc6a44e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:13:42.695348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.695212    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvx2f\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-kube-api-access-gvx2f\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.695348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.695254    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.695348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.695268    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.695348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.695281    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.695348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.695295    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.695348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.695307    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/44f5b707-4dc6-4c92-84a8-ec658bc6a44e-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:42.768979 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.768944    2562 generic.go:356] "Generic (PLEG): container finished" podID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerID="4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07" exitCode=0
Sep 08 02:13:42.769145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.768992    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"
Sep 08 02:13:42.769145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.769037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" event={"ID":"44f5b707-4dc6-4c92-84a8-ec658bc6a44e","Type":"ContainerDied","Data":"4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07"}
Sep 08 02:13:42.769145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.769095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt" event={"ID":"44f5b707-4dc6-4c92-84a8-ec658bc6a44e","Type":"ContainerDied","Data":"4732083f231a885d953efa28b150c481d1799e42f9a2693166f625d7f5289049"}
Sep 08 02:13:42.769145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.769118    2562 scope.go:117] "RemoveContainer" containerID="4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07"
Sep 08 02:13:42.780006 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.779984    2562 scope.go:117] "RemoveContainer" containerID="0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"
Sep 08 02:13:42.791265 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.791243    2562 scope.go:117] "RemoveContainer" containerID="4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07"
Sep 08 02:13:42.791639 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:13:42.791613    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07\": container with ID starting with 4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07 not found: ID does not exist" containerID="4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07"
Sep 08 02:13:42.791715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.791652    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07"} err="failed to get container status \"4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07\": rpc error: code = NotFound desc = could not find container \"4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07\": container with ID starting with 4e811a2ba20ca92ec8578f22a04b306d6bd305f442ee90a6f95ce2a9090d0c07 not found: ID does not exist"
Sep 08 02:13:42.791715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.791676    2562 scope.go:117] "RemoveContainer" containerID="0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"
Sep 08 02:13:42.792032 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:13:42.792012    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8\": container with ID starting with 0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8 not found: ID does not exist" containerID="0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"
Sep 08 02:13:42.792097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.792043    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8"} err="failed to get container status \"0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8\": rpc error: code = NotFound desc = could not find container \"0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8\": container with ID starting with 0d83348ab582478a456563b9a342fc88720a556d4a945637e6a2154976bf2cf8 not found: ID does not exist"
Sep 08 02:13:42.792617 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.792599    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"]
Sep 08 02:13:42.796442 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:42.796418    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-308137-openshift-default-7897c8f5fd-xjxgt"]
Sep 08 02:13:43.011247 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:43.011157    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:13:43.070477 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:43.070439    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" path="/var/lib/kubelet/pods/44f5b707-4dc6-4c92-84a8-ec658bc6a44e/volumes"
Sep 08 02:13:45.789095 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:45.789061    2562 generic.go:356] "Generic (PLEG): container finished" podID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerID="2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9" exitCode=0
Sep 08 02:13:45.789511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:45.789144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" event={"ID":"8badd3d8-50a1-4e79-b38d-b1909bd39b0b","Type":"ContainerDied","Data":"2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"}
Sep 08 02:13:45.789729 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:45.789709    2562 scope.go:117] "RemoveContainer" containerID="2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"
Sep 08 02:13:45.791080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:45.791055    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:45.791154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:45.791124    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:45.791195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:45.791157    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:13:46.796210 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:46.796172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" event={"ID":"8badd3d8-50a1-4e79-b38d-b1909bd39b0b","Type":"ContainerStarted","Data":"76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb"}
Sep 08 02:13:47.620122 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:47.620079    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:47.620346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:47.620317    2562 patch_prober.go:28] interesting pod/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 02:13:47.620434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:47.620381    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 02:13:48.056266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:48.056227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:48.620011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:48.619978    2562 patch_prober.go:28] interesting pod/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 02:13:48.620181 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:48.620032    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 02:13:49.619254 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:49.619221    2562 patch_prober.go:28] interesting pod/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 02:13:49.619626 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:49.619283    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 02:13:50.620184 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.620147    2562 patch_prober.go:28] interesting pod/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 02:13:50.620649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.620213    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 02:13:50.760523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.760488    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"]
Sep 08 02:13:50.760926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.760899    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy"
Sep 08 02:13:50.760926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.760926    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy"
Sep 08 02:13:50.761031 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.760941    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy"
Sep 08 02:13:50.761031 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.760947    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy"
Sep 08 02:13:50.761031 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.761014    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy"
Sep 08 02:13:50.761031 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.761023    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="44f5b707-4dc6-4c92-84a8-ec658bc6a44e" containerName="istio-proxy"
Sep 08 02:13:50.764253 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.764234    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:50.766773 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.766752    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:13:50.766877 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.766790    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:13:50.771591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.771567    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"]
Sep 08 02:13:50.883496 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.883431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99571eae-da44-4057-8399-04e047d296d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh\" (UID: \"99571eae-da44-4057-8399-04e047d296d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:50.984525 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.984495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99571eae-da44-4057-8399-04e047d296d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh\" (UID: \"99571eae-da44-4057-8399-04e047d296d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:50.985133 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:50.985114    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99571eae-da44-4057-8399-04e047d296d0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh\" (UID: \"99571eae-da44-4057-8399-04e047d296d0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:51.096438 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:51.096407    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:51.395047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:51.395022    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"]
Sep 08 02:13:51.397198 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:13:51.397169    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99571eae_da44_4057_8399_04e047d296d0.slice/crio-6edaeb75f5d5aae83e64e4f93adb79e86492051823f956346bafaac9a051a9e2 WatchSource:0}: Error finding container 6edaeb75f5d5aae83e64e4f93adb79e86492051823f956346bafaac9a051a9e2: Status 404 returned error can't find the container with id 6edaeb75f5d5aae83e64e4f93adb79e86492051823f956346bafaac9a051a9e2
Sep 08 02:13:51.619260 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:51.619225    2562 patch_prober.go:28] interesting pod/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 08 02:13:51.619431 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:51.619289    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 08 02:13:51.825012 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:51.824954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh" event={"ID":"99571eae-da44-4057-8399-04e047d296d0","Type":"ContainerStarted","Data":"6edaeb75f5d5aae83e64e4f93adb79e86492051823f956346bafaac9a051a9e2"}
Sep 08 02:13:52.623731 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:52.623699    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:52.624153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:52.624128    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:52.624696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:52.624678    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:13:52.838938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:52.836138    2562 generic.go:356] "Generic (PLEG): container finished" podID="99571eae-da44-4057-8399-04e047d296d0" containerID="8906736a5003a675178e49da787578133326724e6e268e4a8c7697f82b8ef6f1" exitCode=0
Sep 08 02:13:52.838938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:52.837855    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh" event={"ID":"99571eae-da44-4057-8399-04e047d296d0","Type":"ContainerDied","Data":"8906736a5003a675178e49da787578133326724e6e268e4a8c7697f82b8ef6f1"}
Sep 08 02:13:54.004492 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.004467    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:54.118339 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.118241    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99571eae-da44-4057-8399-04e047d296d0-maas-api-service-ca\") pod \"99571eae-da44-4057-8399-04e047d296d0\" (UID: \"99571eae-da44-4057-8399-04e047d296d0\") "
Sep 08 02:13:54.118572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.118550    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99571eae-da44-4057-8399-04e047d296d0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99571eae-da44-4057-8399-04e047d296d0" (UID: "99571eae-da44-4057-8399-04e047d296d0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:13:54.219063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.219032    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99571eae-da44-4057-8399-04e047d296d0-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:13:54.854867 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.854833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh" event={"ID":"99571eae-da44-4057-8399-04e047d296d0","Type":"ContainerDied","Data":"6edaeb75f5d5aae83e64e4f93adb79e86492051823f956346bafaac9a051a9e2"}
Sep 08 02:13:54.854867 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.854864    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"
Sep 08 02:13:54.855103 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:54.854890    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6edaeb75f5d5aae83e64e4f93adb79e86492051823f956346bafaac9a051a9e2"
Sep 08 02:13:57.612205 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.612168    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:13:57.717335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.717299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:57.780906 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.780863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:57.842156 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.842116    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:57.882188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.882100    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"]
Sep 08 02:13:57.885415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.885385    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b1ffefe6-ksdlh"]
Sep 08 02:13:57.897144 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:57.897115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:58.008855 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:58.008820    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"]
Sep 08 02:13:58.009469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:58.009091    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy" containerID="cri-o://76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb" gracePeriod=30
Sep 08 02:13:58.020024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:58.020001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:58.654415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:58.654373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:58.754083 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:58.754047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:58.854453 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:58.854423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:13:59.071708 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:13:59.071665    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99571eae-da44-4057-8399-04e047d296d0" path="/var/lib/kubelet/pods/99571eae-da44-4057-8399-04e047d296d0/volumes"
Sep 08 02:14:00.119758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.119729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:00.894032 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.894001    2562 generic.go:356] "Generic (PLEG): container finished" podID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerID="fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8" exitCode=0
Sep 08 02:14:00.894236 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.894075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" event={"ID":"259b2ee3-d1ba-4c60-8241-c2aa8594be15","Type":"ContainerDied","Data":"fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"}
Sep 08 02:14:00.894491 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.894478    2562 scope.go:117] "RemoveContainer" containerID="fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"
Sep 08 02:14:00.895591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.895566    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:14:00.895671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.895629    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:14:00.895671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:00.895661    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:14:01.902816 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:01.902780    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" event={"ID":"259b2ee3-d1ba-4c60-8241-c2aa8594be15","Type":"ContainerStarted","Data":"0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd"}
Sep 08 02:14:02.334097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:02.333601    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:14:02.334097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:02.333734    2562 patch_prober.go:28] interesting pod/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 02:14:02.334097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:02.333788    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 02:14:03.064482 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.064458    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:14:03.066370 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.066351    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:14:03.309176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.309115    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:14:03.343892 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.343075    2562 patch_prober.go:28] interesting pod/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 02:14:03.343892 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.343159    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 02:14:03.421118 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421083    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-credential-socket\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421118 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421124    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-certs\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421329 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421181    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istiod-ca-cert\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421329 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421235    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98xf7\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-kube-api-access-98xf7\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421329 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421269    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-socket\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421335    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-podinfo\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-envoy\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421396    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:14:03.421479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421433    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-token\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421454    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:14:03.421743 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421491    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-data\") pod \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\" (UID: \"8badd3d8-50a1-4e79-b38d-b1909bd39b0b\") "
Sep 08 02:14:03.421743 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421560    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:14:03.421861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421828    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:14:03.421950 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421873    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.421950 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421892    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.421950 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.421908    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.422180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.422151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:14:03.423669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.423650    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:14:03.423739 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.423701    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:14:03.423959 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.423934    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-kube-api-access-98xf7" (OuterVolumeSpecName: "kube-api-access-98xf7") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "kube-api-access-98xf7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:14:03.424040 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.424024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "8badd3d8-50a1-4e79-b38d-b1909bd39b0b" (UID: "8badd3d8-50a1-4e79-b38d-b1909bd39b0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:14:03.522798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.522764    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.522798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.522793    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.522798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.522802    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.522798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.522810    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98xf7\" (UniqueName: \"kubernetes.io/projected/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-kube-api-access-98xf7\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.523090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.522819    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.523090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.522830    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8badd3d8-50a1-4e79-b38d-b1909bd39b0b-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:14:03.670470 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.670372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:03.915099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.915064    2562 generic.go:356] "Generic (PLEG): container finished" podID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerID="76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb" exitCode=0
Sep 08 02:14:03.915268 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.915162    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" event={"ID":"8badd3d8-50a1-4e79-b38d-b1909bd39b0b","Type":"ContainerDied","Data":"76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb"}
Sep 08 02:14:03.915268 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.915177    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"
Sep 08 02:14:03.915268 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.915220    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j" event={"ID":"8badd3d8-50a1-4e79-b38d-b1909bd39b0b","Type":"ContainerDied","Data":"3a5fbde7186dabe1afe1098c2feed915234723a1742102941ffb6cf7f77bfa9b"}
Sep 08 02:14:03.915372 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.915255    2562 scope.go:117] "RemoveContainer" containerID="76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb"
Sep 08 02:14:03.925305 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.925102    2562 scope.go:117] "RemoveContainer" containerID="2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"
Sep 08 02:14:03.950216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.942951    2562 scope.go:117] "RemoveContainer" containerID="76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb"
Sep 08 02:14:03.951547 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:14:03.950646    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb\": container with ID starting with 76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb not found: ID does not exist" containerID="76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb"
Sep 08 02:14:03.951547 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.950700    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb"} err="failed to get container status \"76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb\": rpc error: code = NotFound desc = could not find container \"76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb\": container with ID starting with 76663368f8b3e2ecc3d6c594025b6b2f5147083b7426ae6644d61f934512d8fb not found: ID does not exist"
Sep 08 02:14:03.951547 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.950726    2562 scope.go:117] "RemoveContainer" containerID="2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"
Sep 08 02:14:03.951547 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:14:03.951212    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9\": container with ID starting with 2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9 not found: ID does not exist" containerID="2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"
Sep 08 02:14:03.951547 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.951273    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9"} err="failed to get container status \"2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9\": rpc error: code = NotFound desc = could not find container \"2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9\": container with ID starting with 2cc17b97dd95b5e80037e13aa0ffe81b8ab3d29cc61aa91ddd517bcfc9efd3c9 not found: ID does not exist"
Sep 08 02:14:03.953245 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.953221    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"]
Sep 08 02:14:03.956034 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:03.956011    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b1ffefe6-openshift-default-6f6d479764-smr6j"]
Sep 08 02:14:04.333359 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:04.333315    2562 patch_prober.go:28] interesting pod/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 02:14:04.333858 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:04.333381    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 02:14:05.070470 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:05.070435    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" path="/var/lib/kubelet/pods/8badd3d8-50a1-4e79-b38d-b1909bd39b0b/volumes"
Sep 08 02:14:05.333252 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:05.333156    2562 patch_prober.go:28] interesting pod/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 02:14:05.333527 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:05.333494    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 02:14:05.492463 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:05.492430    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:05.874813 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:05.874770    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:05.932335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:05.932306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:06.000516 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:06.000483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:06.101209 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:06.101175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:06.202130 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:06.202043    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:06.333388 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:06.333348    2562 patch_prober.go:28] interesting pod/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Sep 08 02:14:06.333709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:06.333676    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Sep 08 02:14:06.520332 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:06.520257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:07.337223 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:07.337194    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:14:07.337621 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:07.337498    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:14:07.338256 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:07.338235    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:14:11.505108 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:11.505071    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:14:18.209305 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:18.209274    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:22.513062 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:22.513005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:14:32.235937 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:32.235837    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:32.378216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:32.378174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:38.161126 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:38.161093    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:38.265648 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:38.265608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:38.362176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:38.362143    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:38.918657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:38.918620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:14:54.118384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:54.118336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:54.208323 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:54.208290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:14:59.836285 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:59.836236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:59.891011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:59.890980    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:14:59.960712 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:14:59.960678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:00.059391 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.059336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:00.150473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150391    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"]
Sep 08 02:15:00.150792 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150780    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy"
Sep 08 02:15:00.150837 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150794    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy"
Sep 08 02:15:00.150837 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150815    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy"
Sep 08 02:15:00.150837 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150820    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy"
Sep 08 02:15:00.150837 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150830    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99571eae-da44-4057-8399-04e047d296d0" containerName="revoke-keys"
Sep 08 02:15:00.150837 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150836    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="99571eae-da44-4057-8399-04e047d296d0" containerName="revoke-keys"
Sep 08 02:15:00.151040 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150892    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="99571eae-da44-4057-8399-04e047d296d0" containerName="revoke-keys"
Sep 08 02:15:00.151040 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.150904    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy"
Sep 08 02:15:00.154128 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.154106    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"]
Sep 08 02:15:00.154250 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.154214    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"
Sep 08 02:15:00.154541 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.154529    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8badd3d8-50a1-4e79-b38d-b1909bd39b0b" containerName="istio-proxy"
Sep 08 02:15:00.156864 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.156847    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:15:00.157969 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.157956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"
Sep 08 02:15:00.162495 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.162343    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"]
Sep 08 02:15:00.167709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.167691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"
Sep 08 02:15:00.168072 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.168051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"]
Sep 08 02:15:00.176411 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.176393    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"
Sep 08 02:15:00.448019 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.447932    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"]
Sep 08 02:15:00.450939 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:15:00.450899    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7de6c61e_27b6_4846_9e91_678541705d02.slice/crio-3709c566fc7d565b9a1b9bb315aa11b28ba46c0d784bf34ccd1ec44db9b51972 WatchSource:0}: Error finding container 3709c566fc7d565b9a1b9bb315aa11b28ba46c0d784bf34ccd1ec44db9b51972: Status 404 returned error can't find the container with id 3709c566fc7d565b9a1b9bb315aa11b28ba46c0d784bf34ccd1ec44db9b51972
Sep 08 02:15:00.462213 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:00.462193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"]
Sep 08 02:15:00.465270 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:15:00.465247    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c96eb59_e265_4e30_a7cc_4db6619c0bd4.slice/crio-1f9027ccb7a748055dbe83a51a21661a78aaad5dd948873accc27d1ffed53c72 WatchSource:0}: Error finding container 1f9027ccb7a748055dbe83a51a21661a78aaad5dd948873accc27d1ffed53c72: Status 404 returned error can't find the container with id 1f9027ccb7a748055dbe83a51a21661a78aaad5dd948873accc27d1ffed53c72
Sep 08 02:15:01.225464 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.225422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h" event={"ID":"4c96eb59-e265-4e30-a7cc-4db6619c0bd4","Type":"ContainerStarted","Data":"bb5039309699b9bab1eb33200cefb5f66a78d078a8942cd407949db5ac3f4dbe"}
Sep 08 02:15:01.226003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.225489    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h" event={"ID":"4c96eb59-e265-4e30-a7cc-4db6619c0bd4","Type":"ContainerStarted","Data":"1f9027ccb7a748055dbe83a51a21661a78aaad5dd948873accc27d1ffed53c72"}
Sep 08 02:15:01.227308 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.227276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt" event={"ID":"7de6c61e-27b6-4846-9e91-678541705d02","Type":"ContainerStarted","Data":"e93ae831bd80fc4580ef05e5a16df2bd8822006dcb2c1d577f6069bb6b7b699a"}
Sep 08 02:15:01.227440 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.227327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt" event={"ID":"7de6c61e-27b6-4846-9e91-678541705d02","Type":"ContainerStarted","Data":"3709c566fc7d565b9a1b9bb315aa11b28ba46c0d784bf34ccd1ec44db9b51972"}
Sep 08 02:15:01.242466 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.242418    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h" podStartSLOduration=1.242400144 podStartE2EDuration="1.242400144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:15:01.241123549 +0000 UTC m=+958.696738487" watchObservedRunningTime="2026-09-08 02:15:01.242400144 +0000 UTC m=+958.698015057"
Sep 08 02:15:01.255037 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.254969    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt" podStartSLOduration=1.254946063 podStartE2EDuration="1.254946063s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:15:01.2544829 +0000 UTC m=+958.710097835" watchObservedRunningTime="2026-09-08 02:15:01.254946063 +0000 UTC m=+958.710560973"
Sep 08 02:15:01.641052 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.640986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:01.729811 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.729775    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"]
Sep 08 02:15:01.733333 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.733310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:01.735755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.735726    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:15:01.740024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.739995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"]
Sep 08 02:15:01.818231 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.818194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ede16-50ca-4b2c-95b9-f52b62825b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-173970-bxlpv\" (UID: \"5d9ede16-50ca-4b2c-95b9-f52b62825b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:01.919567 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.919477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ede16-50ca-4b2c-95b9-f52b62825b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-173970-bxlpv\" (UID: \"5d9ede16-50ca-4b2c-95b9-f52b62825b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:01.920099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:01.920082    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ede16-50ca-4b2c-95b9-f52b62825b70-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-173970-bxlpv\" (UID: \"5d9ede16-50ca-4b2c-95b9-f52b62825b70\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:02.046724 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:02.046677    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:02.234578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:02.234490    2562 generic.go:356] "Generic (PLEG): container finished" podID="4c96eb59-e265-4e30-a7cc-4db6619c0bd4" containerID="bb5039309699b9bab1eb33200cefb5f66a78d078a8942cd407949db5ac3f4dbe" exitCode=0
Sep 08 02:15:02.234578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:02.234562    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h" event={"ID":"4c96eb59-e265-4e30-a7cc-4db6619c0bd4","Type":"ContainerDied","Data":"bb5039309699b9bab1eb33200cefb5f66a78d078a8942cd407949db5ac3f4dbe"}
Sep 08 02:15:02.236169 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:02.236134    2562 generic.go:356] "Generic (PLEG): container finished" podID="7de6c61e-27b6-4846-9e91-678541705d02" containerID="e93ae831bd80fc4580ef05e5a16df2bd8822006dcb2c1d577f6069bb6b7b699a" exitCode=0
Sep 08 02:15:02.236305 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:02.236226    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt" event={"ID":"7de6c61e-27b6-4846-9e91-678541705d02","Type":"ContainerDied","Data":"e93ae831bd80fc4580ef05e5a16df2bd8822006dcb2c1d577f6069bb6b7b699a"}
Sep 08 02:15:02.320166 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:02.320133    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"]
Sep 08 02:15:02.321598 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:15:02.321572    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d9ede16_50ca_4b2c_95b9_f52b62825b70.slice/crio-d12d47636c3d952d2444497b04f3c3221a1b518b9329fb7ab2546a1729fbac8b WatchSource:0}: Error finding container d12d47636c3d952d2444497b04f3c3221a1b518b9329fb7ab2546a1729fbac8b: Status 404 returned error can't find the container with id d12d47636c3d952d2444497b04f3c3221a1b518b9329fb7ab2546a1729fbac8b
Sep 08 02:15:03.243013 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:03.242979    2562 generic.go:356] "Generic (PLEG): container finished" podID="5d9ede16-50ca-4b2c-95b9-f52b62825b70" containerID="e26dc595952fc9a667d5550d3b39173da1ee3b5ede8c1fbbfe6a9afa03eac7a9" exitCode=0
Sep 08 02:15:03.243405 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:03.243061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv" event={"ID":"5d9ede16-50ca-4b2c-95b9-f52b62825b70","Type":"ContainerDied","Data":"e26dc595952fc9a667d5550d3b39173da1ee3b5ede8c1fbbfe6a9afa03eac7a9"}
Sep 08 02:15:03.243405 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:03.243113    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv" event={"ID":"5d9ede16-50ca-4b2c-95b9-f52b62825b70","Type":"ContainerStarted","Data":"d12d47636c3d952d2444497b04f3c3221a1b518b9329fb7ab2546a1729fbac8b"}
Sep 08 02:15:03.380782 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:03.380759    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"
Sep 08 02:15:03.422245 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:03.422220    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"
Sep 08 02:15:04.249461 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.249431    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"
Sep 08 02:15:04.249869 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.249431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h" event={"ID":"4c96eb59-e265-4e30-a7cc-4db6619c0bd4","Type":"ContainerDied","Data":"1f9027ccb7a748055dbe83a51a21661a78aaad5dd948873accc27d1ffed53c72"}
Sep 08 02:15:04.249869 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.249584    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f9027ccb7a748055dbe83a51a21661a78aaad5dd948873accc27d1ffed53c72"
Sep 08 02:15:04.250801 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.250787    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"
Sep 08 02:15:04.250864 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.250841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt" event={"ID":"7de6c61e-27b6-4846-9e91-678541705d02","Type":"ContainerDied","Data":"3709c566fc7d565b9a1b9bb315aa11b28ba46c0d784bf34ccd1ec44db9b51972"}
Sep 08 02:15:04.250926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.250885    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3709c566fc7d565b9a1b9bb315aa11b28ba46c0d784bf34ccd1ec44db9b51972"
Sep 08 02:15:04.386346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.386320    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:04.445093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.445065    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ede16-50ca-4b2c-95b9-f52b62825b70-maas-api-service-ca\") pod \"5d9ede16-50ca-4b2c-95b9-f52b62825b70\" (UID: \"5d9ede16-50ca-4b2c-95b9-f52b62825b70\") "
Sep 08 02:15:04.445410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.445389    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d9ede16-50ca-4b2c-95b9-f52b62825b70-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5d9ede16-50ca-4b2c-95b9-f52b62825b70" (UID: "5d9ede16-50ca-4b2c-95b9-f52b62825b70"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:15:04.546731 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:04.546700    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5d9ede16-50ca-4b2c-95b9-f52b62825b70-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:05.258029 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:05.257999    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"
Sep 08 02:15:05.258401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:05.258038    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv" event={"ID":"5d9ede16-50ca-4b2c-95b9-f52b62825b70","Type":"ContainerDied","Data":"d12d47636c3d952d2444497b04f3c3221a1b518b9329fb7ab2546a1729fbac8b"}
Sep 08 02:15:05.258401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:05.258083    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d12d47636c3d952d2444497b04f3c3221a1b518b9329fb7ab2546a1729fbac8b"
Sep 08 02:15:06.311970 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:06.311933    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:15:10.507656 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:10.507624    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:11.251118 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:11.251087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:12.121545 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.121505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:12.187681 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.187650    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"]
Sep 08 02:15:12.189520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.189498    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-explicit-173970-29813895-n9j4h"]
Sep 08 02:15:12.244530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.244501    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:12.344127 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.344092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:12.361795 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.361762    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"]
Sep 08 02:15:12.365267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.365237    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-173970-bxlpv"]
Sep 08 02:15:12.445010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.444933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:12.693521 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:12.693486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:13.070128 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:13.070099    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c96eb59-e265-4e30-a7cc-4db6619c0bd4" path="/var/lib/kubelet/pods/4c96eb59-e265-4e30-a7cc-4db6619c0bd4/volumes"
Sep 08 02:15:13.070409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:13.070397    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d9ede16-50ca-4b2c-95b9-f52b62825b70" path="/var/lib/kubelet/pods/5d9ede16-50ca-4b2c-95b9-f52b62825b70/volumes"
Sep 08 02:15:16.916777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:16.916747    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:17.022043 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:17.022008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:17.117216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:17.117183    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:17.242603 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:17.242522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:17.298233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:17.298198    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:15:17.832454 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:17.832405    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:17.928262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:17.928232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:18.025842 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:18.025807    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:18.858225 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:18.858184    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:18.957857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:18.957825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:19.073272 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:19.073237    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"]
Sep 08 02:15:19.073514 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:19.073481    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" containerID="cri-o://0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd" gracePeriod=30
Sep 08 02:15:19.095811 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:19.095786    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:19.410266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:19.410235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:19.511880 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:19.511844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:19.772088 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:19.772008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:20.425670 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:20.425640    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:22.340334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:22.340292    2562 patch_prober.go:28] interesting pod/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:15:22.340730 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:22.340391    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:15:24.278332 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.278291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:24.331817 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.331791    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:15:24.345742 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345670    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-socket\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.345888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-podinfo\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.345888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-credential-socket\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.345888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345827    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-envoy\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.345888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istiod-ca-cert\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.345888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345882    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-data\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.346162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.345938    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:15:24.346162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346065    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:15:24.346258 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346206    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-data" (OuterVolumeSpecName: "istio-data") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:15:24.346258 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346228    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:15:24.346454 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346427    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msq8q\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-kube-api-access-msq8q\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.346571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-certs\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.346571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346542    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-token\") pod \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\" (UID: \"259b2ee3-d1ba-4c60-8241-c2aa8594be15\") "
Sep 08 02:15:24.346766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346730    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:15:24.347002 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.346978    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.347109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.347004    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.347109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.347019    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.347109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.347032    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.347109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.347043    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.348191 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.348165    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:15:24.348307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.348269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:15:24.348566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.348548    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-kube-api-access-msq8q" (OuterVolumeSpecName: "kube-api-access-msq8q") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "kube-api-access-msq8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:15:24.348814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.348796    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-token" (OuterVolumeSpecName: "istio-token") pod "259b2ee3-d1ba-4c60-8241-c2aa8594be15" (UID: "259b2ee3-d1ba-4c60-8241-c2aa8594be15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:15:24.358092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.358062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:24.365563 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.365539    2562 generic.go:356] "Generic (PLEG): container finished" podID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerID="0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd" exitCode=0
Sep 08 02:15:24.365669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.365600    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"
Sep 08 02:15:24.365669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.365624    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" event={"ID":"259b2ee3-d1ba-4c60-8241-c2aa8594be15","Type":"ContainerDied","Data":"0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd"}
Sep 08 02:15:24.365786 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.365693    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx" event={"ID":"259b2ee3-d1ba-4c60-8241-c2aa8594be15","Type":"ContainerDied","Data":"22b19829d2e6c6bdad35e6d02b745e06889cdfb83d2c74a8df1ef933a5ea3230"}
Sep 08 02:15:24.365786 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.365727    2562 scope.go:117] "RemoveContainer" containerID="0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd"
Sep 08 02:15:24.375047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.375027    2562 scope.go:117] "RemoveContainer" containerID="fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"
Sep 08 02:15:24.384595 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.384577    2562 scope.go:117] "RemoveContainer" containerID="0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd"
Sep 08 02:15:24.384867 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:15:24.384846    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd\": container with ID starting with 0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd not found: ID does not exist" containerID="0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd"
Sep 08 02:15:24.384974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.384876    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd"} err="failed to get container status \"0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd\": rpc error: code = NotFound desc = could not find container \"0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd\": container with ID starting with 0b529dc567c385d48013bf9a6053ff5e34eb0bb7023954b118dcaa56008e54dd not found: ID does not exist"
Sep 08 02:15:24.384974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.384893    2562 scope.go:117] "RemoveContainer" containerID="fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"
Sep 08 02:15:24.385168 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:15:24.385149    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8\": container with ID starting with fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8 not found: ID does not exist" containerID="fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"
Sep 08 02:15:24.385236 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.385171    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8"} err="failed to get container status \"fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8\": rpc error: code = NotFound desc = could not find container \"fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8\": container with ID starting with fcceac29508883ac54525db43c137d2cbc8a7ad6bbfe8b5359995c11b4c1c3e8 not found: ID does not exist"
Sep 08 02:15:24.398708 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.398685    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"]
Sep 08 02:15:24.403246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.403225    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-173970-openshift-default-6986dd5f68-nljxx"]
Sep 08 02:15:24.448007 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.447967    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.448007 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.448001    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msq8q\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-kube-api-access-msq8q\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.448007 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.448010    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.448007 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.448019    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/259b2ee3-d1ba-4c60-8241-c2aa8594be15-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:24.491106 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:24.491062    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:25.072164 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:25.072077    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" path="/var/lib/kubelet/pods/259b2ee3-d1ba-4c60-8241-c2aa8594be15/volumes"
Sep 08 02:15:25.492677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:25.492547    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:25.552249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:25.552199    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:26.157326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:26.157294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:31.687407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:31.687373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:31.787903 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:31.787869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:31.901317 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:31.901268    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:32.152303 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152267    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"]
Sep 08 02:15:32.152850 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152824    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c96eb59-e265-4e30-a7cc-4db6619c0bd4" containerName="cleanup"
Sep 08 02:15:32.152850 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152849    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c96eb59-e265-4e30-a7cc-4db6619c0bd4" containerName="cleanup"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152866    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d9ede16-50ca-4b2c-95b9-f52b62825b70" containerName="revoke-keys"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152876    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d9ede16-50ca-4b2c-95b9-f52b62825b70" containerName="revoke-keys"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152885    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152891    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152905    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de6c61e-27b6-4846-9e91-678541705d02" containerName="cleanup"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.152927    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de6c61e-27b6-4846-9e91-678541705d02" containerName="cleanup"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.153013    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.153023    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.153036    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c96eb59-e265-4e30-a7cc-4db6619c0bd4" containerName="cleanup"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.153044    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d9ede16-50ca-4b2c-95b9-f52b62825b70" containerName="revoke-keys"
Sep 08 02:15:32.153065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.153054    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de6c61e-27b6-4846-9e91-678541705d02" containerName="cleanup"
Sep 08 02:15:32.156431 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.156410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.159257 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.159232    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8fa74948-openshift-default-dockercfg-8qn2x\""
Sep 08 02:15:32.165084 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.165060    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"]
Sep 08 02:15:32.179192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.179159    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:32.224563 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-certs\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224581    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-data\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv5lf\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-kube-api-access-wv5lf\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224765 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-podinfo\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224765 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-socket\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224765 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-credential-socket\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224778    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-token\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224801    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b416104-b064-4340-85cf-c24a8b8dd30e-istiod-ca-cert\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.224884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.224879    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-envoy\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.291279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.291245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:32.325719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-credential-socket\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.325719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-token\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.325968 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b416104-b064-4340-85cf-c24a8b8dd30e-istiod-ca-cert\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.325968 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325823    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-envoy\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.325968 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325862    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-certs\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.325968 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325937    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-data\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.325980    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv5lf\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-kube-api-access-wv5lf\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326017    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-podinfo\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326050    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-socket\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326181    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-credential-socket\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326203    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-certs\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-socket\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326583    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b416104-b064-4340-85cf-c24a8b8dd30e-istiod-ca-cert\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.326723 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.326599    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-data\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.328110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.328088    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-envoy\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.328379 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.328363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-podinfo\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.339907 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.339882    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-token\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.340854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.340836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv5lf\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-kube-api-access-wv5lf\") pod \"e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") " pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.469901 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.469821    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:32.710863 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.710824    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:15:32.745517 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.745495    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"]
Sep 08 02:15:32.747847 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:15:32.747818    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b416104_b064_4340_85cf_c24a8b8dd30e.slice/crio-195cf50481d598f21014a1eb03e0ae8fe7b016b05f6b887177bf86754352914c WatchSource:0}: Error finding container 195cf50481d598f21014a1eb03e0ae8fe7b016b05f6b887177bf86754352914c: Status 404 returned error can't find the container with id 195cf50481d598f21014a1eb03e0ae8fe7b016b05f6b887177bf86754352914c
Sep 08 02:15:32.750006 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.749979    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:15:32.750064 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.750056    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:15:32.750100 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:32.750086    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:15:33.428989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:33.428931    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" event={"ID":"7b416104-b064-4340-85cf-c24a8b8dd30e","Type":"ContainerStarted","Data":"2442adeecb571de17a5c6f824b2e1bbcd9a6a46c3903b691e24dacbf55d30104"}
Sep 08 02:15:33.429172 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:33.429043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" event={"ID":"7b416104-b064-4340-85cf-c24a8b8dd30e","Type":"ContainerStarted","Data":"195cf50481d598f21014a1eb03e0ae8fe7b016b05f6b887177bf86754352914c"}
Sep 08 02:15:33.448792 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:33.448742    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podStartSLOduration=1.448726524 podStartE2EDuration="1.448726524s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:15:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:15:33.447518955 +0000 UTC m=+990.903133916" watchObservedRunningTime="2026-09-08 02:15:33.448726524 +0000 UTC m=+990.904341437"
Sep 08 02:15:33.470698 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:33.470664    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:33.477098 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:33.477071    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:34.434382 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:34.434344    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:34.435296 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:34.435276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:35.284764 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:35.284733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:35.379756 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:35.379725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:36.545177 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:36.545145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:36.598785 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:36.598757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:36.861594 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:36.861509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:36.993188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:36.993157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:37.091598 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:37.091563    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:44.416442 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:44.416408    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:47.021336 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:47.021292    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:48.124006 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:48.123968    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:15:48.213212 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:48.213179    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:48.319345 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:48.319313    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:48.527977 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:48.527893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:48.629556 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:48.629505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:49.176071 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.176035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:49.219050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.219019    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"]
Sep 08 02:15:49.219472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.219456    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy"
Sep 08 02:15:49.219535 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.219474    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="259b2ee3-d1ba-4c60-8241-c2aa8594be15" containerName="istio-proxy"
Sep 08 02:15:49.223821 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.223803    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:49.227188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.227162    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:15:49.227508 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.227163    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:15:49.228728 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.228705    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"]
Sep 08 02:15:49.325525 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.325494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:49.405549 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.405362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f72954-dfb8-4a4e-a0cd-94bb1801432e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k\" (UID: \"f6f72954-dfb8-4a4e-a0cd-94bb1801432e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:49.506406 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.506322    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f72954-dfb8-4a4e-a0cd-94bb1801432e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k\" (UID: \"f6f72954-dfb8-4a4e-a0cd-94bb1801432e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:49.506966 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.506947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f72954-dfb8-4a4e-a0cd-94bb1801432e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k\" (UID: \"f6f72954-dfb8-4a4e-a0cd-94bb1801432e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:49.537926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.537885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:49.814424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:49.814395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"]
Sep 08 02:15:49.816208 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:15:49.816178    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f72954_dfb8_4a4e_a0cd_94bb1801432e.slice/crio-9f1e21e3bf62a1d96f20c7d4f1cf1988e51347387f67397f019fb254f00d063e WatchSource:0}: Error finding container 9f1e21e3bf62a1d96f20c7d4f1cf1988e51347387f67397f019fb254f00d063e: Status 404 returned error can't find the container with id 9f1e21e3bf62a1d96f20c7d4f1cf1988e51347387f67397f019fb254f00d063e
Sep 08 02:15:50.476140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:50.476047    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:15:50.476140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:50.476121    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:15:50.519756 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:50.519728    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k" event={"ID":"f6f72954-dfb8-4a4e-a0cd-94bb1801432e","Type":"ContainerStarted","Data":"e06f5f6d75d655bd817768484b9ab62b40b11b9988c561022fa523d03acd82bc"}
Sep 08 02:15:50.519888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:50.519780    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k" event={"ID":"f6f72954-dfb8-4a4e-a0cd-94bb1801432e","Type":"ContainerStarted","Data":"9f1e21e3bf62a1d96f20c7d4f1cf1988e51347387f67397f019fb254f00d063e"}
Sep 08 02:15:50.539125 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:50.539083    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k" podStartSLOduration=1.539067806 podStartE2EDuration="1.539067806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:15:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:15:50.536142116 +0000 UTC m=+1007.991757030" watchObservedRunningTime="2026-09-08 02:15:50.539067806 +0000 UTC m=+1007.994682718"
Sep 08 02:15:51.526861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.526828    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerID="2442adeecb571de17a5c6f824b2e1bbcd9a6a46c3903b691e24dacbf55d30104" exitCode=0
Sep 08 02:15:51.527335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.526905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" event={"ID":"7b416104-b064-4340-85cf-c24a8b8dd30e","Type":"ContainerDied","Data":"2442adeecb571de17a5c6f824b2e1bbcd9a6a46c3903b691e24dacbf55d30104"}
Sep 08 02:15:51.527414 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.527369    2562 scope.go:117] "RemoveContainer" containerID="2442adeecb571de17a5c6f824b2e1bbcd9a6a46c3903b691e24dacbf55d30104"
Sep 08 02:15:51.528589 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.528555    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:15:51.528687 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.528631    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:15:51.528687 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.528662    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:15:51.528687 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.528656    2562 generic.go:356] "Generic (PLEG): container finished" podID="f6f72954-dfb8-4a4e-a0cd-94bb1801432e" containerID="e06f5f6d75d655bd817768484b9ab62b40b11b9988c561022fa523d03acd82bc" exitCode=0
Sep 08 02:15:51.528810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:51.528696    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k" event={"ID":"f6f72954-dfb8-4a4e-a0cd-94bb1801432e","Type":"ContainerDied","Data":"e06f5f6d75d655bd817768484b9ab62b40b11b9988c561022fa523d03acd82bc"}
Sep 08 02:15:52.541157 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:52.540119    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" event={"ID":"7b416104-b064-4340-85cf-c24a8b8dd30e","Type":"ContainerStarted","Data":"c6ecbe3d6840a8950367888d976f1364503df3756836ab7f7edbabd5987a806d"}
Sep 08 02:15:52.706922 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:52.706888    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:52.851473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:52.851305    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f72954-dfb8-4a4e-a0cd-94bb1801432e-maas-api-service-ca\") pod \"f6f72954-dfb8-4a4e-a0cd-94bb1801432e\" (UID: \"f6f72954-dfb8-4a4e-a0cd-94bb1801432e\") "
Sep 08 02:15:52.851746 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:52.851692    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f72954-dfb8-4a4e-a0cd-94bb1801432e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f6f72954-dfb8-4a4e-a0cd-94bb1801432e" (UID: "f6f72954-dfb8-4a4e-a0cd-94bb1801432e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:15:52.851901 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:52.851814    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6f72954-dfb8-4a4e-a0cd-94bb1801432e-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:15:53.470473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.470432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:53.470666 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.470647    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 02:15:53.470714 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.470689    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 02:15:53.550928 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.550872    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k" event={"ID":"f6f72954-dfb8-4a4e-a0cd-94bb1801432e","Type":"ContainerDied","Data":"9f1e21e3bf62a1d96f20c7d4f1cf1988e51347387f67397f019fb254f00d063e"}
Sep 08 02:15:53.551494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.551460    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f1e21e3bf62a1d96f20c7d4f1cf1988e51347387f67397f019fb254f00d063e"
Sep 08 02:15:53.551494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.550933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"
Sep 08 02:15:53.713213 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:53.713173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:54.470398 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:54.470362    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 02:15:54.470596 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:54.470419    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 02:15:55.470525 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:55.470485    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 02:15:55.470962 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:55.470546    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 02:15:56.470604 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:56.470566    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 02:15:56.470992 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:56.470635    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 02:15:57.367859 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:57.367817    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:57.470879 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:57.470831    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Sep 08 02:15:57.471277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:57.470932    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Sep 08 02:15:58.474428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:58.474396    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:58.474882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:58.474689    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:58.475334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:58.475319    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:15:59.306586 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:59.306547    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:15:59.337391 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:59.337362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:59.922792 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:59.922759    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:15:59.987079 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:15:59.987035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:00.049355 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.049319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:00.098167 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.098136    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"]
Sep 08 02:16:00.100086 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.100060    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5d27de-mwj8k"]
Sep 08 02:16:00.150473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.150439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:00.312356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.312325    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:00.425438 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.425406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:00.814142 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.814094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:00.912839 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:00.912804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:01.070458 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:01.070380    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f72954-dfb8-4a4e-a0cd-94bb1801432e" path="/var/lib/kubelet/pods/f6f72954-dfb8-4a4e-a0cd-94bb1801432e/volumes"
Sep 08 02:16:01.211634 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:01.211603    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:06.155149 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.155109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:06.255564 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.255515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:06.377513 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.377477    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"]
Sep 08 02:16:06.377706 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.377685    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy" containerID="cri-o://74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a" gracePeriod=30
Sep 08 02:16:06.396228 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.396203    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:06.812164 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.812124    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"]
Sep 08 02:16:06.812607 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.812592    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f72954-dfb8-4a4e-a0cd-94bb1801432e" containerName="revoke-keys"
Sep 08 02:16:06.812652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.812609    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f72954-dfb8-4a4e-a0cd-94bb1801432e" containerName="revoke-keys"
Sep 08 02:16:06.812753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.812743    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f72954-dfb8-4a4e-a0cd-94bb1801432e" containerName="revoke-keys"
Sep 08 02:16:06.817131 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.817114    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:06.819906 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.819883    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:16:06.820105 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.820011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:16:06.822794 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.822769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"]
Sep 08 02:16:06.887168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.887133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eaac3ce-8c14-42a7-a839-bb052f9fb93e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs\" (UID: \"3eaac3ce-8c14-42a7-a839-bb052f9fb93e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:06.939737 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.939697    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:06.988690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.988656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eaac3ce-8c14-42a7-a839-bb052f9fb93e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs\" (UID: \"3eaac3ce-8c14-42a7-a839-bb052f9fb93e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:06.989288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:06.989269    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eaac3ce-8c14-42a7-a839-bb052f9fb93e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs\" (UID: \"3eaac3ce-8c14-42a7-a839-bb052f9fb93e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:07.129472 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:07.129380    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:07.401192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:07.401163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"]
Sep 08 02:16:07.402688 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:16:07.402656    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eaac3ce_8c14_42a7_a839_bb052f9fb93e.slice/crio-eb77d95e44ff2e03ef7468de1c9716cefd211692ba940597df5fdc314678bf86 WatchSource:0}: Error finding container eb77d95e44ff2e03ef7468de1c9716cefd211692ba940597df5fdc314678bf86: Status 404 returned error can't find the container with id eb77d95e44ff2e03ef7468de1c9716cefd211692ba940597df5fdc314678bf86
Sep 08 02:16:07.518098 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:07.518059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:07.618613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:07.618577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:07.650719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:07.650652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs" event={"ID":"3eaac3ce-8c14-42a7-a839-bb052f9fb93e","Type":"ContainerStarted","Data":"eb77d95e44ff2e03ef7468de1c9716cefd211692ba940597df5fdc314678bf86"}
Sep 08 02:16:08.151462 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:08.151434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:08.657489 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:08.657457    2562 generic.go:356] "Generic (PLEG): container finished" podID="3eaac3ce-8c14-42a7-a839-bb052f9fb93e" containerID="bf540c76db660628d93eba9633c42069cb6d7e86cb2e3fb87690ddce9d5e8913" exitCode=0
Sep 08 02:16:08.657844 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:08.657538    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs" event={"ID":"3eaac3ce-8c14-42a7-a839-bb052f9fb93e","Type":"ContainerDied","Data":"bf540c76db660628d93eba9633c42069cb6d7e86cb2e3fb87690ddce9d5e8913"}
Sep 08 02:16:08.812465 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:08.812428    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:16:09.795229 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:09.795205    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:09.917109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:09.917037    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eaac3ce-8c14-42a7-a839-bb052f9fb93e-maas-api-service-ca\") pod \"3eaac3ce-8c14-42a7-a839-bb052f9fb93e\" (UID: \"3eaac3ce-8c14-42a7-a839-bb052f9fb93e\") "
Sep 08 02:16:09.917380 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:09.917359    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eaac3ce-8c14-42a7-a839-bb052f9fb93e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3eaac3ce-8c14-42a7-a839-bb052f9fb93e" (UID: "3eaac3ce-8c14-42a7-a839-bb052f9fb93e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:16:10.018433 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:10.018401    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eaac3ce-8c14-42a7-a839-bb052f9fb93e-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:10.669780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:10.669748    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"
Sep 08 02:16:10.669780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:10.669764    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs" event={"ID":"3eaac3ce-8c14-42a7-a839-bb052f9fb93e","Type":"ContainerDied","Data":"eb77d95e44ff2e03ef7468de1c9716cefd211692ba940597df5fdc314678bf86"}
Sep 08 02:16:10.670030 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:10.669808    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eb77d95e44ff2e03ef7468de1c9716cefd211692ba940597df5fdc314678bf86"
Sep 08 02:16:11.635602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.635577    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:16:11.679280 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.679194    2562 generic.go:356] "Generic (PLEG): container finished" podID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerID="74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a" exitCode=0
Sep 08 02:16:11.679280 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.679228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" event={"ID":"f9042c1a-1dd4-481b-b1ab-522d29813ab3","Type":"ContainerDied","Data":"74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a"}
Sep 08 02:16:11.679280 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.679242    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"
Sep 08 02:16:11.679538 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.679307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6" event={"ID":"f9042c1a-1dd4-481b-b1ab-522d29813ab3","Type":"ContainerDied","Data":"474ef844c3550291704b3b403df4b68a8279500a0617ff0654d174b10a54010b"}
Sep 08 02:16:11.679538 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.679331    2562 scope.go:117] "RemoveContainer" containerID="74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a"
Sep 08 02:16:11.688399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.688380    2562 scope.go:117] "RemoveContainer" containerID="7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"
Sep 08 02:16:11.696627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.696610    2562 scope.go:117] "RemoveContainer" containerID="74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a"
Sep 08 02:16:11.696888 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:16:11.696869    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a\": container with ID starting with 74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a not found: ID does not exist" containerID="74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a"
Sep 08 02:16:11.696969 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.696895    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a"} err="failed to get container status \"74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a\": rpc error: code = NotFound desc = could not find container \"74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a\": container with ID starting with 74cfb4b7a3e9499c8268d2266d78bdd0f0d63580b34502b52f6f20e662af315a not found: ID does not exist"
Sep 08 02:16:11.696969 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.696927    2562 scope.go:117] "RemoveContainer" containerID="7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"
Sep 08 02:16:11.697207 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:16:11.697189    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e\": container with ID starting with 7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e not found: ID does not exist" containerID="7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"
Sep 08 02:16:11.697262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.697212    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e"} err="failed to get container status \"7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e\": rpc error: code = NotFound desc = could not find container \"7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e\": container with ID starting with 7ed2514d70400d3cce7eee0d9b04eca2a2bb744f383bacd53fef0abffdc4522e not found: ID does not exist"
Sep 08 02:16:11.737700 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737660    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-envoy\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.737857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-token\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.737857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737741    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-podinfo\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.737857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737759    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-socket\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.737857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-certs\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.737857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737819    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzwgn\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-kube-api-access-dzwgn\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.738175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737863    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-credential-socket\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.738175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.737974    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istiod-ca-cert\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.738175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-data\") pod \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\" (UID: \"f9042c1a-1dd4-481b-b1ab-522d29813ab3\") "
Sep 08 02:16:11.738324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738229    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:11.738374 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738331    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:11.738462 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738438    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:11.738462 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738452    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-data" (OuterVolumeSpecName: "istio-data") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:11.738644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738621    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.738696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738650    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.738696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738666    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.738696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738679    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.738696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.738647    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:16:11.740153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.740122    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:16:11.740273 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.740176    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-kube-api-access-dzwgn" (OuterVolumeSpecName: "kube-api-access-dzwgn") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "kube-api-access-dzwgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:16:11.740461 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.740441    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-token" (OuterVolumeSpecName: "istio-token") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:16:11.740500 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.740446    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f9042c1a-1dd4-481b-b1ab-522d29813ab3" (UID: "f9042c1a-1dd4-481b-b1ab-522d29813ab3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:11.839672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.839640    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.839672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.839666    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.839672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.839674    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.839889 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.839683    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f9042c1a-1dd4-481b-b1ab-522d29813ab3-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:11.839889 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:11.839692    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzwgn\" (UniqueName: \"kubernetes.io/projected/f9042c1a-1dd4-481b-b1ab-522d29813ab3-kube-api-access-dzwgn\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:12.001230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:12.001201    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"]
Sep 08 02:16:12.005807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:12.005780    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-5d27de-openshift-default-66b48fcbd4-p2zf6"]
Sep 08 02:16:13.070524 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:13.070490    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" path="/var/lib/kubelet/pods/f9042c1a-1dd4-481b-b1ab-522d29813ab3/volumes"
Sep 08 02:16:16.848374 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:16.848342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:17.395808 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.395771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:17.396304 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.396284    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"]
Sep 08 02:16:17.399866 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.399844    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-8d800a-29813895-2zzbt"]
Sep 08 02:16:17.459271 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.459240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:17.515267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.515221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:17.577327 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.577283    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"]
Sep 08 02:16:17.580260 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.580233    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-8d800a-dnxhs"]
Sep 08 02:16:17.582548 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.582514    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:17.655056 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.654956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:17.939943 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:17.939809    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:18.212653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:18.212558    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:18.611158 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:18.611125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:18.674488 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:18.674456    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:18.736407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:18.736369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:18.914566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:18.914448    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:19.070028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:19.069998    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eaac3ce-8c14-42a7-a839-bb052f9fb93e" path="/var/lib/kubelet/pods/3eaac3ce-8c14-42a7-a839-bb052f9fb93e/volumes"
Sep 08 02:16:19.070385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:19.070318    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de6c61e-27b6-4846-9e91-678541705d02" path="/var/lib/kubelet/pods/7de6c61e-27b6-4846-9e91-678541705d02/volumes"
Sep 08 02:16:19.188062 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:19.187946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:21.211982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:21.211947    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:16:23.891270 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:23.891224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:23.952726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:23.952689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:24.123843 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:24.123810    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"]
Sep 08 02:16:24.124071 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:24.124042    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" containerID="cri-o://81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257" gracePeriod=30
Sep 08 02:16:24.148537 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:24.148467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:24.669185 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:24.669155    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:24.967206 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:24.967131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:25.080660 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.080629    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:25.363982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.363949    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:25.463005 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.462950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:25.571379 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.571336    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"]
Sep 08 02:16:25.571621 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.571587    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" containerID="cri-o://c6ecbe3d6840a8950367888d976f1364503df3756836ab7f7edbabd5987a806d" gracePeriod=30
Sep 08 02:16:25.597309 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.597279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:25.915086 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:25.915054    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:26.011308 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:26.011275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:26.123264 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:26.123233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:27.670041 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:27.670001    2562 patch_prober.go:28] interesting pod/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:16:27.670404 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:27.670058    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:16:28.276680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:28.276647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:28.375981 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:28.375942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:28.477225 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:28.477186    2562 patch_prober.go:28] interesting pod/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:16:28.477410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:28.477262    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:16:29.391579 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.391508    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:16:29.451493 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.451460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:29.515143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515111    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-podinfo\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515146    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-data\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515176    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-socket\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515204    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-token\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515245    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istiod-ca-cert\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515277    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-credential-socket\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515306    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9pmq\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-kube-api-access-h9pmq\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515330    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-certs\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515401 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515393    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-envoy\") pod \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\" (UID: \"aed437e3-e7e7-4b22-baa4-88aaba2feeae\") "
Sep 08 02:16:29.515780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515409    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-data" (OuterVolumeSpecName: "istio-data") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:29.515780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515656    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:29.515780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515694    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:29.515780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515732    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:16:29.515780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515755    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:29.516078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515847    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.516078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515867    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.516078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515881    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.516078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.515896    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.517579 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.517551    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-token" (OuterVolumeSpecName: "istio-token") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:16:29.517694 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.517572    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:29.517694 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.517597    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:16:29.517694 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.517677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-kube-api-access-h9pmq" (OuterVolumeSpecName: "kube-api-access-h9pmq") pod "aed437e3-e7e7-4b22-baa4-88aaba2feeae" (UID: "aed437e3-e7e7-4b22-baa4-88aaba2feeae"). InnerVolumeSpecName "kube-api-access-h9pmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:16:29.553677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.553646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:29.617344 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.617311    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.617344 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.617340    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.617522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.617351    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9pmq\" (UniqueName: \"kubernetes.io/projected/aed437e3-e7e7-4b22-baa4-88aaba2feeae-kube-api-access-h9pmq\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.617522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.617362    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.617522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.617378    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aed437e3-e7e7-4b22-baa4-88aaba2feeae-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:29.780996 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.780878    2562 generic.go:356] "Generic (PLEG): container finished" podID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerID="81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257" exitCode=0
Sep 08 02:16:29.780996 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.780947    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"
Sep 08 02:16:29.780996 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.780964    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" event={"ID":"aed437e3-e7e7-4b22-baa4-88aaba2feeae","Type":"ContainerDied","Data":"81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257"}
Sep 08 02:16:29.781262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.781017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2" event={"ID":"aed437e3-e7e7-4b22-baa4-88aaba2feeae","Type":"ContainerDied","Data":"20da5c4dd115430898c2750cd28971f706517095ecf7a90df00aecc8e2955403"}
Sep 08 02:16:29.781262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.781039    2562 scope.go:117] "RemoveContainer" containerID="81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257"
Sep 08 02:16:29.790629 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.790614    2562 scope.go:117] "RemoveContainer" containerID="837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"
Sep 08 02:16:29.799097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.799079    2562 scope.go:117] "RemoveContainer" containerID="81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257"
Sep 08 02:16:29.799353 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:16:29.799339    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257\": container with ID starting with 81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257 not found: ID does not exist" containerID="81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257"
Sep 08 02:16:29.799398 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.799362    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257"} err="failed to get container status \"81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257\": rpc error: code = NotFound desc = could not find container \"81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257\": container with ID starting with 81d025dfb68247b5d676f8f22e0887384474be52dbb7afd56176ef9e887d4257 not found: ID does not exist"
Sep 08 02:16:29.799398 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.799377    2562 scope.go:117] "RemoveContainer" containerID="837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"
Sep 08 02:16:29.799598 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:16:29.799578    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184\": container with ID starting with 837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184 not found: ID does not exist" containerID="837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"
Sep 08 02:16:29.799645 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.799605    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184"} err="failed to get container status \"837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184\": rpc error: code = NotFound desc = could not find container \"837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184\": container with ID starting with 837053c79b492699676c4830ca6e77a52d12632fa0940346c0a2129f446d7184 not found: ID does not exist"
Sep 08 02:16:29.804396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.804374    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"]
Sep 08 02:16:29.808364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.808334    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-8d800a-openshift-default-78fbdfd666-zfpl2"]
Sep 08 02:16:29.837640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:29.837615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:30.009542 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.009512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:30.115092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.115052    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:30.788284 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.788255    2562 generic.go:356] "Generic (PLEG): container finished" podID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerID="c6ecbe3d6840a8950367888d976f1364503df3756836ab7f7edbabd5987a806d" exitCode=0
Sep 08 02:16:30.788706 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.788324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" event={"ID":"7b416104-b064-4340-85cf-c24a8b8dd30e","Type":"ContainerDied","Data":"c6ecbe3d6840a8950367888d976f1364503df3756836ab7f7edbabd5987a806d"}
Sep 08 02:16:30.788706 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.788382    2562 scope.go:117] "RemoveContainer" containerID="2442adeecb571de17a5c6f824b2e1bbcd9a6a46c3903b691e24dacbf55d30104"
Sep 08 02:16:30.829808 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.829785    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:16:30.930795 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.930714    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-envoy\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.930795 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.930767    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-data\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.930796    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-credential-socket\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.930844    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-socket\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.930943    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b416104-b064-4340-85cf-c24a8b8dd30e-istiod-ca-cert\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.930995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-token\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931050 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931031    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-podinfo\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931046    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-data" (OuterVolumeSpecName: "istio-data") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:30.931311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931141    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv5lf\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-kube-api-access-wv5lf\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931159    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:30.931311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931192    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-certs\") pod \"7b416104-b064-4340-85cf-c24a8b8dd30e\" (UID: \"7b416104-b064-4340-85cf-c24a8b8dd30e\") "
Sep 08 02:16:30.931311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931270    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:30.931544 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931353    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b416104-b064-4340-85cf-c24a8b8dd30e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:16:30.931544 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931534    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:30.931717 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931686    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:30.931717 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931712    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7b416104-b064-4340-85cf-c24a8b8dd30e-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:30.931810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931728    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:30.931810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931747    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:30.931810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.931759    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:30.933203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.933172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:16:30.933305 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.933205    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-kube-api-access-wv5lf" (OuterVolumeSpecName: "kube-api-access-wv5lf") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "kube-api-access-wv5lf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:16:30.933380 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.933369    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:16:30.933417 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:30.933384    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-token" (OuterVolumeSpecName: "istio-token") pod "7b416104-b064-4340-85cf-c24a8b8dd30e" (UID: "7b416104-b064-4340-85cf-c24a8b8dd30e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:16:31.032758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.032728    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:31.032758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.032753    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:31.032758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.032762    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7b416104-b064-4340-85cf-c24a8b8dd30e-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:31.032989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.032771    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv5lf\" (UniqueName: \"kubernetes.io/projected/7b416104-b064-4340-85cf-c24a8b8dd30e-kube-api-access-wv5lf\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:16:31.070957 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.070926    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" path="/var/lib/kubelet/pods/aed437e3-e7e7-4b22-baa4-88aaba2feeae/volumes"
Sep 08 02:16:31.358220 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.358191    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:31.795786 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.795753    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"
Sep 08 02:16:31.796230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.795784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d" event={"ID":"7b416104-b064-4340-85cf-c24a8b8dd30e","Type":"ContainerDied","Data":"195cf50481d598f21014a1eb03e0ae8fe7b016b05f6b887177bf86754352914c"}
Sep 08 02:16:31.796230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.795846    2562 scope.go:117] "RemoveContainer" containerID="c6ecbe3d6840a8950367888d976f1364503df3756836ab7f7edbabd5987a806d"
Sep 08 02:16:31.823538 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.823513    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"]
Sep 08 02:16:31.825278 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:31.825247    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8fa74948-openshift-default-5d48b7d6f6-9cc4d"]
Sep 08 02:16:32.386201 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:32.386160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:32.453989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:32.453956    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:32.534485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:32.534455    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:32.637611 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:32.637515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:32.736780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:32.736745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:33.070111 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:33.070072    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" path="/var/lib/kubelet/pods/7b416104-b064-4340-85cf-c24a8b8dd30e/volumes"
Sep 08 02:16:33.117753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:33.117717    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:16:38.253840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:38.253802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:38.352840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:38.352806    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:39.111718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.111688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:39.373499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.373408    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"]
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374014    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374030    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374043    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374048    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374058    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eaac3ce-8c14-42a7-a839-bb052f9fb93e" containerName="revoke-keys"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374063    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eaac3ce-8c14-42a7-a839-bb052f9fb93e" containerName="revoke-keys"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374071    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374077    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374090    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374098    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374176    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy"
Sep 08 02:16:39.374178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374185    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy"
Sep 08 02:16:39.374553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374191    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy"
Sep 08 02:16:39.374553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374198    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy"
Sep 08 02:16:39.374553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374205    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eaac3ce-8c14-42a7-a839-bb052f9fb93e" containerName="revoke-keys"
Sep 08 02:16:39.374553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.374210    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy"
Sep 08 02:16:39.378798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.378775    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.381469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.381446    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-670bc3-openshift-default-dockercfg-9czt8\""
Sep 08 02:16:39.389836 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.389808    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"]
Sep 08 02:16:39.405325 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.405298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:39.416985 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.416959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-credential-socket\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-podinfo\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-envoy\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417102    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istiod-ca-cert\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-certs\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-socket\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6xjt\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-kube-api-access-s6xjt\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417192    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-token\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.417324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.417208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-data\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518388 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518351    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istiod-ca-cert\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-certs\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-socket\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518450    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6xjt\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-kube-api-access-s6xjt\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-token\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518804 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-data\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518804 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-credential-socket\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518804 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518746    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-podinfo\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.518804 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-envoy\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.519045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.518942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-socket\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.519045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.519036    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-certs\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.519161 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.519039    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-data\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.519161 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.519111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-credential-socket\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.519161 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.519157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istiod-ca-cert\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.521125 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.521091    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-envoy\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.521272 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.521255    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-podinfo\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.526396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.526372    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-token\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.526818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.526794    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6xjt\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-kube-api-access-s6xjt\") pod \"e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") " pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.595761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.595720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:39.692282 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.692195    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:39.966448 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.966334    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"]
Sep 08 02:16:39.968541 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:16:39.968518    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ca7a321_9cf2_43d1_b633_39ac89e71fd2.slice/crio-df6a12aaf0d7b99132f30b8469e0738256d85021ccba3730c8e302acaa8dbd34 WatchSource:0}: Error finding container df6a12aaf0d7b99132f30b8469e0738256d85021ccba3730c8e302acaa8dbd34: Status 404 returned error can't find the container with id df6a12aaf0d7b99132f30b8469e0738256d85021ccba3730c8e302acaa8dbd34
Sep 08 02:16:39.970778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.970748    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:16:39.970847 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.970812    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:16:39.970881 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:39.970866    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:16:40.855378 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:40.855343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" event={"ID":"4ca7a321-9cf2-43d1-b633-39ac89e71fd2","Type":"ContainerStarted","Data":"02cd24e22d4ce6925c12d39613061f6eba702d7d4f57549ea69d3cbae9d3dc9b"}
Sep 08 02:16:40.855813 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:40.855399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" event={"ID":"4ca7a321-9cf2-43d1-b633-39ac89e71fd2","Type":"ContainerStarted","Data":"df6a12aaf0d7b99132f30b8469e0738256d85021ccba3730c8e302acaa8dbd34"}
Sep 08 02:16:40.876037 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:40.875982    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podStartSLOduration=1.875965726 podStartE2EDuration="1.875965726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:16:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:16:40.873621399 +0000 UTC m=+1058.329236377" watchObservedRunningTime="2026-09-08 02:16:40.875965726 +0000 UTC m=+1058.331580639"
Sep 08 02:16:41.692575 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:41.692533    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:41.697624 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:41.697594    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:41.861013 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:41.860982    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:41.861908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:41.861887    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:16:42.734380 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:42.734341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:42.834526 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:42.834496    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:44.012711 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:44.012680    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:44.113444 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:44.113412    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:44.213585 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:44.213550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:44.476184 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:44.476152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:44.573908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:44.573879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:46.380719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:46.380672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:50.549963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:50.549882    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:50.623807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:50.623774    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:16:53.207194 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.207157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:53.531095 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.531002    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:53.792513 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.792481    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"]
Sep 08 02:16:53.793166 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.793149    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy"
Sep 08 02:16:53.793216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.793170    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b416104-b064-4340-85cf-c24a8b8dd30e" containerName="istio-proxy"
Sep 08 02:16:53.793216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.793186    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy"
Sep 08 02:16:53.793216 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.793198    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="aed437e3-e7e7-4b22-baa4-88aaba2feeae" containerName="istio-proxy"
Sep 08 02:16:53.793314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.793298    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9042c1a-1dd4-481b-b1ab-522d29813ab3" containerName="istio-proxy"
Sep 08 02:16:53.797098 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.797079    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.799515 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.799494    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-527ac8-openshift-default-dockercfg-slgdg\""
Sep 08 02:16:53.808020 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.807996    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"]
Sep 08 02:16:53.820554 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.820524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:53.871566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-envoy\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.871566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871570    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-credential-socket\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.871788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2741744-7012-4018-a2ec-cebfc906242b-istiod-ca-cert\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.871788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2741744-7012-4018-a2ec-cebfc906242b-istio-podinfo\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.871788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871690    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-certs\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.871788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-istio-token\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.871788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871780    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwhcc\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-kube-api-access-vwhcc\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.872021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-data\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.872021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.871893    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-socket\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973355 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973315    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-socket\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-envoy\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-credential-socket\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2741744-7012-4018-a2ec-cebfc906242b-istiod-ca-cert\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2741744-7012-4018-a2ec-cebfc906242b-istio-podinfo\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-certs\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-istio-token\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwhcc\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-kube-api-access-vwhcc\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973568    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-data\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-socket\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.973982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.973840    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-credential-socket\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.974154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.974029    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-certs\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.974274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.974149    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-data\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.974331 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.974262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2741744-7012-4018-a2ec-cebfc906242b-istiod-ca-cert\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.975790 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.975771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-envoy\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.975943 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.975907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2741744-7012-4018-a2ec-cebfc906242b-istio-podinfo\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.983597 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.983570    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-istio-token\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:53.983722 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:53.983702    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwhcc\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-kube-api-access-vwhcc\") pod \"e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") " pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:54.023202 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.023172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:54.109548 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.109466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:54.407766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.407736    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"]
Sep 08 02:16:54.409526 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:16:54.409500    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2741744_7012_4018_a2ec_cebfc906242b.slice/crio-e4e47883158fe7cdb7863ff7146eb566fba9ee79a15a1e72e5726e2583831fd6 WatchSource:0}: Error finding container e4e47883158fe7cdb7863ff7146eb566fba9ee79a15a1e72e5726e2583831fd6: Status 404 returned error can't find the container with id e4e47883158fe7cdb7863ff7146eb566fba9ee79a15a1e72e5726e2583831fd6
Sep 08 02:16:54.411818 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.411784    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:16:54.411899 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.411856    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:16:54.411899 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.411884    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:16:54.935180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.935144    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" event={"ID":"b2741744-7012-4018-a2ec-cebfc906242b","Type":"ContainerStarted","Data":"2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"}
Sep 08 02:16:54.935458 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.935433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" event={"ID":"b2741744-7012-4018-a2ec-cebfc906242b","Type":"ContainerStarted","Data":"e4e47883158fe7cdb7863ff7146eb566fba9ee79a15a1e72e5726e2583831fd6"}
Sep 08 02:16:54.956861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:54.956804    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podStartSLOduration=1.956786943 podStartE2EDuration="1.956786943s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:16:54.955209074 +0000 UTC m=+1072.410824012" watchObservedRunningTime="2026-09-08 02:16:54.956786943 +0000 UTC m=+1072.412401855"
Sep 08 02:16:55.110380 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:55.110341    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:55.115425 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:55.115400    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:55.943884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:55.943851    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:55.950333 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:55.950302    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:16:56.820042 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:56.820011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:56.916321 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:56.916291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:57.944689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:57.944611    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:58.052828 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:58.052793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:58.157859 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:58.157818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:58.454070 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:58.454029    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:16:58.515230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:16:58.515190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:00.976502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:00.976401    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerID="02cd24e22d4ce6925c12d39613061f6eba702d7d4f57549ea69d3cbae9d3dc9b" exitCode=0
Sep 08 02:17:00.976502 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:00.976457    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" event={"ID":"4ca7a321-9cf2-43d1-b633-39ac89e71fd2","Type":"ContainerDied","Data":"02cd24e22d4ce6925c12d39613061f6eba702d7d4f57549ea69d3cbae9d3dc9b"}
Sep 08 02:17:00.976983 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:00.976837    2562 scope.go:117] "RemoveContainer" containerID="02cd24e22d4ce6925c12d39613061f6eba702d7d4f57549ea69d3cbae9d3dc9b"
Sep 08 02:17:00.978077 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:00.978044    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:00.978191 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:00.978132    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:00.978191 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:00.978165    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:01.983958 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:01.983903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" event={"ID":"4ca7a321-9cf2-43d1-b633-39ac89e71fd2","Type":"ContainerStarted","Data":"f87f2f0ba8acaa0033f1d6147ceac301cc7245518262b9172ac493251c144d16"}
Sep 08 02:17:02.027113 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:02.027074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:17:02.693123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:02.693086    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:17:02.693322 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:02.693300    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 02:17:02.693375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:02.693352    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 02:17:03.693434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:03.693389    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 02:17:03.693845 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:03.693465    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 02:17:04.692815 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:04.692778    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 02:17:04.693011 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:04.692834    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 02:17:04.854962 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:04.854905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:05.692669 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:05.692633    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 02:17:05.692849 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:05.692687    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 02:17:06.692543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:06.692509    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 08 02:17:06.693035 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:06.693002    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 08 02:17:07.674196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:07.674163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:07.696423 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:07.696400    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:17:07.696842 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:07.696787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:17:07.697511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:07.697495    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:17:07.996301 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:07.996224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:08.252406 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.252319    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"]
Sep 08 02:17:08.256945 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.256572    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.260936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.260563    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-1d1413-openshift-default-dockercfg-mwftz\""
Sep 08 02:17:08.262736 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.262712    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"]
Sep 08 02:17:08.272883 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.272848    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:08.329677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.329645    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-certs\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.329987 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.329964    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-token\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.330224 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.330204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istiod-ca-cert\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.330422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.330383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-data\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.330591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.330574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-socket\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.330763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.330745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-kube-api-access-cz4vb\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.330953 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.330934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-credential-socket\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.331131 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.331115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-podinfo\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.331325 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.331310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-envoy\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.385790 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.385754    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:08.432233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432194    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-podinfo\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-envoy\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432405    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-certs\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-token\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istiod-ca-cert\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-data\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-socket\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-kube-api-access-cz4vb\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.432608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432585    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-credential-socket\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.433168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.432942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-credential-socket\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.433168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.433040    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-certs\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.433324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.433216    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-data\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.433324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.433290    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-socket\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.436935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.433724    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istiod-ca-cert\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.436935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.435404    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-podinfo\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.444187 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.444157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-envoy\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.453935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.451489    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-kube-api-access-cz4vb\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.453935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.453338    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-token\") pod \"e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") " pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.572630 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.572592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:08.874644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.874616    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"]
Sep 08 02:17:08.875949 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:17:08.875898    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f63434e_c10a_45ee_a3fb_e7838bb4e5ea.slice/crio-96a52ca7839757899f56b4645096b2b7713760be01089a960b9fc3b27221c7a8 WatchSource:0}: Error finding container 96a52ca7839757899f56b4645096b2b7713760be01089a960b9fc3b27221c7a8: Status 404 returned error can't find the container with id 96a52ca7839757899f56b4645096b2b7713760be01089a960b9fc3b27221c7a8
Sep 08 02:17:08.878178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.878152    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:08.878238 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.878209    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:08.878277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:08.878237    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:09.026756 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:09.026720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" event={"ID":"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea","Type":"ContainerStarted","Data":"226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"}
Sep 08 02:17:09.027076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:09.027048    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" event={"ID":"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea","Type":"ContainerStarted","Data":"96a52ca7839757899f56b4645096b2b7713760be01089a960b9fc3b27221c7a8"}
Sep 08 02:17:09.573342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:09.573309    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:09.579605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:09.579580    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:09.602814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:09.602752    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podStartSLOduration=1.602738618 podStartE2EDuration="1.602738618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:17:09.049749961 +0000 UTC m=+1086.505364893" watchObservedRunningTime="2026-09-08 02:17:09.602738618 +0000 UTC m=+1087.058353532"
Sep 08 02:17:10.033047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:10.032969    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:10.034159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:10.034133    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:10.927936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:10.927891    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:11.017657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:11.017614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:11.944321 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:11.944272    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:17:11.944823 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:11.944350    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:17:12.087620 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:12.087583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:12.162626 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:12.162459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:12.256110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:12.256035    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:12.566169 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:12.566117    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:12.638123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:12.638097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:13.051258 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:13.051227    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2741744-7012-4018-a2ec-cebfc906242b" containerID="2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc" exitCode=0
Sep 08 02:17:13.051637 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:13.051302    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" event={"ID":"b2741744-7012-4018-a2ec-cebfc906242b","Type":"ContainerDied","Data":"2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"}
Sep 08 02:17:13.051721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:13.051707    2562 scope.go:117] "RemoveContainer" containerID="2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"
Sep 08 02:17:13.052890 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:13.052865    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:13.052971 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:13.052956    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:13.053008 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:13.052994    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:14.059490 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:14.059452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" event={"ID":"b2741744-7012-4018-a2ec-cebfc906242b","Type":"ContainerStarted","Data":"92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20"}
Sep 08 02:17:14.109826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:14.109794    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:17:14.110004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:14.109973    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 02:17:14.110054 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:14.110017    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 02:17:15.110136 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:15.110101    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 02:17:15.110523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:15.110153    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 02:17:16.110119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:16.110083    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 02:17:16.110274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:16.110154    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 02:17:16.427329 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:16.427238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:17:17.110672 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:17.110638    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 02:17:17.111099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:17.110687    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 02:17:18.110198 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:18.110164    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 02:17:18.110376 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:18.110226    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 02:17:18.819806 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:18.819771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:19.110563 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:19.110470    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused" start-of-body=
Sep 08 02:17:19.110563 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:19.110530    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": dial tcp 10.134.0.52:15021: connect: connection refused"
Sep 08 02:17:20.113680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:20.113651    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:17:20.114085 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:20.113939    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:17:20.114736 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:20.114718    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:17:21.760134 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:21.760099    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:26.075108 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:26.075059    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:17:26.075515 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:26.075134    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:17:27.027033 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:17:27.026994    2562 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f63434e_c10a_45ee_a3fb_e7838bb4e5ea.slice/crio-226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55.scope\": RecentStats: unable to find data in memory cache]"
Sep 08 02:17:27.135643 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:27.135541    2562 generic.go:356] "Generic (PLEG): container finished" podID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerID="226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55" exitCode=0
Sep 08 02:17:27.136180 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:27.135719    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" event={"ID":"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea","Type":"ContainerDied","Data":"226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"}
Sep 08 02:17:27.136284 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:27.136256    2562 scope.go:117] "RemoveContainer" containerID="226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"
Sep 08 02:17:27.137719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:27.137679    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:27.137806 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:27.137775    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:27.137845 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:27.137824    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:28.147799 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:28.147755    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" event={"ID":"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea","Type":"ContainerStarted","Data":"b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7"}
Sep 08 02:17:28.573340 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:28.573281    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:28.573629 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:28.573602    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 02:17:28.573681 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:28.573659    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 02:17:29.573858 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:29.573812    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 02:17:29.574289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:29.573875    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 02:17:30.573450 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:30.573417    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 02:17:30.573636 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:30.573474    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 02:17:31.573893 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:31.573858    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 02:17:31.574296 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:31.573941    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 02:17:32.573390 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:32.573352    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 08 02:17:32.573552 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:32.573424    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 08 02:17:32.942191 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:32.942101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:33.576832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:33.576800    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:33.577172 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:33.577151    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:33.577777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:33.577759    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:17:35.849608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:35.849577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:37.717716 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.717686    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"]
Sep 08 02:17:37.720371 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.720354    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.724097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.724074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-fcdd46\"/\"default-dockercfg-z4qcn\""
Sep 08 02:17:37.724097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.724088    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-fcdd46\"/\"openshift-service-ca.crt\""
Sep 08 02:17:37.724349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.724078    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-fcdd46\"/\"auth-test-model-fcdd46-kserve-self-signed-certs\""
Sep 08 02:17:37.724349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.724232    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-fcdd46\"/\"kube-root-ca.crt\""
Sep 08 02:17:37.730226 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.730203    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"]
Sep 08 02:17:37.744610 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.744584    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:37.753775 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.753754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-dshm\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.753854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.753798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tls-certs\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.753854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.753833    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-home\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.753962 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.753856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2mtd\" (UniqueName: \"kubernetes.io/projected/981ac8e7-26dc-40f8-ba32-26e5593f74b5-kube-api-access-z2mtd\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.753962 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.753888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tmp-dir\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.754047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.753972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-model-cache\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.855489 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.855452    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-dshm\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.855695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.855520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tls-certs\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.855695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.855564    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-home\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.855695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.855586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2mtd\" (UniqueName: \"kubernetes.io/projected/981ac8e7-26dc-40f8-ba32-26e5593f74b5-kube-api-access-z2mtd\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.855695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.855633    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tmp-dir\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.855695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.855655    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-model-cache\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.856043 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.856018    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-home\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.856181 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.856152    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tmp-dir\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.856181 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.856152    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-model-cache\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.857888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.857861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-dshm\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.858087 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.858068    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tls-certs\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:37.863805 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:37.863783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2mtd\" (UniqueName: \"kubernetes.io/projected/981ac8e7-26dc-40f8-ba32-26e5593f74b5-kube-api-access-z2mtd\") pod \"auth-test-model-fcdd46-kserve-84d97fbf67-66lph\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") " pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:38.031558 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:38.031466    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:38.302639 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:38.302615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"]
Sep 08 02:17:38.304932 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:17:38.304887    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod981ac8e7_26dc_40f8_ba32_26e5593f74b5.slice/crio-e1407e2d694a15270fe33a6fae0690e99db55096698c858c28174c4450f4c0a8 WatchSource:0}: Error finding container e1407e2d694a15270fe33a6fae0690e99db55096698c858c28174c4450f4c0a8: Status 404 returned error can't find the container with id e1407e2d694a15270fe33a6fae0690e99db55096698c858c28174c4450f4c0a8
Sep 08 02:17:39.210492 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:39.210459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:39.211026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:39.211003    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph" event={"ID":"981ac8e7-26dc-40f8-ba32-26e5593f74b5","Type":"ContainerStarted","Data":"dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188"}
Sep 08 02:17:39.211095 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:39.211043    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph" event={"ID":"981ac8e7-26dc-40f8-ba32-26e5593f74b5","Type":"ContainerStarted","Data":"e1407e2d694a15270fe33a6fae0690e99db55096698c858c28174c4450f4c0a8"}
Sep 08 02:17:39.230054 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:39.230011    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph" podStartSLOduration=2.229996775 podStartE2EDuration="2.229996775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:17:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:17:39.227975303 +0000 UTC m=+1116.683590231" watchObservedRunningTime="2026-09-08 02:17:39.229996775 +0000 UTC m=+1116.685611688"
Sep 08 02:17:43.418802 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:43.418765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:17:48.031855 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:48.031810    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:48.032303 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:48.031886    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:48.044421 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:48.044396    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:48.275905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:48.275871    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:17:49.695382 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:49.695339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:49.963801 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:49.963708    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"]
Sep 08 02:17:49.966949 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:49.966927    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:49.969542 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:49.969522    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-967ab780-openshift-default-dockercfg-pwfgc\""
Sep 08 02:17:49.978871 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:49.978847    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"]
Sep 08 02:17:49.987166 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:49.987139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:50.086553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.086509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-envoy\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.086866 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.086841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-socket\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.087066 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.087045    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-credential-socket\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.087257 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.087237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-certs\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.087411 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.087391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bntcn\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-kube-api-access-bntcn\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.087588 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.087573    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-data\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.087768 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.087741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-podinfo\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.087938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.087903    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-token\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.088122 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.088106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71c3895-0a4f-4969-8c53-4029977f3c3c-istiod-ca-cert\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.188855 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.188816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71c3895-0a4f-4969-8c53-4029977f3c3c-istiod-ca-cert\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189057 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.188973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-envoy\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189057 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-socket\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189170 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-credential-socket\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189170 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-certs\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189170 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bntcn\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-kube-api-access-bntcn\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189200    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-data\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189261    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-podinfo\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-token\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189458    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-credential-socket\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189493    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-socket\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189516    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-certs\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71c3895-0a4f-4969-8c53-4029977f3c3c-istiod-ca-cert\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.189698 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.189675    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-data\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.191346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.191323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-envoy\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.191691 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.191667    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-podinfo\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.196855 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.196836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-token\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.197237 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.197217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bntcn\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-kube-api-access-bntcn\") pod \"e2e-mt-967ab780-openshift-default-5794cb5596-kspsf\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") " pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.279413 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.279328    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:50.298290 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.298257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:50.555333 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.555303    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"]
Sep 08 02:17:50.557474 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:17:50.557448    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71c3895_0a4f_4969_8c53_4029977f3c3c.slice/crio-8c7f582aae7cf2ebd71c27c356583d5fd737dac28aa6173384796b2ef64da8e4 WatchSource:0}: Error finding container 8c7f582aae7cf2ebd71c27c356583d5fd737dac28aa6173384796b2ef64da8e4: Status 404 returned error can't find the container with id 8c7f582aae7cf2ebd71c27c356583d5fd737dac28aa6173384796b2ef64da8e4
Sep 08 02:17:50.559902 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.559870    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:50.560000 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.559957    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:50.560000 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:50.559989    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:17:51.279863 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:51.279825    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" event={"ID":"b71c3895-0a4f-4969-8c53-4029977f3c3c","Type":"ContainerStarted","Data":"2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"}
Sep 08 02:17:51.280272 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:51.279880    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" event={"ID":"b71c3895-0a4f-4969-8c53-4029977f3c3c","Type":"ContainerStarted","Data":"8c7f582aae7cf2ebd71c27c356583d5fd737dac28aa6173384796b2ef64da8e4"}
Sep 08 02:17:51.302473 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:51.302413    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podStartSLOduration=2.302398407 podStartE2EDuration="2.302398407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:17:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:17:51.299960635 +0000 UTC m=+1128.755575569" watchObservedRunningTime="2026-09-08 02:17:51.302398407 +0000 UTC m=+1128.758013321"
Sep 08 02:17:52.279817 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:52.279762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:52.285769 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:52.285739    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:52.286941 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:52.286897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:52.287661 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:52.287641    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:17:53.136822 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:53.136784    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:53.237082 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:53.237041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:54.289997 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:54.289965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:54.390623 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:54.390592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:54.726588 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:54.726509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:54.823527 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:54.823500    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:17:54.910593 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:17:54.910551    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:00.312533 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:00.312499    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:18:03.175610 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:03.175579    2562 scope.go:117] "RemoveContainer" containerID="6606ce6eddfa46e1573a1b4bd957f6899e88977ab81a07819e8b7eb4ca5b9c40"
Sep 08 02:18:07.338638 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:07.338602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:07.848719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:07.848668    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:11.398941 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:11.398839    2562 generic.go:356] "Generic (PLEG): container finished" podID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerID="2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6" exitCode=0
Sep 08 02:18:11.399432 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:11.398936    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" event={"ID":"b71c3895-0a4f-4969-8c53-4029977f3c3c","Type":"ContainerDied","Data":"2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"}
Sep 08 02:18:11.399522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:11.399503    2562 scope.go:117] "RemoveContainer" containerID="2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"
Sep 08 02:18:11.400652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:11.400627    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:18:11.400708 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:11.400698    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:18:11.400746 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:11.400735    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:18:12.406501 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:12.406462    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" event={"ID":"b71c3895-0a4f-4969-8c53-4029977f3c3c","Type":"ContainerStarted","Data":"e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7"}
Sep 08 02:18:13.280211 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:13.280180    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:18:13.280389 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:13.280372    2562 patch_prober.go:28] interesting pod/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 02:18:13.280446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:13.280427    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 02:18:13.317029 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:13.316994    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:18:14.279971 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:14.279897    2562 patch_prober.go:28] interesting pod/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 02:18:14.280389 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:14.279999    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 02:18:15.185926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:15.185883    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:15.280527 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:15.280488    2562 patch_prober.go:28] interesting pod/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 02:18:15.280937 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:15.280542    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 02:18:16.280284 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:16.280249    2562 patch_prober.go:28] interesting pod/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 02:18:16.280476 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:16.280307    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 02:18:17.280293 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:17.280255    2562 patch_prober.go:28] interesting pod/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 02:18:17.280689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:17.280311    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 02:18:18.067826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:18.067791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:18.279888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:18.279855    2562 patch_prober.go:28] interesting pod/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 08 02:18:18.280102 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:18.279951    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 08 02:18:19.284343 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:19.284311    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:18:19.284789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:19.284584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:18:19.285377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:19.285358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:18:24.804178 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:24.804145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:27.024023 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:27.023976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:18:45.490283 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:45.490250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:18:46.411332 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:46.411300    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:18:51.960261 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:51.960228    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"]
Sep 08 02:18:51.962956 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:51.962941    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:51.965540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:51.965518    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:18:51.965680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:51.965592    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:18:51.970500 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:51.970443    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"]
Sep 08 02:18:52.042123 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:52.042083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af42e7-868d-4453-8ded-1d8dba1be78a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-967ab780-2vqmh\" (UID: \"91af42e7-868d-4453-8ded-1d8dba1be78a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:52.143281 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:52.143241    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af42e7-868d-4453-8ded-1d8dba1be78a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-967ab780-2vqmh\" (UID: \"91af42e7-868d-4453-8ded-1d8dba1be78a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:52.143856 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:52.143835    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af42e7-868d-4453-8ded-1d8dba1be78a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-967ab780-2vqmh\" (UID: \"91af42e7-868d-4453-8ded-1d8dba1be78a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:52.276450 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:52.276357    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:52.543876 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:52.543849    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"]
Sep 08 02:18:52.546014 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:18:52.545982    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91af42e7_868d_4453_8ded_1d8dba1be78a.slice/crio-65b2a38038a31809e5637bf7ec6d397f3696558fbb3fe83237bb212b1cc9397b WatchSource:0}: Error finding container 65b2a38038a31809e5637bf7ec6d397f3696558fbb3fe83237bb212b1cc9397b: Status 404 returned error can't find the container with id 65b2a38038a31809e5637bf7ec6d397f3696558fbb3fe83237bb212b1cc9397b
Sep 08 02:18:52.657196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:52.657167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh" event={"ID":"91af42e7-868d-4453-8ded-1d8dba1be78a","Type":"ContainerStarted","Data":"65b2a38038a31809e5637bf7ec6d397f3696558fbb3fe83237bb212b1cc9397b"}
Sep 08 02:18:53.663578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:53.663541    2562 generic.go:356] "Generic (PLEG): container finished" podID="91af42e7-868d-4453-8ded-1d8dba1be78a" containerID="11234b65621d5a675c16a9140bdd4fa41e56b9502aaa22a6ec92efee98d351cb" exitCode=0
Sep 08 02:18:53.664016 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:53.663622    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh" event={"ID":"91af42e7-868d-4453-8ded-1d8dba1be78a","Type":"ContainerDied","Data":"11234b65621d5a675c16a9140bdd4fa41e56b9502aaa22a6ec92efee98d351cb"}
Sep 08 02:18:54.798279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:54.798256    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:54.871877 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:54.871845    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af42e7-868d-4453-8ded-1d8dba1be78a-maas-api-service-ca\") pod \"91af42e7-868d-4453-8ded-1d8dba1be78a\" (UID: \"91af42e7-868d-4453-8ded-1d8dba1be78a\") "
Sep 08 02:18:54.872240 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:54.872213    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91af42e7-868d-4453-8ded-1d8dba1be78a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "91af42e7-868d-4453-8ded-1d8dba1be78a" (UID: "91af42e7-868d-4453-8ded-1d8dba1be78a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:18:54.973068 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:54.972996    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/91af42e7-868d-4453-8ded-1d8dba1be78a-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:18:55.675438 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:55.675408    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"
Sep 08 02:18:55.675616 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:55.675405    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh" event={"ID":"91af42e7-868d-4453-8ded-1d8dba1be78a","Type":"ContainerDied","Data":"65b2a38038a31809e5637bf7ec6d397f3696558fbb3fe83237bb212b1cc9397b"}
Sep 08 02:18:55.675616 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:18:55.675533    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65b2a38038a31809e5637bf7ec6d397f3696558fbb3fe83237bb212b1cc9397b"
Sep 08 02:19:03.105785 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:03.105752    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:19:03.107940 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:03.107907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:19:03.196670 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:03.196638    2562 scope.go:117] "RemoveContainer" containerID="65ba845d3088a5c4e9876ce4a14c838e3da682cfb841b5b5dcb66044d69dcfdd"
Sep 08 02:19:05.915930 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:05.915873    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:19:07.539057 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:07.539018    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:07.640346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:07.640312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:07.728262 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:07.728231    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:07.736740 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:07.736718    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"]
Sep 08 02:19:07.738659 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:07.738641    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-967ab780-2vqmh"]
Sep 08 02:19:07.796886 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:07.796795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:09.071020 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:09.070984    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91af42e7-868d-4453-8ded-1d8dba1be78a" path="/var/lib/kubelet/pods/91af42e7-868d-4453-8ded-1d8dba1be78a/volumes"
Sep 08 02:19:10.644752 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:10.644717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:15.723504 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:15.723466    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:25.413435 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:25.413399    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:19:29.032941 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:29.032895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:30.224846 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:30.224810    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:41.508794 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:41.508758    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:19:51.060083 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:51.060049    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:51.476312 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:51.476206    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:56.905553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:56.905517    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:57.004682 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:57.004648    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:57.129449 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:57.129406    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"]
Sep 08 02:19:57.129680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:57.129648    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy" containerID="cri-o://e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7" gracePeriod=30
Sep 08 02:19:57.154162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:57.154134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:57.819067 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:57.819032    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:19:58.332139 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:58.332106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:58.429418 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:58.429378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:58.530397 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:58.530347    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:59.069434 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:59.069397    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:59.164544 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:59.164515    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:19:59.262949 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:19:59.262890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:00.495536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:00.495507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:02.391033 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.391007    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:20:02.475888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.475796    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-certs\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.475888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.475842    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bntcn\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-kube-api-access-bntcn\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.475888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.475873    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-envoy\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.475940    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71c3895-0a4f-4969-8c53-4029977f3c3c-istiod-ca-cert\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-podinfo\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476063    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-socket\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476145    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-credential-socket\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476173    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-token\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476169    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:02.476511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476213    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-data\") pod \"b71c3895-0a4f-4969-8c53-4029977f3c3c\" (UID: \"b71c3895-0a4f-4969-8c53-4029977f3c3c\") "
Sep 08 02:20:02.476511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476374    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:02.476511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476425    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:02.476511 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476469    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b71c3895-0a4f-4969-8c53-4029977f3c3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:20:02.476715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476566    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:02.476755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476733    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.476755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476751    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.476840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476766    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.476840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476778    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b71c3895-0a4f-4969-8c53-4029977f3c3c-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.476840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.476791    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.478144 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.478122    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:02.478446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.478428    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:20:02.478541 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.478519    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-kube-api-access-bntcn" (OuterVolumeSpecName: "kube-api-access-bntcn") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "kube-api-access-bntcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:20:02.478588 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.478527    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b71c3895-0a4f-4969-8c53-4029977f3c3c" (UID: "b71c3895-0a4f-4969-8c53-4029977f3c3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:20:02.577948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.577895    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.577948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.577942    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.577948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.577951    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bntcn\" (UniqueName: \"kubernetes.io/projected/b71c3895-0a4f-4969-8c53-4029977f3c3c-kube-api-access-bntcn\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:02.578141 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:02.577960    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b71c3895-0a4f-4969-8c53-4029977f3c3c-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:03.068658 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.068623    2562 generic.go:356] "Generic (PLEG): container finished" podID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerID="e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7" exitCode=0
Sep 08 02:20:03.068804 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.068715    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"
Sep 08 02:20:03.071327 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.071307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" event={"ID":"b71c3895-0a4f-4969-8c53-4029977f3c3c","Type":"ContainerDied","Data":"e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7"}
Sep 08 02:20:03.071414 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.071344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf" event={"ID":"b71c3895-0a4f-4969-8c53-4029977f3c3c","Type":"ContainerDied","Data":"8c7f582aae7cf2ebd71c27c356583d5fd737dac28aa6173384796b2ef64da8e4"}
Sep 08 02:20:03.071414 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.071366    2562 scope.go:117] "RemoveContainer" containerID="e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7"
Sep 08 02:20:03.081097 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.081075    2562 scope.go:117] "RemoveContainer" containerID="2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"
Sep 08 02:20:03.089748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.089732    2562 scope.go:117] "RemoveContainer" containerID="e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7"
Sep 08 02:20:03.090012 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:20:03.089993    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7\": container with ID starting with e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7 not found: ID does not exist" containerID="e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7"
Sep 08 02:20:03.090065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.090020    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7"} err="failed to get container status \"e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7\": rpc error: code = NotFound desc = could not find container \"e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7\": container with ID starting with e974a7701fefdf637aa04764926c6493bda70a0b459715b184e7d85efe260bf7 not found: ID does not exist"
Sep 08 02:20:03.090065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.090036    2562 scope.go:117] "RemoveContainer" containerID="2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"
Sep 08 02:20:03.090304 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:20:03.090285    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6\": container with ID starting with 2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6 not found: ID does not exist" containerID="2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"
Sep 08 02:20:03.090354 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.090308    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6"} err="failed to get container status \"2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6\": rpc error: code = NotFound desc = could not find container \"2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6\": container with ID starting with 2ebefe5b51a6e5a3180298a048942243e57569736adb0c253405411db109b3d6 not found: ID does not exist"
Sep 08 02:20:03.094027 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.094005    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"]
Sep 08 02:20:03.097868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.097844    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-967ab780-openshift-default-5794cb5596-kspsf"]
Sep 08 02:20:03.217750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.217720    2562 scope.go:117] "RemoveContainer" containerID="8906736a5003a675178e49da787578133326724e6e268e4a8c7697f82b8ef6f1"
Sep 08 02:20:03.226626 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.226606    2562 scope.go:117] "RemoveContainer" containerID="108ce4a8d4ac7f305c370c2248d44a4e5515170c87ceb2cdf10d40a33f660a07"
Sep 08 02:20:03.234628 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:03.234603    2562 scope.go:117] "RemoveContainer" containerID="849f60a5a537be316f619b49bddda76b9187384a079a9b84cc991841e37d1992"
Sep 08 02:20:05.070962 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:05.070932    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" path="/var/lib/kubelet/pods/b71c3895-0a4f-4969-8c53-4029977f3c3c/volumes"
Sep 08 02:20:06.162802 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:06.162761    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:06.218831 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:06.218797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:06.806005 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:06.805972    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:07.883449 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:07.883411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:12.294664 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:12.294627    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"]
Sep 08 02:20:12.311702 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:12.311661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:12.709899 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:12.709818    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:20:12.784862 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:12.784828    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:12.842640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:12.842610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:12.933196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:12.933152    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:13.033028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:13.032946    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:13.333993 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:13.333960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:18.534358 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:18.534323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:23.426155 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:23.426120    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:23.651402 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:23.651366    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:23.732194 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:23.732102    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:20:27.316957 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.316894    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph" podUID="981ac8e7-26dc-40f8-ba32-26e5593f74b5" containerName="main" containerID="cri-o://dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188" gracePeriod=45
Sep 08 02:20:27.571941 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.571860    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:20:27.629680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.629651    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tls-certs\") pod \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") "
Sep 08 02:20:27.629829 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.629729    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tmp-dir\") pod \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") "
Sep 08 02:20:27.629829 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.629811    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-dshm\") pod \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") "
Sep 08 02:20:27.629829 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.629825    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-home\") pod \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") "
Sep 08 02:20:27.629995 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.629842    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-model-cache\") pod \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") "
Sep 08 02:20:27.629995 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.629864    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2mtd\" (UniqueName: \"kubernetes.io/projected/981ac8e7-26dc-40f8-ba32-26e5593f74b5-kube-api-access-z2mtd\") pod \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\" (UID: \"981ac8e7-26dc-40f8-ba32-26e5593f74b5\") "
Sep 08 02:20:27.630109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.630051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "981ac8e7-26dc-40f8-ba32-26e5593f74b5" (UID: "981ac8e7-26dc-40f8-ba32-26e5593f74b5"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:27.630109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.630085    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-home" (OuterVolumeSpecName: "home") pod "981ac8e7-26dc-40f8-ba32-26e5593f74b5" (UID: "981ac8e7-26dc-40f8-ba32-26e5593f74b5"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:27.630260 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.630228    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-model-cache" (OuterVolumeSpecName: "model-cache") pod "981ac8e7-26dc-40f8-ba32-26e5593f74b5" (UID: "981ac8e7-26dc-40f8-ba32-26e5593f74b5"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:27.630337 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.630316    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-home\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:27.630399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.630343    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tmp-dir\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:27.632127 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.632096    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "981ac8e7-26dc-40f8-ba32-26e5593f74b5" (UID: "981ac8e7-26dc-40f8-ba32-26e5593f74b5"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:20:27.632234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.632138    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-dshm" (OuterVolumeSpecName: "dshm") pod "981ac8e7-26dc-40f8-ba32-26e5593f74b5" (UID: "981ac8e7-26dc-40f8-ba32-26e5593f74b5"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:20:27.632234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.632163    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/981ac8e7-26dc-40f8-ba32-26e5593f74b5-kube-api-access-z2mtd" (OuterVolumeSpecName: "kube-api-access-z2mtd") pod "981ac8e7-26dc-40f8-ba32-26e5593f74b5" (UID: "981ac8e7-26dc-40f8-ba32-26e5593f74b5"). InnerVolumeSpecName "kube-api-access-z2mtd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:20:27.731485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.731450    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/981ac8e7-26dc-40f8-ba32-26e5593f74b5-tls-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:27.731485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.731478    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-dshm\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:27.731485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.731487    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/981ac8e7-26dc-40f8-ba32-26e5593f74b5-model-cache\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:27.731718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:27.731495    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2mtd\" (UniqueName: \"kubernetes.io/projected/981ac8e7-26dc-40f8-ba32-26e5593f74b5-kube-api-access-z2mtd\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:20:28.209124 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.209085    2562 generic.go:356] "Generic (PLEG): container finished" podID="981ac8e7-26dc-40f8-ba32-26e5593f74b5" containerID="dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188" exitCode=0
Sep 08 02:20:28.209289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.209150    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"
Sep 08 02:20:28.209289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.209154    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph" event={"ID":"981ac8e7-26dc-40f8-ba32-26e5593f74b5","Type":"ContainerDied","Data":"dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188"}
Sep 08 02:20:28.209289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.209192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph" event={"ID":"981ac8e7-26dc-40f8-ba32-26e5593f74b5","Type":"ContainerDied","Data":"e1407e2d694a15270fe33a6fae0690e99db55096698c858c28174c4450f4c0a8"}
Sep 08 02:20:28.209289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.209215    2562 scope.go:117] "RemoveContainer" containerID="dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188"
Sep 08 02:20:28.218327 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.218307    2562 scope.go:117] "RemoveContainer" containerID="dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188"
Sep 08 02:20:28.218601 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:20:28.218581    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188\": container with ID starting with dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188 not found: ID does not exist" containerID="dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188"
Sep 08 02:20:28.218641 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.218612    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188"} err="failed to get container status \"dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188\": rpc error: code = NotFound desc = could not find container \"dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188\": container with ID starting with dd09f8c3bcec41703b783418d8f6f84ebcc3a7b4f53736805b91f557cc520188 not found: ID does not exist"
Sep 08 02:20:28.228826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.228805    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"]
Sep 08 02:20:28.232412 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:28.232392    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-fcdd46/auth-test-model-fcdd46-kserve-84d97fbf67-66lph"]
Sep 08 02:20:29.070570 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:29.070532    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="981ac8e7-26dc-40f8-ba32-26e5593f74b5" path="/var/lib/kubelet/pods/981ac8e7-26dc-40f8-ba32-26e5593f74b5/volumes"
Sep 08 02:20:41.702778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:41.702739    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:44.552468 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:44.552432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:50.118592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.118562    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"]
Sep 08 02:20:50.118994 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.118980    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="981ac8e7-26dc-40f8-ba32-26e5593f74b5" containerName="main"
Sep 08 02:20:50.119045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.118995    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="981ac8e7-26dc-40f8-ba32-26e5593f74b5" containerName="main"
Sep 08 02:20:50.119045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119006    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91af42e7-868d-4453-8ded-1d8dba1be78a" containerName="revoke-keys"
Sep 08 02:20:50.119045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119012    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="91af42e7-868d-4453-8ded-1d8dba1be78a" containerName="revoke-keys"
Sep 08 02:20:50.119045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119045    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy"
Sep 08 02:20:50.119179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119051    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy"
Sep 08 02:20:50.119179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119060    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy"
Sep 08 02:20:50.119179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119066    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy"
Sep 08 02:20:50.119179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119122    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy"
Sep 08 02:20:50.119179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119132    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="91af42e7-868d-4453-8ded-1d8dba1be78a" containerName="revoke-keys"
Sep 08 02:20:50.119179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.119138    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="981ac8e7-26dc-40f8-ba32-26e5593f74b5" containerName="main"
Sep 08 02:20:50.122353 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.122333    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.126308 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.126278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-527ac8\"/\"openshift-service-ca.crt\""
Sep 08 02:20:50.126450 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.126316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-527ac8\"/\"sub-test-model-527ac8-kserve-self-signed-certs\""
Sep 08 02:20:50.126450 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.126317    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-527ac8\"/\"kube-root-ca.crt\""
Sep 08 02:20:50.126450 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.126323    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-527ac8\"/\"default-dockercfg-zjlj4\""
Sep 08 02:20:50.133093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.133061    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"]
Sep 08 02:20:50.153089 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.153061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:50.159341 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.159319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-tmp-dir\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.159410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.159366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-home\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.159479 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.159463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e16c37-b9da-4c2c-b112-1aab875d5559-tls-certs\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.159517 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.159504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-dshm\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.159552 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.159543    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-model-cache\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.159694 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.159666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmqp4\" (UniqueName: \"kubernetes.io/projected/69e16c37-b9da-4c2c-b112-1aab875d5559-kube-api-access-cmqp4\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261092 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261060    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-model-cache\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmqp4\" (UniqueName: \"kubernetes.io/projected/69e16c37-b9da-4c2c-b112-1aab875d5559-kube-api-access-cmqp4\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261156    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-tmp-dir\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261192    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-home\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e16c37-b9da-4c2c-b112-1aab875d5559-tls-certs\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-dshm\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261538 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261517    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-model-cache\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261538 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-tmp-dir\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.261631 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.261609    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-home\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.263409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.263388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-dshm\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.263659 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.263641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e16c37-b9da-4c2c-b112-1aab875d5559-tls-certs\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.269139 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.269117    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmqp4\" (UniqueName: \"kubernetes.io/projected/69e16c37-b9da-4c2c-b112-1aab875d5559-kube-api-access-cmqp4\") pod \"sub-test-model-527ac8-kserve-58cb9b7699-w5c6c\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") " pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.434363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.434284    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:20:50.557113 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.557081    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:50.625267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.625240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:50.716267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.716245    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"]
Sep 08 02:20:50.718151 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:20:50.718124    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod69e16c37_b9da_4c2c_b112_1aab875d5559.slice/crio-dfade3aec3fd223b3ad24fd8ec220af0cbce5a2250d22bc0bd706cdb75395b3e WatchSource:0}: Error finding container dfade3aec3fd223b3ad24fd8ec220af0cbce5a2250d22bc0bd706cdb75395b3e: Status 404 returned error can't find the container with id dfade3aec3fd223b3ad24fd8ec220af0cbce5a2250d22bc0bd706cdb75395b3e
Sep 08 02:20:50.898737 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:50.898688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:51.166498 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.166457    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"]
Sep 08 02:20:51.167635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.167604    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71c3895-0a4f-4969-8c53-4029977f3c3c" containerName="istio-proxy"
Sep 08 02:20:51.172362 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.172338    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.175438 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.175414    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c25e6e-openshift-default-dockercfg-kpgfj\""
Sep 08 02:20:51.179842 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.179816    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"]
Sep 08 02:20:51.190700 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.190673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:51.273155 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273109    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-credential-socket\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273225    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-certs\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273257    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-podinfo\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-envoy\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273346 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-data\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273353    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwkpg\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-kube-api-access-vwkpg\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-socket\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273427    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-token\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.273568 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.273477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istiod-ca-cert\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.336233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.336198    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c" event={"ID":"69e16c37-b9da-4c2c-b112-1aab875d5559","Type":"ContainerStarted","Data":"16fbc46466f552c614486ed738247db49cda57a89d3483cd3846512127768083"}
Sep 08 02:20:51.336233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.336243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c" event={"ID":"69e16c37-b9da-4c2c-b112-1aab875d5559","Type":"ContainerStarted","Data":"dfade3aec3fd223b3ad24fd8ec220af0cbce5a2250d22bc0bd706cdb75395b3e"}
Sep 08 02:20:51.353898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.353846    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c" podStartSLOduration=1.353830407 podStartE2EDuration="1.353830407s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:20:51.352024329 +0000 UTC m=+1308.807639258" watchObservedRunningTime="2026-09-08 02:20:51.353830407 +0000 UTC m=+1308.809445320"
Sep 08 02:20:51.374420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-credential-socket\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.374560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374458    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-certs\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.374560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374484    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-podinfo\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.374560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-envoy\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.374675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374565    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-data\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.374675 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwkpg\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-kube-api-access-vwkpg\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-socket\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374876    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-certs\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-data\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.374950    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-token\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.375023    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-credential-socket\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.375072    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istiod-ca-cert\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375393 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.375211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-socket\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.375590 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.375572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istiod-ca-cert\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.377042 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.377014    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-envoy\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.377172 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.377157    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-podinfo\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.383567 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.383548    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwkpg\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-kube-api-access-vwkpg\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.383648 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.383612    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-token\") pod \"e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") " pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.485062 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.484965    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:51.533324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.533291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:51.783878 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.783852    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"]
Sep 08 02:20:51.784956 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:20:51.784933    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65ac7926_c9db_4a0e_bf1a_5273d3cc6133.slice/crio-8a4ea24b19ed6b19da6ed3bc88b7218876de425222339dd12e17a446c4e87bd8 WatchSource:0}: Error finding container 8a4ea24b19ed6b19da6ed3bc88b7218876de425222339dd12e17a446c4e87bd8: Status 404 returned error can't find the container with id 8a4ea24b19ed6b19da6ed3bc88b7218876de425222339dd12e17a446c4e87bd8
Sep 08 02:20:51.787298 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.787260    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:20:51.787415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.787344    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:20:51.787415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:51.787390    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:20:52.343503 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:52.343461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" event={"ID":"65ac7926-c9db-4a0e-bf1a-5273d3cc6133","Type":"ContainerStarted","Data":"7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"}
Sep 08 02:20:52.343932 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:52.343513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" event={"ID":"65ac7926-c9db-4a0e-bf1a-5273d3cc6133","Type":"ContainerStarted","Data":"8a4ea24b19ed6b19da6ed3bc88b7218876de425222339dd12e17a446c4e87bd8"}
Sep 08 02:20:52.365247 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:52.365200    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podStartSLOduration=1.365185593 podStartE2EDuration="1.365185593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:20:52.362205319 +0000 UTC m=+1309.817820271" watchObservedRunningTime="2026-09-08 02:20:52.365185593 +0000 UTC m=+1309.820800506"
Sep 08 02:20:52.485503 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:52.485413    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:52.493733 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:52.493705    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:53.350194 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:53.350161    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:53.351261 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:53.351238    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:20:54.218690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:54.218657    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:54.316363 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:54.316326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:55.350954 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:55.350898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:55.453052 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:55.453017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:55.780777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:55.780678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:55.879635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:55.879598    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:20:55.927065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:55.927034    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:20:55.958085 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:20:55.958060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:00.434713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:00.434676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:21:00.434713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:00.434717    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:21:00.447657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:00.447632    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:21:01.403335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:01.403304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:21:03.267933 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:03.267886    2562 scope.go:117] "RemoveContainer" containerID="bb5039309699b9bab1eb33200cefb5f66a78d078a8942cd407949db5ac3f4dbe"
Sep 08 02:21:03.276898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:03.276878    2562 scope.go:117] "RemoveContainer" containerID="e26dc595952fc9a667d5550d3b39173da1ee3b5ede8c1fbbfe6a9afa03eac7a9"
Sep 08 02:21:03.284593 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:03.284574    2562 scope.go:117] "RemoveContainer" containerID="e93ae831bd80fc4580ef05e5a16df2bd8822006dcb2c1d577f6069bb6b7b699a"
Sep 08 02:21:12.916286 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:12.916250    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:21:16.365138 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:16.365094    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:16.465188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:16.465156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:17.491832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:17.491798    2562 generic.go:356] "Generic (PLEG): container finished" podID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerID="7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57" exitCode=0
Sep 08 02:21:17.492283 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:17.491852    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" event={"ID":"65ac7926-c9db-4a0e-bf1a-5273d3cc6133","Type":"ContainerDied","Data":"7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"}
Sep 08 02:21:17.492283 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:17.492272    2562 scope.go:117] "RemoveContainer" containerID="7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"
Sep 08 02:21:17.493464 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:17.493432    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:17.493598 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:17.493501    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:17.493598 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:17.493531    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:18.499521 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:18.499483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" event={"ID":"65ac7926-c9db-4a0e-bf1a-5273d3cc6133","Type":"ContainerStarted","Data":"65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b"}
Sep 08 02:21:19.129837 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.129800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:19.486655 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.486553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:21:19.487506 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.487464    2562 patch_prober.go:28] interesting pod/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 02:21:19.487658 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.487527    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 02:21:19.558284 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.558242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:19.820087 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.820054    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"]
Sep 08 02:21:19.822807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.822784    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.836074 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.831984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-4a198d-openshift-default-dockercfg-dtvbb\""
Sep 08 02:21:19.841938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.837871    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"]
Sep 08 02:21:19.857932 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.852873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:19.872784 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.872753    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-certs\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873048 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.872804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istiod-ca-cert\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873048 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.872942    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-token\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873048 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.873005    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-data\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873048 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.873041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-envoy\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873293 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.873064    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5qzc\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-kube-api-access-s5qzc\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873293 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.873092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-podinfo\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873293 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.873135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-credential-socket\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.873293 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.873170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-socket\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.973854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.973819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-token\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.973854 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.973870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-data\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.973903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-envoy\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.973943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5qzc\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-kube-api-access-s5qzc\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.973969    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-podinfo\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974010    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-credential-socket\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974044    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-socket\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974095    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-certs\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istiod-ca-cert\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974514 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974369    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-data\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974514 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974469    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-credential-socket\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-certs\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-socket\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.974929 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.974897    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istiod-ca-cert\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.976340 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.976323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-envoy\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.976601 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.976571    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-podinfo\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.982300 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.982275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5qzc\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-kube-api-access-s5qzc\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:19.982300 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:19.982283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-token\") pod \"e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") " pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:20.084505 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.084423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:20.158076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.158035    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:20.450285 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.446870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"]
Sep 08 02:21:20.457023 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.456978    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:20.457127 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.457079    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:20.457168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.457122    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:20.485490 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.485456    2562 patch_prober.go:28] interesting pod/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 02:21:20.485592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.485506    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 02:21:20.513328 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:20.513243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" event={"ID":"adfdc9d0-df63-44cb-a1f8-fb1ec593f407","Type":"ContainerStarted","Data":"246f8607294bcd2a07617e86777fbda541560632725dc87851afb0ee7b378226"}
Sep 08 02:21:21.486161 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:21.486122    2562 patch_prober.go:28] interesting pod/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 02:21:21.486526 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:21.486181    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 02:21:21.520748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:21.520711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" event={"ID":"adfdc9d0-df63-44cb-a1f8-fb1ec593f407","Type":"ContainerStarted","Data":"1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"}
Sep 08 02:21:21.541936 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:21.539866    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podStartSLOduration=2.539844806 podStartE2EDuration="2.539844806s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:21:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:21:21.538789112 +0000 UTC m=+1338.994404085" watchObservedRunningTime="2026-09-08 02:21:21.539844806 +0000 UTC m=+1338.995459720"
Sep 08 02:21:22.158433 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:22.158394    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:22.163753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:22.163715    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:22.486259 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:22.486174    2562 patch_prober.go:28] interesting pod/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 02:21:22.486259 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:22.486235    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 02:21:22.527512 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:22.527478    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:22.532382 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:22.532356    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:23.350822 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:23.350785    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:21:23.419838 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:23.419804    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:23.485497 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:23.485461    2562 patch_prober.go:28] interesting pod/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 02:21:23.485691 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:23.485521    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 02:21:23.519085 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:23.519047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:24.485821 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:24.485787    2562 patch_prober.go:28] interesting pod/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 08 02:21:24.486021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:24.485840    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 08 02:21:24.577383 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:24.577346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:24.680275 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:24.680245    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:24.773428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:24.773345    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:25.060659 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:25.060626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:25.137935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:25.137879    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:25.489722 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:25.489643    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:21:25.490576 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:25.490553    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:21:28.113149 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:28.113121    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:21:38.569132 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.569077    2562 patch_prober.go:28] interesting pod/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:21:38.570277 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.569171    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:21:38.637668 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.637641    2562 generic.go:356] "Generic (PLEG): container finished" podID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerID="1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2" exitCode=0
Sep 08 02:21:38.637788 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.637712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" event={"ID":"adfdc9d0-df63-44cb-a1f8-fb1ec593f407","Type":"ContainerDied","Data":"1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"}
Sep 08 02:21:38.638151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.638138    2562 scope.go:117] "RemoveContainer" containerID="1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"
Sep 08 02:21:38.639343 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.639319    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:38.639409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.639384    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:38.639443 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:38.639414    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:21:39.523403 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:39.523369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:39.654375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:39.654307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" event={"ID":"adfdc9d0-df63-44cb-a1f8-fb1ec593f407","Type":"ContainerStarted","Data":"ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c"}
Sep 08 02:21:40.158585 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:40.158545    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:40.158813 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:40.158793    2562 patch_prober.go:28] interesting pod/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 02:21:40.158859 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:40.158841    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 02:21:40.596657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:40.596614    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"]
Sep 08 02:21:40.615506 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:40.615480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:41.158891 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:41.158853    2562 patch_prober.go:28] interesting pod/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 02:21:41.159301 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:41.158938    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 02:21:42.158591 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:42.158557    2562 patch_prober.go:28] interesting pod/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 02:21:42.158775 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:42.158609    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 02:21:43.158590 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:43.158550    2562 patch_prober.go:28] interesting pod/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 02:21:43.159026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:43.158610    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 02:21:44.159457 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:44.159418    2562 patch_prober.go:28] interesting pod/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 08 02:21:44.159857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:44.159478    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 08 02:21:45.162662 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:45.162627    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:45.163115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:45.162905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:45.163605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:45.163588    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:21:45.445651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:45.445510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:46.329054 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:46.329017    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:21:48.325592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:48.325543    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:51.036587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.036545    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"]
Sep 08 02:21:51.039707 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.039683    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:51.042313 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.042290    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:21:51.042755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.042336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:21:51.048377 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.048354    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"]
Sep 08 02:21:51.135427 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.135388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21706017-ea74-47cb-a341-02fcf3fd45ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69\" (UID: \"21706017-ea74-47cb-a341-02fcf3fd45ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:51.135644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.135614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:51.236476 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.236443    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21706017-ea74-47cb-a341-02fcf3fd45ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69\" (UID: \"21706017-ea74-47cb-a341-02fcf3fd45ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:51.237096 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.237077    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21706017-ea74-47cb-a341-02fcf3fd45ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69\" (UID: \"21706017-ea74-47cb-a341-02fcf3fd45ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:51.351665 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.351583    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:51.514737 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.514707    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:51.625175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.625150    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"]
Sep 08 02:21:51.626786 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:21:51.626756    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21706017_ea74_47cb_a341_02fcf3fd45ae.slice/crio-004b9806885ea2c564172d970d6a8d30047ba7b5e46b2248429cdcbb9b10d224 WatchSource:0}: Error finding container 004b9806885ea2c564172d970d6a8d30047ba7b5e46b2248429cdcbb9b10d224: Status 404 returned error can't find the container with id 004b9806885ea2c564172d970d6a8d30047ba7b5e46b2248429cdcbb9b10d224
Sep 08 02:21:51.721644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.721610    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69" event={"ID":"21706017-ea74-47cb-a341-02fcf3fd45ae","Type":"ContainerStarted","Data":"004b9806885ea2c564172d970d6a8d30047ba7b5e46b2248429cdcbb9b10d224"}
Sep 08 02:21:51.852968 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:51.852937    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:52.476225 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:52.476198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:21:52.728195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:52.728110    2562 generic.go:356] "Generic (PLEG): container finished" podID="21706017-ea74-47cb-a341-02fcf3fd45ae" containerID="00eeaf9b7bfc1b0c225ab94e6dc0b84e5b0ac8a7dcb60872260e44fd353a60de" exitCode=0
Sep 08 02:21:52.728195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:52.728176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69" event={"ID":"21706017-ea74-47cb-a341-02fcf3fd45ae","Type":"ContainerDied","Data":"00eeaf9b7bfc1b0c225ab94e6dc0b84e5b0ac8a7dcb60872260e44fd353a60de"}
Sep 08 02:21:53.905040 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:53.905017    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:53.972388 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:53.972355    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21706017-ea74-47cb-a341-02fcf3fd45ae-maas-api-service-ca\") pod \"21706017-ea74-47cb-a341-02fcf3fd45ae\" (UID: \"21706017-ea74-47cb-a341-02fcf3fd45ae\") "
Sep 08 02:21:53.972767 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:53.972741    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21706017-ea74-47cb-a341-02fcf3fd45ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21706017-ea74-47cb-a341-02fcf3fd45ae" (UID: "21706017-ea74-47cb-a341-02fcf3fd45ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:21:54.073387 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:54.073355    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21706017-ea74-47cb-a341-02fcf3fd45ae-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:54.740668 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:54.740628    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"
Sep 08 02:21:54.740668 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:54.740649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69" event={"ID":"21706017-ea74-47cb-a341-02fcf3fd45ae","Type":"ContainerDied","Data":"004b9806885ea2c564172d970d6a8d30047ba7b5e46b2248429cdcbb9b10d224"}
Sep 08 02:21:54.740909 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:54.740700    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="004b9806885ea2c564172d970d6a8d30047ba7b5e46b2248429cdcbb9b10d224"
Sep 08 02:21:55.617055 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.616986    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c" podUID="69e16c37-b9da-4c2c-b112-1aab875d5559" containerName="main" containerID="cri-o://16fbc46466f552c614486ed738247db49cda57a89d3483cd3846512127768083" gracePeriod=45
Sep 08 02:21:55.748152 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.748122    2562 generic.go:356] "Generic (PLEG): container finished" podID="69e16c37-b9da-4c2c-b112-1aab875d5559" containerID="16fbc46466f552c614486ed738247db49cda57a89d3483cd3846512127768083" exitCode=0
Sep 08 02:21:55.748274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.748192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c" event={"ID":"69e16c37-b9da-4c2c-b112-1aab875d5559","Type":"ContainerDied","Data":"16fbc46466f552c614486ed738247db49cda57a89d3483cd3846512127768083"}
Sep 08 02:21:55.865416 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.865392    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:21:55.996340 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996264    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-tmp-dir\") pod \"69e16c37-b9da-4c2c-b112-1aab875d5559\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") "
Sep 08 02:21:55.996340 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996325    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-model-cache\") pod \"69e16c37-b9da-4c2c-b112-1aab875d5559\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") "
Sep 08 02:21:55.996572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-home\") pod \"69e16c37-b9da-4c2c-b112-1aab875d5559\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") "
Sep 08 02:21:55.996572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996388    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmqp4\" (UniqueName: \"kubernetes.io/projected/69e16c37-b9da-4c2c-b112-1aab875d5559-kube-api-access-cmqp4\") pod \"69e16c37-b9da-4c2c-b112-1aab875d5559\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") "
Sep 08 02:21:55.996572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996440    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-dshm\") pod \"69e16c37-b9da-4c2c-b112-1aab875d5559\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") "
Sep 08 02:21:55.996572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996538    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e16c37-b9da-4c2c-b112-1aab875d5559-tls-certs\") pod \"69e16c37-b9da-4c2c-b112-1aab875d5559\" (UID: \"69e16c37-b9da-4c2c-b112-1aab875d5559\") "
Sep 08 02:21:55.996572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996559    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "69e16c37-b9da-4c2c-b112-1aab875d5559" (UID: "69e16c37-b9da-4c2c-b112-1aab875d5559"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:21:55.996777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996620    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-home" (OuterVolumeSpecName: "home") pod "69e16c37-b9da-4c2c-b112-1aab875d5559" (UID: "69e16c37-b9da-4c2c-b112-1aab875d5559"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:21:55.996777 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996642    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-model-cache" (OuterVolumeSpecName: "model-cache") pod "69e16c37-b9da-4c2c-b112-1aab875d5559" (UID: "69e16c37-b9da-4c2c-b112-1aab875d5559"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:21:55.996904 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996886    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-tmp-dir\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:55.997006 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996906    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-model-cache\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:55.997006 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.996942    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-home\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:55.998704 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.998676    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69e16c37-b9da-4c2c-b112-1aab875d5559-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "69e16c37-b9da-4c2c-b112-1aab875d5559" (UID: "69e16c37-b9da-4c2c-b112-1aab875d5559"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:21:55.998799 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.998739    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e16c37-b9da-4c2c-b112-1aab875d5559-kube-api-access-cmqp4" (OuterVolumeSpecName: "kube-api-access-cmqp4") pod "69e16c37-b9da-4c2c-b112-1aab875d5559" (UID: "69e16c37-b9da-4c2c-b112-1aab875d5559"). InnerVolumeSpecName "kube-api-access-cmqp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:21:55.998845 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:55.998809    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-dshm" (OuterVolumeSpecName: "dshm") pod "69e16c37-b9da-4c2c-b112-1aab875d5559" (UID: "69e16c37-b9da-4c2c-b112-1aab875d5559"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:21:56.097793 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.097766    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/69e16c37-b9da-4c2c-b112-1aab875d5559-tls-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:56.097793 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.097790    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmqp4\" (UniqueName: \"kubernetes.io/projected/69e16c37-b9da-4c2c-b112-1aab875d5559-kube-api-access-cmqp4\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:56.097793 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.097799    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/69e16c37-b9da-4c2c-b112-1aab875d5559-dshm\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:21:56.754884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.754795    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"
Sep 08 02:21:56.754884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.754835    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c" event={"ID":"69e16c37-b9da-4c2c-b112-1aab875d5559","Type":"ContainerDied","Data":"dfade3aec3fd223b3ad24fd8ec220af0cbce5a2250d22bc0bd706cdb75395b3e"}
Sep 08 02:21:56.755381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.754888    2562 scope.go:117] "RemoveContainer" containerID="16fbc46466f552c614486ed738247db49cda57a89d3483cd3846512127768083"
Sep 08 02:21:56.776337 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.776312    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"]
Sep 08 02:21:56.780223 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:56.780198    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-527ac8/sub-test-model-527ac8-kserve-58cb9b7699-w5c6c"]
Sep 08 02:21:57.071614 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:57.071580    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e16c37-b9da-4c2c-b112-1aab875d5559" path="/var/lib/kubelet/pods/69e16c37-b9da-4c2c-b112-1aab875d5559/volumes"
Sep 08 02:21:59.407258 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:21:59.407227    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:22:03.315226 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:03.315192    2562 scope.go:117] "RemoveContainer" containerID="e06f5f6d75d655bd817768484b9ab62b40b11b9988c561022fa523d03acd82bc"
Sep 08 02:22:05.472309 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:05.472259    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:06.468528 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.468492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:06.566093 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.566055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:06.643135 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.643061    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"]
Sep 08 02:22:06.645070 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.645042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:06.645683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.645665    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-c25e6e-sfq69"]
Sep 08 02:22:06.705640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.705609    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:06.996527 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:06.996476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:07.070204 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:07.070176    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21706017-ea74-47cb-a341-02fcf3fd45ae" path="/var/lib/kubelet/pods/21706017-ea74-47cb-a341-02fcf3fd45ae/volumes"
Sep 08 02:22:11.215709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:11.215673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:12.648220 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:12.648185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:12.698984 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:12.698950    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:12.887868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:12.887838    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"]
Sep 08 02:22:12.888131 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:12.888104    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy" containerID="cri-o://65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b" gracePeriod=30
Sep 08 02:22:12.904183 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:12.904111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:13.016214 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.016174    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:22:13.207036 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.206952    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"]
Sep 08 02:22:13.207379 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.207367    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21706017-ea74-47cb-a341-02fcf3fd45ae" containerName="revoke-keys"
Sep 08 02:22:13.207424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.207381    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="21706017-ea74-47cb-a341-02fcf3fd45ae" containerName="revoke-keys"
Sep 08 02:22:13.207424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.207403    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e16c37-b9da-4c2c-b112-1aab875d5559" containerName="main"
Sep 08 02:22:13.207424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.207409    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e16c37-b9da-4c2c-b112-1aab875d5559" containerName="main"
Sep 08 02:22:13.207524 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.207475    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="21706017-ea74-47cb-a341-02fcf3fd45ae" containerName="revoke-keys"
Sep 08 02:22:13.207524 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.207486    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e16c37-b9da-4c2c-b112-1aab875d5559" containerName="main"
Sep 08 02:22:13.211927 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.211892    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:13.214601 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.214573    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:22:13.214776 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.214579    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:22:13.217021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.216995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"]
Sep 08 02:22:13.284862 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.284832    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72d427-f30a-4082-9314-f2b1dc527550-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4a198d-x74vc\" (UID: \"2b72d427-f30a-4082-9314-f2b1dc527550\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:13.385391 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.385364    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72d427-f30a-4082-9314-f2b1dc527550-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4a198d-x74vc\" (UID: \"2b72d427-f30a-4082-9314-f2b1dc527550\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:13.385987 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.385968    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72d427-f30a-4082-9314-f2b1dc527550-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-4a198d-x74vc\" (UID: \"2b72d427-f30a-4082-9314-f2b1dc527550\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:13.422852 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.422801    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:13.524013 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.523932    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:13.798754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.798730    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"]
Sep 08 02:22:13.800907 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:22:13.800877    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b72d427_f30a_4082_9314_f2b1dc527550.slice/crio-816b00ba63d7a03fc9a8b57bbc7f8b12e294e99cc159080cb45feaeb8f80ebdd WatchSource:0}: Error finding container 816b00ba63d7a03fc9a8b57bbc7f8b12e294e99cc159080cb45feaeb8f80ebdd: Status 404 returned error can't find the container with id 816b00ba63d7a03fc9a8b57bbc7f8b12e294e99cc159080cb45feaeb8f80ebdd
Sep 08 02:22:13.861842 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:13.861810    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc" event={"ID":"2b72d427-f30a-4082-9314-f2b1dc527550","Type":"ContainerStarted","Data":"816b00ba63d7a03fc9a8b57bbc7f8b12e294e99cc159080cb45feaeb8f80ebdd"}
Sep 08 02:22:14.868805 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:14.868772    2562 generic.go:356] "Generic (PLEG): container finished" podID="2b72d427-f30a-4082-9314-f2b1dc527550" containerID="7d8f5b211c3b7a8e644d146da423a5bfec2550f5c7aa8f178a700d434e96ffc0" exitCode=0
Sep 08 02:22:14.869199 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:14.868860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc" event={"ID":"2b72d427-f30a-4082-9314-f2b1dc527550","Type":"ContainerDied","Data":"7d8f5b211c3b7a8e644d146da423a5bfec2550f5c7aa8f178a700d434e96ffc0"}
Sep 08 02:22:16.007667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.007637    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:16.113090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.113059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72d427-f30a-4082-9314-f2b1dc527550-maas-api-service-ca\") pod \"2b72d427-f30a-4082-9314-f2b1dc527550\" (UID: \"2b72d427-f30a-4082-9314-f2b1dc527550\") "
Sep 08 02:22:16.113454 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.113433    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b72d427-f30a-4082-9314-f2b1dc527550-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b72d427-f30a-4082-9314-f2b1dc527550" (UID: "2b72d427-f30a-4082-9314-f2b1dc527550"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:22:16.113646 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.113628    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b72d427-f30a-4082-9314-f2b1dc527550-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:16.880717 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.880689    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"
Sep 08 02:22:16.880896 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.880730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc" event={"ID":"2b72d427-f30a-4082-9314-f2b1dc527550","Type":"ContainerDied","Data":"816b00ba63d7a03fc9a8b57bbc7f8b12e294e99cc159080cb45feaeb8f80ebdd"}
Sep 08 02:22:16.880896 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:16.880773    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="816b00ba63d7a03fc9a8b57bbc7f8b12e294e99cc159080cb45feaeb8f80ebdd"
Sep 08 02:22:18.139973 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.139945    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:22:18.235328 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235250    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-certs\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235328 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235286    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-podinfo\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235328 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235326    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-credential-socket\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-envoy\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235358    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwkpg\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-kube-api-access-vwkpg\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235378    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-token\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235409    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-socket\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istiod-ca-cert\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235550    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:18.235605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-data\") pod \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\" (UID: \"65ac7926-c9db-4a0e-bf1a-5273d3cc6133\") "
Sep 08 02:22:18.236009 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235626    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:18.236009 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235775    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:18.236009 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235976    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-data" (OuterVolumeSpecName: "istio-data") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:18.236009 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.235892    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:22:18.236174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.236105    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.236174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.236123    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.236174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.236136    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.236174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.236149    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.236174 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.236162    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.237649 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.237620    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:22:18.237772 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.237696    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-kube-api-access-vwkpg" (OuterVolumeSpecName: "kube-api-access-vwkpg") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "kube-api-access-vwkpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:22:18.237908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.237891    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:18.238037 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.238009    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-token" (OuterVolumeSpecName: "istio-token") pod "65ac7926-c9db-4a0e-bf1a-5273d3cc6133" (UID: "65ac7926-c9db-4a0e-bf1a-5273d3cc6133"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:22:18.336625 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.336598    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.336625 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.336620    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.336625 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.336630    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwkpg\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-kube-api-access-vwkpg\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.336880 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.336638    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/65ac7926-c9db-4a0e-bf1a-5273d3cc6133-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:18.893010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.892978    2562 generic.go:356] "Generic (PLEG): container finished" podID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerID="65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b" exitCode=0
Sep 08 02:22:18.893188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.893038    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"
Sep 08 02:22:18.893188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.893073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" event={"ID":"65ac7926-c9db-4a0e-bf1a-5273d3cc6133","Type":"ContainerDied","Data":"65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b"}
Sep 08 02:22:18.893188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.893130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm" event={"ID":"65ac7926-c9db-4a0e-bf1a-5273d3cc6133","Type":"ContainerDied","Data":"8a4ea24b19ed6b19da6ed3bc88b7218876de425222339dd12e17a446c4e87bd8"}
Sep 08 02:22:18.893188 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.893157    2562 scope.go:117] "RemoveContainer" containerID="65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b"
Sep 08 02:22:18.903014 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.903000    2562 scope.go:117] "RemoveContainer" containerID="7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"
Sep 08 02:22:18.911613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.911598    2562 scope.go:117] "RemoveContainer" containerID="65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b"
Sep 08 02:22:18.911901 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:22:18.911873    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b\": container with ID starting with 65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b not found: ID does not exist" containerID="65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b"
Sep 08 02:22:18.912022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.911902    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b"} err="failed to get container status \"65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b\": rpc error: code = NotFound desc = could not find container \"65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b\": container with ID starting with 65a9f9ae82f4a2dccc78e09b725722827d504be023aeeed08852000b26f6124b not found: ID does not exist"
Sep 08 02:22:18.912022 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.911938    2562 scope.go:117] "RemoveContainer" containerID="7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"
Sep 08 02:22:18.912200 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:22:18.912180    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57\": container with ID starting with 7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57 not found: ID does not exist" containerID="7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"
Sep 08 02:22:18.912259 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.912209    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57"} err="failed to get container status \"7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57\": rpc error: code = NotFound desc = could not find container \"7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57\": container with ID starting with 7f4a34bfd0eb5a6cad8f7e18d861f82a8f99cb4905acdeea1aab57be0e326b57 not found: ID does not exist"
Sep 08 02:22:18.918613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.918591    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"]
Sep 08 02:22:18.920529 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:18.920510    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c25e6e-openshift-default-79584dc75b-j59lm"]
Sep 08 02:22:19.074193 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:19.074159    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" path="/var/lib/kubelet/pods/65ac7926-c9db-4a0e-bf1a-5273d3cc6133/volumes"
Sep 08 02:22:19.576545 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:19.576512    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:23.444808 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:23.444775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:26.312115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:26.312074    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:22:28.993878 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:28.993846    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:29.060901 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:29.060855    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:29.127617 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:29.127572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:29.168504 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:29.168450    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"]
Sep 08 02:22:29.170803 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:29.170778    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-4a198d-x74vc"]
Sep 08 02:22:29.192395 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:29.192360    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:29.511954 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:29.511901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:31.070107 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:31.070076    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b72d427-f30a-4082-9314-f2b1dc527550" path="/var/lib/kubelet/pods/2b72d427-f30a-4082-9314-f2b1dc527550/volumes"
Sep 08 02:22:33.541530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:33.541497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:35.129879 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.129835    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:35.191055 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.191025    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:35.363409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.363376    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"]
Sep 08 02:22:35.363621 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.363598    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy" containerID="cri-o://ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c" gracePeriod=30
Sep 08 02:22:35.382957 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.382851    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:35.698205 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698124    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"]
Sep 08 02:22:35.698577 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698564    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b72d427-f30a-4082-9314-f2b1dc527550" containerName="revoke-keys"
Sep 08 02:22:35.698627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698579    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b72d427-f30a-4082-9314-f2b1dc527550" containerName="revoke-keys"
Sep 08 02:22:35.698627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698599    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy"
Sep 08 02:22:35.698627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698605    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy"
Sep 08 02:22:35.698627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698612    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy"
Sep 08 02:22:35.698627 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698617    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy"
Sep 08 02:22:35.698810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698670    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b72d427-f30a-4082-9314-f2b1dc527550" containerName="revoke-keys"
Sep 08 02:22:35.698810 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.698677    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy"
Sep 08 02:22:35.701765 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.701738    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:35.704324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.704299    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:22:35.704324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.704322    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:22:35.709240 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.709214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"]
Sep 08 02:22:35.818616 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.818580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8553baf-8d53-4714-acc4-8c4654cd6958-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445\" (UID: \"d8553baf-8d53-4714-acc4-8c4654cd6958\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:35.919452 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.919413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8553baf-8d53-4714-acc4-8c4654cd6958-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445\" (UID: \"d8553baf-8d53-4714-acc4-8c4654cd6958\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:35.920085 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.920067    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8553baf-8d53-4714-acc4-8c4654cd6958-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445\" (UID: \"d8553baf-8d53-4714-acc4-8c4654cd6958\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:35.951404 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:35.951332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:36.013155 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:36.013128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:36.285661 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:36.285637    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"]
Sep 08 02:22:36.287870 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:22:36.287840    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8553baf_8d53_4714_acc4_8c4654cd6958.slice/crio-4395a02b473449b62104b3b7eb86330aa8b44b00ddc4870108bcc08d85047104 WatchSource:0}: Error finding container 4395a02b473449b62104b3b7eb86330aa8b44b00ddc4870108bcc08d85047104: Status 404 returned error can't find the container with id 4395a02b473449b62104b3b7eb86330aa8b44b00ddc4870108bcc08d85047104
Sep 08 02:22:36.991153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:36.991119    2562 generic.go:356] "Generic (PLEG): container finished" podID="d8553baf-8d53-4714-acc4-8c4654cd6958" containerID="b9337ab5f1f31508e00ceac00b5bfb42d4eff128d20524b78055cbb66b9650ff" exitCode=0
Sep 08 02:22:36.991153 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:36.991157    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445" event={"ID":"d8553baf-8d53-4714-acc4-8c4654cd6958","Type":"ContainerDied","Data":"b9337ab5f1f31508e00ceac00b5bfb42d4eff128d20524b78055cbb66b9650ff"}
Sep 08 02:22:36.991352 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:36.991195    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445" event={"ID":"d8553baf-8d53-4714-acc4-8c4654cd6958","Type":"ContainerStarted","Data":"4395a02b473449b62104b3b7eb86330aa8b44b00ddc4870108bcc08d85047104"}
Sep 08 02:22:38.124144 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:38.124123    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:38.246234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:38.246201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8553baf-8d53-4714-acc4-8c4654cd6958-maas-api-service-ca\") pod \"d8553baf-8d53-4714-acc4-8c4654cd6958\" (UID: \"d8553baf-8d53-4714-acc4-8c4654cd6958\") "
Sep 08 02:22:38.246571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:38.246545    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8553baf-8d53-4714-acc4-8c4654cd6958-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d8553baf-8d53-4714-acc4-8c4654cd6958" (UID: "d8553baf-8d53-4714-acc4-8c4654cd6958"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:22:38.246713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:38.246659    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d8553baf-8d53-4714-acc4-8c4654cd6958-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:39.004208 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:39.004181    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"
Sep 08 02:22:39.004446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:39.004185    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445" event={"ID":"d8553baf-8d53-4714-acc4-8c4654cd6958","Type":"ContainerDied","Data":"4395a02b473449b62104b3b7eb86330aa8b44b00ddc4870108bcc08d85047104"}
Sep 08 02:22:39.004587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:39.004476    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4395a02b473449b62104b3b7eb86330aa8b44b00ddc4870108bcc08d85047104"
Sep 08 02:22:39.014790 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:39.014769    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:22:40.615415 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.615391    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:22:40.672126 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5qzc\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-kube-api-access-s5qzc\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672127    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istiod-ca-cert\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672159    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-credential-socket\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-token\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672236    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-envoy\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672302    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-podinfo\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672352    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-data\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672394    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-socket\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672418    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-certs\") pod \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\" (UID: \"adfdc9d0-df63-44cb-a1f8-fb1ec593f407\") "
Sep 08 02:22:40.672522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672476    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:40.672761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672619    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-data" (OuterVolumeSpecName: "istio-data") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:40.672761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:40.672871 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672844    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.672871 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672862    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.673002 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672877    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.673002 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672876    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:22:40.673002 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.672884    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:40.674778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.674755    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:22:40.674778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.674763    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-kube-api-access-s5qzc" (OuterVolumeSpecName: "kube-api-access-s5qzc") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "kube-api-access-s5qzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:22:40.674952 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.674856    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:40.674952 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.674860    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-token" (OuterVolumeSpecName: "istio-token") pod "adfdc9d0-df63-44cb-a1f8-fb1ec593f407" (UID: "adfdc9d0-df63-44cb-a1f8-fb1ec593f407"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:22:40.773978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.773942    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.773978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.773970    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.773978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.773979    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.773978 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.773987    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.774249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.773996    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5qzc\" (UniqueName: \"kubernetes.io/projected/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-kube-api-access-s5qzc\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:40.774249 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:40.774004    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adfdc9d0-df63-44cb-a1f8-fb1ec593f407-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:41.023931 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.023820    2562 generic.go:356] "Generic (PLEG): container finished" podID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerID="ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c" exitCode=0
Sep 08 02:22:41.023931 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.023874    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"
Sep 08 02:22:41.023931 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.023899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" event={"ID":"adfdc9d0-df63-44cb-a1f8-fb1ec593f407","Type":"ContainerDied","Data":"ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c"}
Sep 08 02:22:41.024154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.023971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x" event={"ID":"adfdc9d0-df63-44cb-a1f8-fb1ec593f407","Type":"ContainerDied","Data":"246f8607294bcd2a07617e86777fbda541560632725dc87851afb0ee7b378226"}
Sep 08 02:22:41.024154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.023993    2562 scope.go:117] "RemoveContainer" containerID="ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c"
Sep 08 02:22:41.034076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.034009    2562 scope.go:117] "RemoveContainer" containerID="1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"
Sep 08 02:22:41.042454 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.042440    2562 scope.go:117] "RemoveContainer" containerID="ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c"
Sep 08 02:22:41.042713 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:22:41.042694    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c\": container with ID starting with ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c not found: ID does not exist" containerID="ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c"
Sep 08 02:22:41.042763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.042719    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c"} err="failed to get container status \"ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c\": rpc error: code = NotFound desc = could not find container \"ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c\": container with ID starting with ca0480110ac7468fc108e3b3904ae8073adf348ae0a69a206d8c48992d3fc90c not found: ID does not exist"
Sep 08 02:22:41.042763 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.042735    2562 scope.go:117] "RemoveContainer" containerID="1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"
Sep 08 02:22:41.043012 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:22:41.042993    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2\": container with ID starting with 1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2 not found: ID does not exist" containerID="1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"
Sep 08 02:22:41.043082 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.043022    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2"} err="failed to get container status \"1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2\": rpc error: code = NotFound desc = could not find container \"1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2\": container with ID starting with 1a1ae1be1a3ada4843f0ea5a8a3f12f07188d1cc00990c39195ed63135ed34b2 not found: ID does not exist"
Sep 08 02:22:41.047311 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.047288    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"]
Sep 08 02:22:41.052147 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.052126    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-4a198d-openshift-default-5fdf94df8d-f6q7x"]
Sep 08 02:22:41.069949 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:41.069901    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" path="/var/lib/kubelet/pods/adfdc9d0-df63-44cb-a1f8-fb1ec593f407/volumes"
Sep 08 02:22:46.242424 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.242373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:46.342187 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.342156    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:46.429879 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.429841    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"]
Sep 08 02:22:46.431938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.431896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:46.432136 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.432120    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-670bc3-9r445"]
Sep 08 02:22:46.488643 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.488618    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:46.772409 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:46.772373    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:47.069747 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:47.069713    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8553baf-8d53-4714-acc4-8c4654cd6958" path="/var/lib/kubelet/pods/d8553baf-8d53-4714-acc4-8c4654cd6958/volumes"
Sep 08 02:22:51.414426 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:51.414388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:22:52.748143 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:52.748109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:52.804080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:52.804040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:52.978955 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:52.978923    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"]
Sep 08 02:22:52.979179 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:52.979155    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy" containerID="cri-o://f87f2f0ba8acaa0033f1d6147ceac301cc7245518262b9172ac493251c144d16" gracePeriod=30
Sep 08 02:22:53.000987 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.000886    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:53.309828 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.309795    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"]
Sep 08 02:22:53.310242 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310228    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8553baf-8d53-4714-acc4-8c4654cd6958" containerName="revoke-keys"
Sep 08 02:22:53.310288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310243    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8553baf-8d53-4714-acc4-8c4654cd6958" containerName="revoke-keys"
Sep 08 02:22:53.310288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310262    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy"
Sep 08 02:22:53.310288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310267    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy"
Sep 08 02:22:53.310288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310274    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy"
Sep 08 02:22:53.310288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310279    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy"
Sep 08 02:22:53.310445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310353    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65ac7926-c9db-4a0e-bf1a-5273d3cc6133" containerName="istio-proxy"
Sep 08 02:22:53.310445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310362    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8553baf-8d53-4714-acc4-8c4654cd6958" containerName="revoke-keys"
Sep 08 02:22:53.310445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310370    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy"
Sep 08 02:22:53.310445 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.310378    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="adfdc9d0-df63-44cb-a1f8-fb1ec593f407" containerName="istio-proxy"
Sep 08 02:22:53.313657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.313641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:53.316074 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.316053    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:22:53.316074 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.316071    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:22:53.321032 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.321007    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"]
Sep 08 02:22:53.403138 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.403106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65dd18-c1a9-4331-ae3a-3b3d462a0310-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br\" (UID: \"5c65dd18-c1a9-4331-ae3a-3b3d462a0310\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:53.437607 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.437570    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:53.504407 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.504368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65dd18-c1a9-4331-ae3a-3b3d462a0310-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br\" (UID: \"5c65dd18-c1a9-4331-ae3a-3b3d462a0310\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:53.505028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.505009    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65dd18-c1a9-4331-ae3a-3b3d462a0310-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br\" (UID: \"5c65dd18-c1a9-4331-ae3a-3b3d462a0310\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:53.625977 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.625881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:53.897853 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:53.897828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"]
Sep 08 02:22:53.899076 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:22:53.899049    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c65dd18_c1a9_4331_ae3a_3b3d462a0310.slice/crio-954c34a477e25af30b101ad66c717dfd8de498c7bd33cbe5b5872716c9065cff WatchSource:0}: Error finding container 954c34a477e25af30b101ad66c717dfd8de498c7bd33cbe5b5872716c9065cff: Status 404 returned error can't find the container with id 954c34a477e25af30b101ad66c717dfd8de498c7bd33cbe5b5872716c9065cff
Sep 08 02:22:54.100629 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:54.100598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br" event={"ID":"5c65dd18-c1a9-4331-ae3a-3b3d462a0310","Type":"ContainerStarted","Data":"954c34a477e25af30b101ad66c717dfd8de498c7bd33cbe5b5872716c9065cff"}
Sep 08 02:22:55.107282 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:55.107249    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c65dd18-c1a9-4331-ae3a-3b3d462a0310" containerID="7086fbc3244411f471796c1bf31bb6cd20f69a87c23d52533abd8d68e26ee84a" exitCode=0
Sep 08 02:22:55.107644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:55.107329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br" event={"ID":"5c65dd18-c1a9-4331-ae3a-3b3d462a0310","Type":"ContainerDied","Data":"7086fbc3244411f471796c1bf31bb6cd20f69a87c23d52533abd8d68e26ee84a"}
Sep 08 02:22:56.246283 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:56.246256    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:56.331953 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:56.331902    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65dd18-c1a9-4331-ae3a-3b3d462a0310-maas-api-service-ca\") pod \"5c65dd18-c1a9-4331-ae3a-3b3d462a0310\" (UID: \"5c65dd18-c1a9-4331-ae3a-3b3d462a0310\") "
Sep 08 02:22:56.332272 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:56.332246    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5c65dd18-c1a9-4331-ae3a-3b3d462a0310-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5c65dd18-c1a9-4331-ae3a-3b3d462a0310" (UID: "5c65dd18-c1a9-4331-ae3a-3b3d462a0310"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:22:56.433689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:56.433613    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c65dd18-c1a9-4331-ae3a-3b3d462a0310-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:57.118402 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:57.118377    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"
Sep 08 02:22:57.118520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:57.118374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br" event={"ID":"5c65dd18-c1a9-4331-ae3a-3b3d462a0310","Type":"ContainerDied","Data":"954c34a477e25af30b101ad66c717dfd8de498c7bd33cbe5b5872716c9065cff"}
Sep 08 02:22:57.118520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:57.118489    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="954c34a477e25af30b101ad66c717dfd8de498c7bd33cbe5b5872716c9065cff"
Sep 08 02:22:57.398203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:57.398130    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:58.125871 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.125834    2562 generic.go:356] "Generic (PLEG): container finished" podID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerID="f87f2f0ba8acaa0033f1d6147ceac301cc7245518262b9172ac493251c144d16" exitCode=0
Sep 08 02:22:58.126028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.125901    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" event={"ID":"4ca7a321-9cf2-43d1-b633-39ac89e71fd2","Type":"ContainerDied","Data":"f87f2f0ba8acaa0033f1d6147ceac301cc7245518262b9172ac493251c144d16"}
Sep 08 02:22:58.126028 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.125977    2562 scope.go:117] "RemoveContainer" containerID="02cd24e22d4ce6925c12d39613061f6eba702d7d4f57549ea69d3cbae9d3dc9b"
Sep 08 02:22:58.238653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.238629    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:22:58.351655 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.351621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:58.353728 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353707    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-credential-socket\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.353814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353740    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-data\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.353814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353766    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-podinfo\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.353814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353791    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istiod-ca-cert\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.353814 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353808    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-socket\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.354026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353844    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-certs\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.354026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353861    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6xjt\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-kube-api-access-s6xjt\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.354026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.353987    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:58.354026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354013    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-data" (OuterVolumeSpecName: "istio-data") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:58.354176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354123    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:58.354235 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354208    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:58.354276 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354266    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:22:58.354320 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354275    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-envoy\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.354384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354366    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-token\") pod \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\" (UID: \"4ca7a321-9cf2-43d1-b633-39ac89e71fd2\") "
Sep 08 02:22:58.354780 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354759    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.354884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354785    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.354884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354801    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.354884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354814    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.354884 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.354828    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.356080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.356054    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:22:58.356196 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.356151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-kube-api-access-s6xjt" (OuterVolumeSpecName: "kube-api-access-s6xjt") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "kube-api-access-s6xjt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:22:58.356245 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.356215    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:22:58.356506 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.356491    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-token" (OuterVolumeSpecName: "istio-token") pod "4ca7a321-9cf2-43d1-b633-39ac89e71fd2" (UID: "4ca7a321-9cf2-43d1-b633-39ac89e71fd2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:22:58.455536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.455500    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.455536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.455528    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6xjt\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-kube-api-access-s6xjt\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.455536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.455538    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.455536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.455546    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4ca7a321-9cf2-43d1-b633-39ac89e71fd2-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:22:58.760146 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:58.760042    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:59.019851 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.019709    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"]
Sep 08 02:22:59.020301 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020279    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c65dd18-c1a9-4331-ae3a-3b3d462a0310" containerName="revoke-keys"
Sep 08 02:22:59.020301 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020302    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c65dd18-c1a9-4331-ae3a-3b3d462a0310" containerName="revoke-keys"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020321    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020329    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020362    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020371    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020460    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020475    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" containerName="istio-proxy"
Sep 08 02:22:59.020485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.020487    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c65dd18-c1a9-4331-ae3a-3b3d462a0310" containerName="revoke-keys"
Sep 08 02:22:59.023945 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.023908    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.026456 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.026432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-b23439-openshift-default-dockercfg-sprcb\""
Sep 08 02:22:59.035570 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.035547    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"]
Sep 08 02:22:59.052345 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.052316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:59.137162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.137126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98" event={"ID":"4ca7a321-9cf2-43d1-b633-39ac89e71fd2","Type":"ContainerDied","Data":"df6a12aaf0d7b99132f30b8469e0738256d85021ccba3730c8e302acaa8dbd34"}
Sep 08 02:22:59.137162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.137149    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"
Sep 08 02:22:59.137410 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.137197    2562 scope.go:117] "RemoveContainer" containerID="f87f2f0ba8acaa0033f1d6147ceac301cc7245518262b9172ac493251c144d16"
Sep 08 02:22:59.160298 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.160268    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"]
Sep 08 02:22:59.163244 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-certs\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163395 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-socket\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163395 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-istio-token\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72691f5e-ce50-4f11-8162-c85b1d912930-istio-podinfo\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-credential-socket\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrt5z\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-kube-api-access-lrt5z\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163636 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-envoy\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163693 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-data\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.163761 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.163731    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72691f5e-ce50-4f11-8162-c85b1d912930-istiod-ca-cert\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.164217 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.164200    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-670bc3-openshift-default-85c9f755b-l7x98"]
Sep 08 02:22:59.219700 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.219669    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:22:59.265151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265119    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-socket\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265153    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-istio-token\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265353 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265265    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72691f5e-ce50-4f11-8162-c85b1d912930-istio-podinfo\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265353 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-credential-socket\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265474 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrt5z\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-kube-api-access-lrt5z\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265474 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-envoy\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265474 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-data\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265634 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265515    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72691f5e-ce50-4f11-8162-c85b1d912930-istiod-ca-cert\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265634 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-certs\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265634 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265569    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-socket\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265785 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-credential-socket\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.265904 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-data\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.266004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.265947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-certs\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.266193 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.266176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72691f5e-ce50-4f11-8162-c85b1d912930-istiod-ca-cert\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.267542 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.267522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-envoy\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.267855 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.267837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72691f5e-ce50-4f11-8162-c85b1d912930-istio-podinfo\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.272755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.272706    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-istio-token\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.272755 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.272736    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrt5z\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-kube-api-access-lrt5z\") pod \"e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") " pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.337835 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.337805    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:22:59.611552 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.611527    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"]
Sep 08 02:22:59.613486 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:22:59.613457    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72691f5e_ce50_4f11_8162_c85b1d912930.slice/crio-c55a0b4d2aa393c5d2a6e7080a089ed8f60f651f60a764b2805273b662a16062 WatchSource:0}: Error finding container c55a0b4d2aa393c5d2a6e7080a089ed8f60f651f60a764b2805273b662a16062: Status 404 returned error can't find the container with id c55a0b4d2aa393c5d2a6e7080a089ed8f60f651f60a764b2805273b662a16062
Sep 08 02:22:59.616224 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.616196    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:22:59.616284 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.616256    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:22:59.616324 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:22:59.616282    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:00.144802 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:00.144770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" event={"ID":"72691f5e-ce50-4f11-8162-c85b1d912930","Type":"ContainerStarted","Data":"0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"}
Sep 08 02:23:00.144989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:00.144818    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" event={"ID":"72691f5e-ce50-4f11-8162-c85b1d912930","Type":"ContainerStarted","Data":"c55a0b4d2aa393c5d2a6e7080a089ed8f60f651f60a764b2805273b662a16062"}
Sep 08 02:23:00.170938 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:00.165716    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podStartSLOduration=1.165696801 podStartE2EDuration="1.165696801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:22:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:00.164495597 +0000 UTC m=+1437.620110541" watchObservedRunningTime="2026-09-08 02:23:00.165696801 +0000 UTC m=+1437.621311714"
Sep 08 02:23:00.338762 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:00.338726    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:00.343521 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:00.343499    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:01.070071 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:01.070036    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ca7a321-9cf2-43d1-b633-39ac89e71fd2" path="/var/lib/kubelet/pods/4ca7a321-9cf2-43d1-b633-39ac89e71fd2/volumes"
Sep 08 02:23:01.149932 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:01.149883    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:01.150819 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:01.150798    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:02.762682 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:02.762649    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:02.865701 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:02.865672    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.120107 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.120072    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:23:03.161203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.161165    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.258758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.258717    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.339954 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.339908    2562 scope.go:117] "RemoveContainer" containerID="bf540c76db660628d93eba9633c42069cb6d7e86cb2e3fb87690ddce9d5e8913"
Sep 08 02:23:03.358421 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.358392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.634184 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.634098    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.726592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.726556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.915268 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.915187    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:03.989289 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:03.989256    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:04.088825 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:04.088796    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:04.108769 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:04.108728    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"]
Sep 08 02:23:04.111739 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:04.111712    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-1d1413-gw9br"]
Sep 08 02:23:04.192105 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:04.191998    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:04.506200 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:04.506097    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:05.070609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:05.070576    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c65dd18-c1a9-4331-ae3a-3b3d462a0310" path="/var/lib/kubelet/pods/5c65dd18-c1a9-4331-ae3a-3b3d462a0310/volumes"
Sep 08 02:23:08.604588 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:08.604550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:10.239713 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:10.239675    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:10.339993 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:10.339959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:10.478560 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:10.478523    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"]
Sep 08 02:23:10.478769 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:10.478742    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy" containerID="cri-o://b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7" gracePeriod=30
Sep 08 02:23:10.525376 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:10.525287    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:14.714554 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:14.714513    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:23:15.776508 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.776483    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:23:15.937320 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937253    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istiod-ca-cert\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937342    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-certs\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937382    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-kube-api-access-cz4vb\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937417    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-socket\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-envoy\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937539    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-podinfo\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937846 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937574    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-token\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937846 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937649    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-data\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.937846 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.937679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-credential-socket\") pod \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\" (UID: \"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea\") "
Sep 08 02:23:15.938210 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.938181    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:23:15.938491 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.938466    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:23:15.940053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.938613    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:23:15.940053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.939048    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:15.940053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.939068    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:15.940053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.939082    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:15.940053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.939650    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:23:15.940053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.940019    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:23:15.950063 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.950024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:23:15.951332 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.951304    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-kube-api-access-cz4vb" (OuterVolumeSpecName: "kube-api-access-cz4vb") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "kube-api-access-cz4vb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:23:15.951428 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.951401    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:23:15.951696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:15.951672    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" (UID: "0f63434e-c10a-45ee-a3fb-e7838bb4e5ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:23:16.040186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.040055    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz4vb\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-kube-api-access-cz4vb\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:16.040186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.040095    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:16.040186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.040112    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:16.040186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.040126    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:16.040186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.040138    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:16.040186 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.040151    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:23:16.249885 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.249784    2562 generic.go:356] "Generic (PLEG): container finished" podID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerID="b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7" exitCode=0
Sep 08 02:23:16.249885 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.249841    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"
Sep 08 02:23:16.250159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.249836    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" event={"ID":"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea","Type":"ContainerDied","Data":"b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7"}
Sep 08 02:23:16.250159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.249989    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f" event={"ID":"0f63434e-c10a-45ee-a3fb-e7838bb4e5ea","Type":"ContainerDied","Data":"96a52ca7839757899f56b4645096b2b7713760be01089a960b9fc3b27221c7a8"}
Sep 08 02:23:16.250159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.250024    2562 scope.go:117] "RemoveContainer" containerID="b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7"
Sep 08 02:23:16.261183 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.261163    2562 scope.go:117] "RemoveContainer" containerID="226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"
Sep 08 02:23:16.269680 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.269659    2562 scope.go:117] "RemoveContainer" containerID="b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7"
Sep 08 02:23:16.270002 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:23:16.269980    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7\": container with ID starting with b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7 not found: ID does not exist" containerID="b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7"
Sep 08 02:23:16.270068 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.270013    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7"} err="failed to get container status \"b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7\": rpc error: code = NotFound desc = could not find container \"b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7\": container with ID starting with b3565caef0ee66a99acbe33311d74eaf656fc413a4c47ea8a62213637164d8d7 not found: ID does not exist"
Sep 08 02:23:16.270068 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.270033    2562 scope.go:117] "RemoveContainer" containerID="226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"
Sep 08 02:23:16.270433 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:23:16.270336    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55\": container with ID starting with 226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55 not found: ID does not exist" containerID="226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"
Sep 08 02:23:16.270433 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.270376    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55"} err="failed to get container status \"226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55\": rpc error: code = NotFound desc = could not find container \"226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55\": container with ID starting with 226652b3995b6f49cd24a4fdf7492676faa881f8db5dfd5f01bd0415cf04de55 not found: ID does not exist"
Sep 08 02:23:16.273521 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.273497    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"]
Sep 08 02:23:16.278950 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:16.278900    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-1d1413-openshift-default-5586dff6f6-89z2f"]
Sep 08 02:23:17.070413 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:17.070378    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" path="/var/lib/kubelet/pods/0f63434e-c10a-45ee-a3fb-e7838bb4e5ea/volumes"
Sep 08 02:23:21.281307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:21.281218    2562 generic.go:356] "Generic (PLEG): container finished" podID="72691f5e-ce50-4f11-8162-c85b1d912930" containerID="0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5" exitCode=0
Sep 08 02:23:21.281307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:21.281285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" event={"ID":"72691f5e-ce50-4f11-8162-c85b1d912930","Type":"ContainerDied","Data":"0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"}
Sep 08 02:23:21.281781 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:21.281764    2562 scope.go:117] "RemoveContainer" containerID="0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"
Sep 08 02:23:21.282888 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:21.282857    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:21.283026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:21.282956    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:21.283026 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:21.283007    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:22.292013 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:22.291977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" event={"ID":"72691f5e-ce50-4f11-8162-c85b1d912930","Type":"ContainerStarted","Data":"916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9"}
Sep 08 02:23:22.338316 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:22.338209    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:22.339045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:22.339015    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 08 02:23:22.339282 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:22.339240    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 08 02:23:23.338840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:23.338377    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 08 02:23:23.338840 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:23.338446    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 08 02:23:23.993886 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:23.993842    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:24.338508 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:24.338465    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 08 02:23:24.338846 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:24.338817    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 08 02:23:25.338821 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:25.338779    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 08 02:23:25.339453 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:25.339421    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 08 02:23:26.339317 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:26.339264    2562 patch_prober.go:28] interesting pod/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Sep 08 02:23:26.339871 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:26.339343    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Sep 08 02:23:26.951224 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:26.951185    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:27.480368 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.480323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:27.480836 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.480808    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:27.482582 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.482560    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:23:27.609105 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.609073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:27.865899 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.865861    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"]
Sep 08 02:23:27.866475 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.866455    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy"
Sep 08 02:23:27.866475 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.866476    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy"
Sep 08 02:23:27.866609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.866486    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy"
Sep 08 02:23:27.866609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.866492    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy"
Sep 08 02:23:27.866609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.866560    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy"
Sep 08 02:23:27.866609 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.866568    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f63434e-c10a-45ee-a3fb-e7838bb4e5ea" containerName="istio-proxy"
Sep 08 02:23:27.868946 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.868929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.871732 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.871709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-d4845d-openshift-default-dockercfg-6nvrb\""
Sep 08 02:23:27.883463 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.883420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"]
Sep 08 02:23:27.895600 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.895577    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:27.972109 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972063    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5qd\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-kube-api-access-7j5qd\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972138    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-certs\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-podinfo\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972223    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-envoy\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972269    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-credential-socket\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972292    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/371ec2af-9f58-4b3f-8944-7ab15983a743-istiod-ca-cert\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972315    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-data\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-token\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:27.972606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:27.972461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-socket\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.044357 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.044324    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:28.073695 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-envoy\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.073832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-credential-socket\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.073832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/371ec2af-9f58-4b3f-8944-7ab15983a743-istiod-ca-cert\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.073832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073775    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-data\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.073963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073838    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-token\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.073963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-socket\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074055 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.073988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5qd\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-kube-api-access-7j5qd\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074055 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-certs\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074242 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074190    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-credential-socket\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074331 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074227    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-podinfo\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074588 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-socket\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074691 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-data\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074691 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074602    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/371ec2af-9f58-4b3f-8944-7ab15983a743-istiod-ca-cert\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.074691 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.074662    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-certs\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.076120 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.076100    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-envoy\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.076652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.076636    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-podinfo\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.082078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.082056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-token\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.082725 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.082705    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5qd\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-kube-api-access-7j5qd\") pod \"e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") " pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.189704 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.189614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:28.474287 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.474259    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"]
Sep 08 02:23:28.476419 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:23:28.476392    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371ec2af_9f58_4b3f_8944_7ab15983a743.slice/crio-58dbf36c79c30da0ce1242190c756dcae6b1c497cb9c80df6e5a97a5bebbcbd8 WatchSource:0}: Error finding container 58dbf36c79c30da0ce1242190c756dcae6b1c497cb9c80df6e5a97a5bebbcbd8: Status 404 returned error can't find the container with id 58dbf36c79c30da0ce1242190c756dcae6b1c497cb9c80df6e5a97a5bebbcbd8
Sep 08 02:23:28.478685 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.478652    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:28.478760 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.478721    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:28.478760 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:28.478753    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:29.333101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:29.333058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" event={"ID":"371ec2af-9f58-4b3f-8944-7ab15983a743","Type":"ContainerStarted","Data":"0f00d81016e62ca16f18f24cbea886008f37095d2cafa9d70a93e107b143e82e"}
Sep 08 02:23:29.333593 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:29.333118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" event={"ID":"371ec2af-9f58-4b3f-8944-7ab15983a743","Type":"ContainerStarted","Data":"58dbf36c79c30da0ce1242190c756dcae6b1c497cb9c80df6e5a97a5bebbcbd8"}
Sep 08 02:23:29.352341 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:29.352295    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podStartSLOduration=2.352278099 podStartE2EDuration="2.352278099s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:23:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:23:29.351286637 +0000 UTC m=+1466.806901570" watchObservedRunningTime="2026-09-08 02:23:29.352278099 +0000 UTC m=+1466.807893015"
Sep 08 02:23:30.190726 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:30.190688    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:30.195839 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:30.195811    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:30.339134 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:30.339100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:30.340051 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:30.340030    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:31.269237 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:31.269198    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:31.360206 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:31.360157    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:32.412926 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:32.412871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:32.516259 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:32.516221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:32.745768 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:32.745688    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:32.878365 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:32.878331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:32.976928 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:32.976892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:23:36.620690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:36.617553    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:23:46.381085 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:46.381038    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:23:46.382524 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:46.381125    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:23:47.431485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:47.431454    2562 generic.go:356] "Generic (PLEG): container finished" podID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerID="0f00d81016e62ca16f18f24cbea886008f37095d2cafa9d70a93e107b143e82e" exitCode=0
Sep 08 02:23:47.431893 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:47.431527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" event={"ID":"371ec2af-9f58-4b3f-8944-7ab15983a743","Type":"ContainerDied","Data":"0f00d81016e62ca16f18f24cbea886008f37095d2cafa9d70a93e107b143e82e"}
Sep 08 02:23:47.432064 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:47.432046    2562 scope.go:117] "RemoveContainer" containerID="0f00d81016e62ca16f18f24cbea886008f37095d2cafa9d70a93e107b143e82e"
Sep 08 02:23:47.433366 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:47.433336    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:47.433442 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:47.433425    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:47.433496 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:47.433475    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:23:48.442729 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:48.442678    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" event={"ID":"371ec2af-9f58-4b3f-8944-7ab15983a743","Type":"ContainerStarted","Data":"5ddae78557ce238935b868414ec404fd30b301b9a1102b5f6a40f6060731fbda"}
Sep 08 02:23:49.189834 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:49.189789    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:49.190078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:49.190051    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 02:23:49.190141 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:49.190106    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 02:23:50.190237 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:50.190197    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 02:23:50.190619 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:50.190270    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 02:23:51.190192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:51.190155    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 02:23:51.190948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:51.190892    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 02:23:52.190879 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:52.190840    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 02:23:52.191115 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:52.190907    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 02:23:53.190420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:53.190382    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Sep 08 02:23:53.190604 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:53.190438    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Sep 08 02:23:54.194253 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:54.194217    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:54.194631 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:54.194499    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:54.195304 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:54.195286    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:23:56.294197 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:23:56.294166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:03.151838 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:03.151811    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:24:03.154848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:03.154825    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:24:08.659103 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:08.659068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:08.759094 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:08.759059    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:14.244420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:14.244379    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:17.720518 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:17.720480    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:24:34.417801 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:34.417718    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:24:41.645417 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.645383    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:41.877344 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.877295    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"]
Sep 08 02:24:41.880263 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.880236    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.882864 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.882839    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-ae715d-openshift-default-dockercfg-kmn74\""
Sep 08 02:24:41.892466 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.892437    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"]
Sep 08 02:24:41.940231 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-data\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940231 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940198    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-certs\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-socket\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-token\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65494fe-0a9e-45df-bca1-4f753de242f3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940392    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-envoy\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940411    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-podinfo\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940583 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940440    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-credential-socket\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:41.940583 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:41.940456    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p5m8\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-kube-api-access-6p5m8\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.041753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.041708    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-certs\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.041753 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.041761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-socket\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042046 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.041904    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-token\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042046 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.041979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65494fe-0a9e-45df-bca1-4f753de242f3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-envoy\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042076    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-podinfo\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-credential-socket\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p5m8\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-kube-api-access-6p5m8\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-data\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042349 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-socket\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042455 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042381    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-certs\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042567 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042546    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-data\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042752 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042634    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-credential-socket\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.042752 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.042686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65494fe-0a9e-45df-bca1-4f753de242f3-istiod-ca-cert\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.044385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.044364    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-envoy\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.044597 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.044578    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-podinfo\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.051956 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.051930    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-token\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.052140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.052119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p5m8\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-kube-api-access-6p5m8\") pod \"e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") " pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.191760 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.191651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:42.463783 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.463749    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"]
Sep 08 02:24:42.465739 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:24:42.465709    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65494fe_0a9e_45df_bca1_4f753de242f3.slice/crio-58e8ad7290158976d5121c6a12707f99516600bd72f50c32e31925f15ce67cf9 WatchSource:0}: Error finding container 58e8ad7290158976d5121c6a12707f99516600bd72f50c32e31925f15ce67cf9: Status 404 returned error can't find the container with id 58e8ad7290158976d5121c6a12707f99516600bd72f50c32e31925f15ce67cf9
Sep 08 02:24:42.468012 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.467975    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:24:42.468110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.468044    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:24:42.468110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.468073    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:24:42.732750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.732663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" event={"ID":"e65494fe-0a9e-45df-bca1-4f753de242f3","Type":"ContainerStarted","Data":"81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"}
Sep 08 02:24:42.732750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.732717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" event={"ID":"e65494fe-0a9e-45df-bca1-4f753de242f3","Type":"ContainerStarted","Data":"58e8ad7290158976d5121c6a12707f99516600bd72f50c32e31925f15ce67cf9"}
Sep 08 02:24:42.753587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.753532    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podStartSLOduration=1.753515583 podStartE2EDuration="1.753515583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:24:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:24:42.752104894 +0000 UTC m=+1540.207719830" watchObservedRunningTime="2026-09-08 02:24:42.753515583 +0000 UTC m=+1540.209130496"
Sep 08 02:24:42.857057 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:42.857019    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:43.192571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:43.192531    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:43.198316 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:43.198288    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:43.738519 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:43.738482    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:43.739572 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:43.739547    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:24:44.599010 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:44.598969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:44.691891 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:44.691843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:45.870523 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:45.870486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:45.929506 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:45.929473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:46.060715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.060683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:46.305288 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.305251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:46.402465 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.402435    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:24:46.454322 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.454284    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"]
Sep 08 02:24:46.456831 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.456810    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.459553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.459533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-ae715d-dockercfg-b6f2k\""
Sep 08 02:24:46.459553 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.459549    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-ae715d\""
Sep 08 02:24:46.468422 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.468398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"]
Sep 08 02:24:46.590748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.590651    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74b56\" (UniqueName: \"kubernetes.io/projected/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-kube-api-access-74b56\") pod \"payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.590748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.590713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.691766 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.691722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74b56\" (UniqueName: \"kubernetes.io/projected/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-kube-api-access-74b56\") pod \"payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.691994 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.691793    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.692495 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.692474    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.700689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.700665    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74b56\" (UniqueName: \"kubernetes.io/projected/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-kube-api-access-74b56\") pod \"payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:46.769150 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:46.769118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:47.038647 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:47.038622    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"]
Sep 08 02:24:47.040785 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:24:47.040755    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdadcd63_9020_480f_a2d9_a4bc1a4f2c1d.slice/crio-e343b0bfdfa51434bace3f965885e72890108b95b7cfc74fa1d1cc7ee4cf826d WatchSource:0}: Error finding container e343b0bfdfa51434bace3f965885e72890108b95b7cfc74fa1d1cc7ee4cf826d: Status 404 returned error can't find the container with id e343b0bfdfa51434bace3f965885e72890108b95b7cfc74fa1d1cc7ee4cf826d
Sep 08 02:24:47.042970 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:47.042948    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 02:24:47.762833 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:47.762795    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6" event={"ID":"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d","Type":"ContainerStarted","Data":"e343b0bfdfa51434bace3f965885e72890108b95b7cfc74fa1d1cc7ee4cf826d"}
Sep 08 02:24:49.778029 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:49.777982    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6" event={"ID":"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d","Type":"ContainerStarted","Data":"7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03"}
Sep 08 02:24:49.778542 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:49.778062    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:24:49.812986 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:49.812900    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6" podStartSLOduration=2.040275329 podStartE2EDuration="3.812877971s" totalImagesPullingTime="1.772602642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:24:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:24:49.810346704 +0000 UTC m=+1547.265961636" watchObservedRunningTime="2026-09-08 02:24:49.812877971 +0000 UTC m=+1547.268492888"
Sep 08 02:24:54.919065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:24:54.919026    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:25:00.785490 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:00.785455    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:25:03.391484 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:03.391447    2562 scope.go:117] "RemoveContainer" containerID="11234b65621d5a675c16a9140bdd4fa41e56b9502aaa22a6ec92efee98d351cb"
Sep 08 02:25:05.882861 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:05.882826    2562 generic.go:356] "Generic (PLEG): container finished" podID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerID="81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887" exitCode=0
Sep 08 02:25:05.883305 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:05.882903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" event={"ID":"e65494fe-0a9e-45df-bca1-4f753de242f3","Type":"ContainerDied","Data":"81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"}
Sep 08 02:25:05.883386 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:05.883371    2562 scope.go:117] "RemoveContainer" containerID="81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"
Sep 08 02:25:05.884732 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:05.884703    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:25:05.884789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:05.884768    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:25:05.884828 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:05.884799    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"}
Sep 08 02:25:06.890101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:06.890061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" event={"ID":"e65494fe-0a9e-45df-bca1-4f753de242f3","Type":"ContainerStarted","Data":"6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278"}
Sep 08 02:25:07.192039 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:07.191936    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:25:07.192228 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:07.192177    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 02:25:07.192302 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:07.192248    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 02:25:08.192079 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:08.192038    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 02:25:08.192499 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:08.192100    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 02:25:09.192705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:09.192661    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 02:25:09.193159 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:09.192732    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 02:25:09.534396 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:09.534261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:10.187053 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.187018    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"]
Sep 08 02:25:10.189719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.189697    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:10.192164 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.192137    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 02:25:10.192269 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.192189    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 02:25:10.192352 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.192334    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:25:10.192414 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.192358    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:25:10.197853 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.197827    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"]
Sep 08 02:25:10.267119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.267080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4ccfc-3b4a-40d2-a259-bca4172a5de1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw\" (UID: \"90c4ccfc-3b4a-40d2-a259-bca4172a5de1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:10.372934 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.369371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4ccfc-3b4a-40d2-a259-bca4172a5de1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw\" (UID: \"90c4ccfc-3b4a-40d2-a259-bca4172a5de1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:10.372934 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.370331    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4ccfc-3b4a-40d2-a259-bca4172a5de1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw\" (UID: \"90c4ccfc-3b4a-40d2-a259-bca4172a5de1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:10.501215 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.501128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:10.789606 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.789576    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"]
Sep 08 02:25:10.791316 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:25:10.791288    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90c4ccfc_3b4a_40d2_a259_bca4172a5de1.slice/crio-493deab90558100f9ee462d1daede78bff06a593575e426d119daf3f2399c4f5 WatchSource:0}: Error finding container 493deab90558100f9ee462d1daede78bff06a593575e426d119daf3f2399c4f5: Status 404 returned error can't find the container with id 493deab90558100f9ee462d1daede78bff06a593575e426d119daf3f2399c4f5
Sep 08 02:25:10.912514 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:10.912480    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw" event={"ID":"90c4ccfc-3b4a-40d2-a259-bca4172a5de1","Type":"ContainerStarted","Data":"493deab90558100f9ee462d1daede78bff06a593575e426d119daf3f2399c4f5"}
Sep 08 02:25:11.192674 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:11.192623    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 02:25:11.192857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:11.192690    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 02:25:11.919447 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:11.919413    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw" event={"ID":"90c4ccfc-3b4a-40d2-a259-bca4172a5de1","Type":"ContainerStarted","Data":"1b32d3929a90db16c051b8ee6ce3460104c476ee309170f6af6b0b7eb03c1ef3"}
Sep 08 02:25:12.192835 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:12.192740    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Sep 08 02:25:12.192835 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:12.192795    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Sep 08 02:25:12.926807 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:12.926771    2562 generic.go:356] "Generic (PLEG): container finished" podID="90c4ccfc-3b4a-40d2-a259-bca4172a5de1" containerID="1b32d3929a90db16c051b8ee6ce3460104c476ee309170f6af6b0b7eb03c1ef3" exitCode=0
Sep 08 02:25:12.927207 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:12.926840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw" event={"ID":"90c4ccfc-3b4a-40d2-a259-bca4172a5de1","Type":"ContainerDied","Data":"1b32d3929a90db16c051b8ee6ce3460104c476ee309170f6af6b0b7eb03c1ef3"}
Sep 08 02:25:13.196964 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:13.196862    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:25:13.197171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:13.197148    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:25:13.197906 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:13.197891    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:25:14.090545 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.090520    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:14.216950 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.216810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4ccfc-3b4a-40d2-a259-bca4172a5de1-maas-api-service-ca\") pod \"90c4ccfc-3b4a-40d2-a259-bca4172a5de1\" (UID: \"90c4ccfc-3b4a-40d2-a259-bca4172a5de1\") "
Sep 08 02:25:14.217279 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.217241    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90c4ccfc-3b4a-40d2-a259-bca4172a5de1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90c4ccfc-3b4a-40d2-a259-bca4172a5de1" (UID: "90c4ccfc-3b4a-40d2-a259-bca4172a5de1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:25:14.317999 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.317909    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90c4ccfc-3b4a-40d2-a259-bca4172a5de1-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:14.939781 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.939741    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"
Sep 08 02:25:14.939988 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.939784    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw" event={"ID":"90c4ccfc-3b4a-40d2-a259-bca4172a5de1","Type":"ContainerDied","Data":"493deab90558100f9ee462d1daede78bff06a593575e426d119daf3f2399c4f5"}
Sep 08 02:25:14.939988 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:14.939835    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="493deab90558100f9ee462d1daede78bff06a593575e426d119daf3f2399c4f5"
Sep 08 02:25:16.411157 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.411115    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:16.432770 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.432731    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"]
Sep 08 02:25:16.433060 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.433029    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6" podUID="cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" containerName="payload-processing" containerID="cri-o://7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03" gracePeriod=30
Sep 08 02:25:16.513298 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.513262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:16.588013 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.587972    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"]
Sep 08 02:25:16.590104 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.590077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:16.590218 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.590163    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-ae715d-q9mbw"]
Sep 08 02:25:16.646748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.646716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:16.731194 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.731161    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:25:16.842667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.842633    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-plugins-config-volume\") pod \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") "
Sep 08 02:25:16.842667 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.842674    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74b56\" (UniqueName: \"kubernetes.io/projected/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-kube-api-access-74b56\") pod \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\" (UID: \"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d\") "
Sep 08 02:25:16.843091 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.843061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" (UID: "cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:25:16.845176 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.845154    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-kube-api-access-74b56" (OuterVolumeSpecName: "kube-api-access-74b56") pod "cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" (UID: "cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d"). InnerVolumeSpecName "kube-api-access-74b56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:25:16.932650 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.932614    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:16.944041 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.944014    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74b56\" (UniqueName: \"kubernetes.io/projected/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-kube-api-access-74b56\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:16.944041 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.944041    2562 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d-plugins-config-volume\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:16.951671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.951603    2562 generic.go:356] "Generic (PLEG): container finished" podID="cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" containerID="7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03" exitCode=0
Sep 08 02:25:16.951671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.951654    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"
Sep 08 02:25:16.951826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.951691    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6" event={"ID":"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d","Type":"ContainerDied","Data":"7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03"}
Sep 08 02:25:16.951826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.951746    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6" event={"ID":"cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d","Type":"ContainerDied","Data":"e343b0bfdfa51434bace3f965885e72890108b95b7cfc74fa1d1cc7ee4cf826d"}
Sep 08 02:25:16.951826 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.951776    2562 scope.go:117] "RemoveContainer" containerID="7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03"
Sep 08 02:25:16.961046 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.961030    2562 scope.go:117] "RemoveContainer" containerID="7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03"
Sep 08 02:25:16.961325 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:25:16.961304    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03\": container with ID starting with 7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03 not found: ID does not exist" containerID="7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03"
Sep 08 02:25:16.961364 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.961334    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03"} err="failed to get container status \"7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03\": rpc error: code = NotFound desc = could not find container \"7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03\": container with ID starting with 7c0eecc42ccdad7ff8c387af0a5dfcbe8ce650db58e480c8b1472c1fac7aab03 not found: ID does not exist"
Sep 08 02:25:16.973197 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.973165    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"]
Sep 08 02:25:16.976982 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:16.976955    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-ae715d-56f75964df-sxct6"]
Sep 08 02:25:17.070750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:17.070717    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90c4ccfc-3b4a-40d2-a259-bca4172a5de1" path="/var/lib/kubelet/pods/90c4ccfc-3b4a-40d2-a259-bca4172a5de1/volumes"
Sep 08 02:25:17.071117 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:17.071104    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" path="/var/lib/kubelet/pods/cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d/volumes"
Sep 08 02:25:22.215809 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:22.215765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:25:22.724162 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:22.724107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:22.821540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:22.821504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:22.948798 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:22.948760    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"]
Sep 08 02:25:22.949098 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:22.949068    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" containerID="cri-o://6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278" gracePeriod=30
Sep 08 02:25:22.973030 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:22.972996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:26.345683 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.345651    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"]
Sep 08 02:25:26.346110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.346090    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90c4ccfc-3b4a-40d2-a259-bca4172a5de1" containerName="revoke-keys"
Sep 08 02:25:26.346110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.346103    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="90c4ccfc-3b4a-40d2-a259-bca4172a5de1" containerName="revoke-keys"
Sep 08 02:25:26.346199 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.346117    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" containerName="payload-processing"
Sep 08 02:25:26.346199 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.346123    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" containerName="payload-processing"
Sep 08 02:25:26.346199 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.346192    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdadcd63-9020-480f-a2d9-a4bc1a4f2c1d" containerName="payload-processing"
Sep 08 02:25:26.346304 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.346203    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="90c4ccfc-3b4a-40d2-a259-bca4172a5de1" containerName="revoke-keys"
Sep 08 02:25:26.350654 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.350636    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:26.354477 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.354446    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:25:26.354863 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.354838    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:25:26.356335 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.356313    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"]
Sep 08 02:25:26.438469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.438436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb10bb6-b506-4ef3-83f6-c183fb5c8259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5\" (UID: \"3eb10bb6-b506-4ef3-83f6-c183fb5c8259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:26.438705 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.438683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:26.539597 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.539557    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb10bb6-b506-4ef3-83f6-c183fb5c8259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5\" (UID: \"3eb10bb6-b506-4ef3-83f6-c183fb5c8259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:26.540220 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.540199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb10bb6-b506-4ef3-83f6-c183fb5c8259-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5\" (UID: \"3eb10bb6-b506-4ef3-83f6-c183fb5c8259\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:26.662948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.662828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:26.931866 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:26.931841    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"]
Sep 08 02:25:26.934106 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:25:26.934074    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3eb10bb6_b506_4ef3_83f6_c183fb5c8259.slice/crio-9e4800787613c864be343e7ec9b805d6f4479fe6aaaf63a9bf2266765a3182ba WatchSource:0}: Error finding container 9e4800787613c864be343e7ec9b805d6f4479fe6aaaf63a9bf2266765a3182ba: Status 404 returned error can't find the container with id 9e4800787613c864be343e7ec9b805d6f4479fe6aaaf63a9bf2266765a3182ba
Sep 08 02:25:27.009384 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:27.009343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5" event={"ID":"3eb10bb6-b506-4ef3-83f6-c183fb5c8259","Type":"ContainerStarted","Data":"9e4800787613c864be343e7ec9b805d6f4479fe6aaaf63a9bf2266765a3182ba"}
Sep 08 02:25:28.016234 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.016198    2562 generic.go:356] "Generic (PLEG): container finished" podID="3eb10bb6-b506-4ef3-83f6-c183fb5c8259" containerID="2b196f261caafe0f0bb901b8987f69ce427154119c77ba46897659a0f16d5635" exitCode=0
Sep 08 02:25:28.016608 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.016290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5" event={"ID":"3eb10bb6-b506-4ef3-83f6-c183fb5c8259","Type":"ContainerDied","Data":"2b196f261caafe0f0bb901b8987f69ce427154119c77ba46897659a0f16d5635"}
Sep 08 02:25:28.233843 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.233818    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:25:28.256463 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256427    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-podinfo\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256616 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256490    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65494fe-0a9e-45df-bca1-4f753de242f3-istiod-ca-cert\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256616 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256534    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-envoy\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256616 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256584    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p5m8\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-kube-api-access-6p5m8\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256622    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-data\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256648    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-token\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-credential-socket\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256746    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-socket\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.256778 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-certs\") pod \"e65494fe-0a9e-45df-bca1-4f753de242f3\" (UID: \"e65494fe-0a9e-45df-bca1-4f753de242f3\") "
Sep 08 02:25:28.257065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.256999    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:25:28.257065 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.257050    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e65494fe-0a9e-45df-bca1-4f753de242f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:25:28.257228 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.257209    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:25:28.257292 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.257224    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:25:28.257292 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.257283    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.257392 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.257304    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e65494fe-0a9e-45df-bca1-4f753de242f3-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.257392 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.257371    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:25:28.259326 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.259279    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-kube-api-access-6p5m8" (OuterVolumeSpecName: "kube-api-access-6p5m8") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "kube-api-access-6p5m8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:25:28.259542 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.259509    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:25:28.259635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.259540    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:25:28.259635 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.259575    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e65494fe-0a9e-45df-bca1-4f753de242f3" (UID: "e65494fe-0a9e-45df-bca1-4f753de242f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:25:28.358520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358482    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.358520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358519    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.358748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358531    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p5m8\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-kube-api-access-6p5m8\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.358748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358543    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.358748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358554    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e65494fe-0a9e-45df-bca1-4f753de242f3-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.358748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358565    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:28.358748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:28.358577    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e65494fe-0a9e-45df-bca1-4f753de242f3-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:29.024171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.024132    2562 generic.go:356] "Generic (PLEG): container finished" podID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerID="6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278" exitCode=0
Sep 08 02:25:29.024653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.024184    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"
Sep 08 02:25:29.024653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.024219    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" event={"ID":"e65494fe-0a9e-45df-bca1-4f753de242f3","Type":"ContainerDied","Data":"6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278"}
Sep 08 02:25:29.024653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.024290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" event={"ID":"e65494fe-0a9e-45df-bca1-4f753de242f3","Type":"ContainerDied","Data":"58e8ad7290158976d5121c6a12707f99516600bd72f50c32e31925f15ce67cf9"}
Sep 08 02:25:29.024653 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.024325    2562 scope.go:117] "RemoveContainer" containerID="6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278"
Sep 08 02:25:29.036850 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.036827    2562 scope.go:117] "RemoveContainer" containerID="81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"
Sep 08 02:25:29.046791 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.046763    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"]
Sep 08 02:25:29.048351 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.048330    2562 scope.go:117] "RemoveContainer" containerID="6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278"
Sep 08 02:25:29.048702 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:25:29.048680    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278\": container with ID starting with 6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278 not found: ID does not exist" containerID="6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278"
Sep 08 02:25:29.048805 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.048715    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278"} err="failed to get container status \"6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278\": rpc error: code = NotFound desc = could not find container \"6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278\": container with ID starting with 6b3100d02093801bedf45819331faedb3f2a2c193d3d647d9388ed2210b27278 not found: ID does not exist"
Sep 08 02:25:29.048805 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.048740    2562 scope.go:117] "RemoveContainer" containerID="81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"
Sep 08 02:25:29.049238 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:25:29.049210    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887\": container with ID starting with 81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887 not found: ID does not exist" containerID="81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"
Sep 08 02:25:29.049345 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.049247    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887"} err="failed to get container status \"81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887\": rpc error: code = NotFound desc = could not find container \"81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887\": container with ID starting with 81ff3f79a244f9d5bbc666e2626428f10399c99f370394b293c551e6c402c887 not found: ID does not exist"
Sep 08 02:25:29.050273 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.050251    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f"]
Sep 08 02:25:29.072071 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.072039    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" path="/var/lib/kubelet/pods/e65494fe-0a9e-45df-bca1-4f753de242f3/volumes"
Sep 08 02:25:29.167047 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.167019    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:29.198213 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.198173    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:25:29.198385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.198246    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-ae715d-openshift-default-5bf677466-lrd6f" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:25:29.266974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.266903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb10bb6-b506-4ef3-83f6-c183fb5c8259-maas-api-service-ca\") pod \"3eb10bb6-b506-4ef3-83f6-c183fb5c8259\" (UID: \"3eb10bb6-b506-4ef3-83f6-c183fb5c8259\") "
Sep 08 02:25:29.267295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.267269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3eb10bb6-b506-4ef3-83f6-c183fb5c8259-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3eb10bb6-b506-4ef3-83f6-c183fb5c8259" (UID: "3eb10bb6-b506-4ef3-83f6-c183fb5c8259"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:25:29.368447 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:29.368390    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3eb10bb6-b506-4ef3-83f6-c183fb5c8259-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:25:30.031230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:30.031201    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"
Sep 08 02:25:30.031230 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:30.031212    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5" event={"ID":"3eb10bb6-b506-4ef3-83f6-c183fb5c8259","Type":"ContainerDied","Data":"9e4800787613c864be343e7ec9b805d6f4479fe6aaaf63a9bf2266765a3182ba"}
Sep 08 02:25:30.031697 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:30.031253    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e4800787613c864be343e7ec9b805d6f4479fe6aaaf63a9bf2266765a3182ba"
Sep 08 02:25:41.814436 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:41.814401    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:41.883587 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:41.883545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:41.943942 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:41.943893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:42.044412 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:42.044378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:42.089696 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:42.089593    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"]
Sep 08 02:25:42.091656 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:42.091627    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b23439-gx6v5"]
Sep 08 02:25:42.098900 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:42.098863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:42.363372 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:42.363262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:43.008212 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:43.008177    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:25:43.070895 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:43.070861    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3eb10bb6-b506-4ef3-83f6-c183fb5c8259" path="/var/lib/kubelet/pods/3eb10bb6-b506-4ef3-83f6-c183fb5c8259/volumes"
Sep 08 02:25:47.441791 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:47.441748    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:25:52.419154 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:25:52.419115    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:26:06.166282 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:06.166247    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:06.231003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:06.230963    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:23.866203 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:23.866170    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:24.225151 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:24.225055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:29.735666 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:29.735635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:35.471495 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:35.471459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:35.575659 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:35.575625    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:35.715446 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:35.715412    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"]
Sep 08 02:26:35.715658 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:35.715626    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy" containerID="cri-o://916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9" gracePeriod=30
Sep 08 02:26:35.742605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:35.742525    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:36.084328 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084283    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"]
Sep 08 02:26:36.084789 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084768    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy"
Sep 08 02:26:36.084882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084791    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy"
Sep 08 02:26:36.084882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084803    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3eb10bb6-b506-4ef3-83f6-c183fb5c8259" containerName="revoke-keys"
Sep 08 02:26:36.084882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084810    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3eb10bb6-b506-4ef3-83f6-c183fb5c8259" containerName="revoke-keys"
Sep 08 02:26:36.084882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084824    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy"
Sep 08 02:26:36.084882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084832    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy"
Sep 08 02:26:36.085190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084950    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3eb10bb6-b506-4ef3-83f6-c183fb5c8259" containerName="revoke-keys"
Sep 08 02:26:36.085190 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.084963    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy"
Sep 08 02:26:36.088064 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.088044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:36.091551 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.091529    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:26:36.091671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.091582    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:26:36.097902 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.097879    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"]
Sep 08 02:26:36.151385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.151346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f85fad84-0fe5-4909-8595-d3c9223dcc47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q\" (UID: \"f85fad84-0fe5-4909-8595-d3c9223dcc47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:36.208657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.208620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:36.252716 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.252679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f85fad84-0fe5-4909-8595-d3c9223dcc47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q\" (UID: \"f85fad84-0fe5-4909-8595-d3c9223dcc47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:36.253351 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.253327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f85fad84-0fe5-4909-8595-d3c9223dcc47-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q\" (UID: \"f85fad84-0fe5-4909-8595-d3c9223dcc47\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:36.400156 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.400053    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:36.685939 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:36.685899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"]
Sep 08 02:26:36.688294 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:26:36.688267    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf85fad84_0fe5_4909_8595_d3c9223dcc47.slice/crio-82475fb72a01f682fdc7cad26cbf2e29cae7f690c5576a97b0b3c25a3ede98b9 WatchSource:0}: Error finding container 82475fb72a01f682fdc7cad26cbf2e29cae7f690c5576a97b0b3c25a3ede98b9: Status 404 returned error can't find the container with id 82475fb72a01f682fdc7cad26cbf2e29cae7f690c5576a97b0b3c25a3ede98b9
Sep 08 02:26:37.411945 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:37.411890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q" event={"ID":"f85fad84-0fe5-4909-8595-d3c9223dcc47","Type":"ContainerStarted","Data":"acbefaea75c7a9ae6644a4cd9656ae7d58e5202232f9c175948f5b91a2a9afc5"}
Sep 08 02:26:37.412135 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:37.411976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q" event={"ID":"f85fad84-0fe5-4909-8595-d3c9223dcc47","Type":"ContainerStarted","Data":"82475fb72a01f682fdc7cad26cbf2e29cae7f690c5576a97b0b3c25a3ede98b9"}
Sep 08 02:26:37.428460 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:37.428404    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q" podStartSLOduration=1.428386448 podStartE2EDuration="1.428386448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:26:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:26:37.427033802 +0000 UTC m=+1654.882648738" watchObservedRunningTime="2026-09-08 02:26:37.428386448 +0000 UTC m=+1654.884001361"
Sep 08 02:26:38.419254 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:38.419222    2562 generic.go:356] "Generic (PLEG): container finished" podID="f85fad84-0fe5-4909-8595-d3c9223dcc47" containerID="acbefaea75c7a9ae6644a4cd9656ae7d58e5202232f9c175948f5b91a2a9afc5" exitCode=0
Sep 08 02:26:38.419750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:38.419307    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q" event={"ID":"f85fad84-0fe5-4909-8595-d3c9223dcc47","Type":"ContainerDied","Data":"acbefaea75c7a9ae6644a4cd9656ae7d58e5202232f9c175948f5b91a2a9afc5"}
Sep 08 02:26:39.561732 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:39.561704    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:39.578145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:39.578119    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f85fad84-0fe5-4909-8595-d3c9223dcc47-maas-api-service-ca\") pod \"f85fad84-0fe5-4909-8595-d3c9223dcc47\" (UID: \"f85fad84-0fe5-4909-8595-d3c9223dcc47\") "
Sep 08 02:26:39.578641 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:39.578589    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f85fad84-0fe5-4909-8595-d3c9223dcc47-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f85fad84-0fe5-4909-8595-d3c9223dcc47" (UID: "f85fad84-0fe5-4909-8595-d3c9223dcc47"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:26:39.679536 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:39.679442    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f85fad84-0fe5-4909-8595-d3c9223dcc47-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:40.433674 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.433643    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"
Sep 08 02:26:40.433868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.433674    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q" event={"ID":"f85fad84-0fe5-4909-8595-d3c9223dcc47","Type":"ContainerDied","Data":"82475fb72a01f682fdc7cad26cbf2e29cae7f690c5576a97b0b3c25a3ede98b9"}
Sep 08 02:26:40.433868 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.433729    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="82475fb72a01f682fdc7cad26cbf2e29cae7f690c5576a97b0b3c25a3ede98b9"
Sep 08 02:26:40.966496 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.966468    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:26:40.993721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993483    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-certs\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.993721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993529    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72691f5e-ce50-4f11-8162-c85b1d912930-istiod-ca-cert\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.993721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993583    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-istio-token\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.993721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993641    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-envoy\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.993721 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993717    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-socket\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.994160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-credential-socket\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.994160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72691f5e-ce50-4f11-8162-c85b1d912930-istio-podinfo\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.994160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993827    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrt5z\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-kube-api-access-lrt5z\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.994160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993882    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-data\") pod \"72691f5e-ce50-4f11-8162-c85b1d912930\" (UID: \"72691f5e-ce50-4f11-8162-c85b1d912930\") "
Sep 08 02:26:40.994160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.993940    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:40.994160 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994031    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72691f5e-ce50-4f11-8162-c85b1d912930-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:26:40.994485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994164    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:40.994485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-data" (OuterVolumeSpecName: "istio-data") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:40.994485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994300    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:40.994485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994320    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:40.994485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994333    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/72691f5e-ce50-4f11-8162-c85b1d912930-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:40.994485 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.994371    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:40.996459 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.996422    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:40.996578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.996455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-istio-token" (OuterVolumeSpecName: "istio-token") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:26:40.996578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.996517    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/72691f5e-ce50-4f11-8162-c85b1d912930-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:26:40.996692 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:40.996674    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-kube-api-access-lrt5z" (OuterVolumeSpecName: "kube-api-access-lrt5z") pod "72691f5e-ce50-4f11-8162-c85b1d912930" (UID: "72691f5e-ce50-4f11-8162-c85b1d912930"). InnerVolumeSpecName "kube-api-access-lrt5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:26:41.095779 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.095737    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:41.095779 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.095773    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:41.095779 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.095782    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:41.096018 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.095790    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/72691f5e-ce50-4f11-8162-c85b1d912930-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:41.096018 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.095800    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrt5z\" (UniqueName: \"kubernetes.io/projected/72691f5e-ce50-4f11-8162-c85b1d912930-kube-api-access-lrt5z\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:41.096018 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.095808    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/72691f5e-ce50-4f11-8162-c85b1d912930-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:41.441116 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.441084    2562 generic.go:356] "Generic (PLEG): container finished" podID="72691f5e-ce50-4f11-8162-c85b1d912930" containerID="916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9" exitCode=0
Sep 08 02:26:41.441314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.441138    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"
Sep 08 02:26:41.441314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.441167    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" event={"ID":"72691f5e-ce50-4f11-8162-c85b1d912930","Type":"ContainerDied","Data":"916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9"}
Sep 08 02:26:41.441314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.441224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85" event={"ID":"72691f5e-ce50-4f11-8162-c85b1d912930","Type":"ContainerDied","Data":"c55a0b4d2aa393c5d2a6e7080a089ed8f60f651f60a764b2805273b662a16062"}
Sep 08 02:26:41.441314 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.441246    2562 scope.go:117] "RemoveContainer" containerID="916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9"
Sep 08 02:26:41.450350 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.450333    2562 scope.go:117] "RemoveContainer" containerID="0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"
Sep 08 02:26:41.459075 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.458980    2562 scope.go:117] "RemoveContainer" containerID="916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9"
Sep 08 02:26:41.459547 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:26:41.459528    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9\": container with ID starting with 916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9 not found: ID does not exist" containerID="916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9"
Sep 08 02:26:41.459644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.459557    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9"} err="failed to get container status \"916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9\": rpc error: code = NotFound desc = could not find container \"916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9\": container with ID starting with 916cfc4b0e9eb48dee8259b31062d6ff735ea6437d573bdc841e163aa0ca89f9 not found: ID does not exist"
Sep 08 02:26:41.459644 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.459573    2562 scope.go:117] "RemoveContainer" containerID="0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"
Sep 08 02:26:41.459851 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:26:41.459826    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5\": container with ID starting with 0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5 not found: ID does not exist" containerID="0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"
Sep 08 02:26:41.459898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.459862    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5"} err="failed to get container status \"0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5\": rpc error: code = NotFound desc = could not find container \"0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5\": container with ID starting with 0a67571bf83c800f3f5cb22f0531ad94620fbdccfddcf0d287d8ec8c67cf30e5 not found: ID does not exist"
Sep 08 02:26:41.461375 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.461357    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"]
Sep 08 02:26:41.465461 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:41.465439    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-b23439-openshift-default-75b698bcd4-64x85"]
Sep 08 02:26:43.070121 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:43.070087    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" path="/var/lib/kubelet/pods/72691f5e-ce50-4f11-8162-c85b1d912930/volumes"
Sep 08 02:26:46.702651 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:46.702608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:46.795285 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:46.795254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:46.894487 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:46.894458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:46.911391 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:46.911359    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"]
Sep 08 02:26:46.914436 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:46.914411    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-d4845d-5l69q"]
Sep 08 02:26:46.997543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:46.997445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:47.074577 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:47.074516    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f85fad84-0fe5-4909-8595-d3c9223dcc47" path="/var/lib/kubelet/pods/f85fad84-0fe5-4909-8595-d3c9223dcc47/volumes"
Sep 08 02:26:47.285857 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:47.285827    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:51.419037 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:51.419000    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:26:52.471368 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:52.471331    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:53.094286 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.094253    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:53.161023 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.160986    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:53.334846 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.334812    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"]
Sep 08 02:26:53.335130 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.335104    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" containerID="cri-o://5ddae78557ce238935b868414ec404fd30b301b9a1102b5f6a40f6060731fbda" gracePeriod=30
Sep 08 02:26:53.363989 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.363888    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:26:53.745076 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.744991    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"]
Sep 08 02:26:53.745603 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745582    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy"
Sep 08 02:26:53.745652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745607    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy"
Sep 08 02:26:53.745652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745616    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f85fad84-0fe5-4909-8595-d3c9223dcc47" containerName="revoke-keys"
Sep 08 02:26:53.745652 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745623    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f85fad84-0fe5-4909-8595-d3c9223dcc47" containerName="revoke-keys"
Sep 08 02:26:53.745748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745697    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e65494fe-0a9e-45df-bca1-4f753de242f3" containerName="istio-proxy"
Sep 08 02:26:53.745748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745707    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy"
Sep 08 02:26:53.745748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745713    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f85fad84-0fe5-4909-8595-d3c9223dcc47" containerName="revoke-keys"
Sep 08 02:26:53.745748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.745720    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy"
Sep 08 02:26:53.750520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.750503    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:53.769974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.769941    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:26:53.770140 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.770012    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:26:53.772195 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.772173    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"]
Sep 08 02:26:53.827458 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.827417    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be683f5e-92c2-408d-a6e3-d1a796fbf954-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f\" (UID: \"be683f5e-92c2-408d-a6e3-d1a796fbf954\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:53.928841 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.928806    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be683f5e-92c2-408d-a6e3-d1a796fbf954-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f\" (UID: \"be683f5e-92c2-408d-a6e3-d1a796fbf954\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:53.929442 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:53.929423    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be683f5e-92c2-408d-a6e3-d1a796fbf954-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f\" (UID: \"be683f5e-92c2-408d-a6e3-d1a796fbf954\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:54.060690 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:54.060659    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:54.197078 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:54.197038    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 02:26:54.197232 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:54.197098    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 02:26:54.331014 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:54.330986    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"]
Sep 08 02:26:54.333223 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:26:54.333192    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe683f5e_92c2_408d_a6e3_d1a796fbf954.slice/crio-f124c9a1f5a5a3b926c10517104608264371a0f5ebf74eaf6e745e44a56a79b0 WatchSource:0}: Error finding container f124c9a1f5a5a3b926c10517104608264371a0f5ebf74eaf6e745e44a56a79b0: Status 404 returned error can't find the container with id f124c9a1f5a5a3b926c10517104608264371a0f5ebf74eaf6e745e44a56a79b0
Sep 08 02:26:54.516845 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:54.516814    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f" event={"ID":"be683f5e-92c2-408d-a6e3-d1a796fbf954","Type":"ContainerStarted","Data":"f124c9a1f5a5a3b926c10517104608264371a0f5ebf74eaf6e745e44a56a79b0"}
Sep 08 02:26:55.524100 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:55.524063    2562 generic.go:356] "Generic (PLEG): container finished" podID="be683f5e-92c2-408d-a6e3-d1a796fbf954" containerID="db265e57bc4d6409e6ecfd117b9153d91aefad671a2770af79c55f7189384197" exitCode=0
Sep 08 02:26:55.524495 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:55.524139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f" event={"ID":"be683f5e-92c2-408d-a6e3-d1a796fbf954","Type":"ContainerDied","Data":"db265e57bc4d6409e6ecfd117b9153d91aefad671a2770af79c55f7189384197"}
Sep 08 02:26:56.659897 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:56.659871    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:56.759501 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:56.759463    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be683f5e-92c2-408d-a6e3-d1a796fbf954-maas-api-service-ca\") pod \"be683f5e-92c2-408d-a6e3-d1a796fbf954\" (UID: \"be683f5e-92c2-408d-a6e3-d1a796fbf954\") "
Sep 08 02:26:56.759832 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:56.759807    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be683f5e-92c2-408d-a6e3-d1a796fbf954-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be683f5e-92c2-408d-a6e3-d1a796fbf954" (UID: "be683f5e-92c2-408d-a6e3-d1a796fbf954"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:26:56.861069 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:56.860975    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be683f5e-92c2-408d-a6e3-d1a796fbf954-maas-api-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:57.537080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:57.537046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f" event={"ID":"be683f5e-92c2-408d-a6e3-d1a796fbf954","Type":"ContainerDied","Data":"f124c9a1f5a5a3b926c10517104608264371a0f5ebf74eaf6e745e44a56a79b0"}
Sep 08 02:26:57.537080 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:57.537082    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"
Sep 08 02:26:57.537267 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:57.537095    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f124c9a1f5a5a3b926c10517104608264371a0f5ebf74eaf6e745e44a56a79b0"
Sep 08 02:26:58.544872 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.544837    2562 generic.go:356] "Generic (PLEG): container finished" podID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerID="5ddae78557ce238935b868414ec404fd30b301b9a1102b5f6a40f6060731fbda" exitCode=0
Sep 08 02:26:58.545274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.544888    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" event={"ID":"371ec2af-9f58-4b3f-8944-7ab15983a743","Type":"ContainerDied","Data":"5ddae78557ce238935b868414ec404fd30b301b9a1102b5f6a40f6060731fbda"}
Sep 08 02:26:58.545274 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.544978    2562 scope.go:117] "RemoveContainer" containerID="0f00d81016e62ca16f18f24cbea886008f37095d2cafa9d70a93e107b143e82e"
Sep 08 02:26:58.607540 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.607463    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:26:58.678745 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678706    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-socket\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.678908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678756    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-certs\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.678908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678775    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-credential-socket\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.678908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678810    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-data\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.678908 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678870    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7j5qd\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-kube-api-access-7j5qd\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.679171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678954    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/371ec2af-9f58-4b3f-8944-7ab15983a743-istiod-ca-cert\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.679171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.678981    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-token\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.679171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679009    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-envoy\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.679171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:58.679171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679030    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-podinfo\") pod \"371ec2af-9f58-4b3f-8944-7ab15983a743\" (UID: \"371ec2af-9f58-4b3f-8944-7ab15983a743\") "
Sep 08 02:26:58.679171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679104    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:58.679483 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679196    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:58.679483 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679273    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/371ec2af-9f58-4b3f-8944-7ab15983a743-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:26:58.679483 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679426    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-data" (OuterVolumeSpecName: "istio-data") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:58.679613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679495    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/371ec2af-9f58-4b3f-8944-7ab15983a743-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.679613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679509    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.679613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679520    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.679613 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.679533    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.681754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.681731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:26:58.681817 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.681750    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-kube-api-access-7j5qd" (OuterVolumeSpecName: "kube-api-access-7j5qd") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "kube-api-access-7j5qd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:26:58.681817 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.681731    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:26:58.681817 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.681767    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-token" (OuterVolumeSpecName: "istio-token") pod "371ec2af-9f58-4b3f-8944-7ab15983a743" (UID: "371ec2af-9f58-4b3f-8944-7ab15983a743"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:26:58.780592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.780561    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.780592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.780589    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j5qd\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-kube-api-access-7j5qd\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.780592 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.780599    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.780828 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.780608    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:58.780828 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:58.780616    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/371ec2af-9f58-4b3f-8944-7ab15983a743-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:26:59.552260 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:59.552231    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"
Sep 08 02:26:59.552694 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:59.552254    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl" event={"ID":"371ec2af-9f58-4b3f-8944-7ab15983a743","Type":"ContainerDied","Data":"58dbf36c79c30da0ce1242190c756dcae6b1c497cb9c80df6e5a97a5bebbcbd8"}
Sep 08 02:26:59.552694 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:59.552312    2562 scope.go:117] "RemoveContainer" containerID="5ddae78557ce238935b868414ec404fd30b301b9a1102b5f6a40f6060731fbda"
Sep 08 02:26:59.570484 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:59.570454    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"]
Sep 08 02:26:59.574469 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:26:59.574446    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-d4845d-openshift-default-6fb5b8d67d-88mpl"]
Sep 08 02:27:01.070718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:01.070684    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" path="/var/lib/kubelet/pods/371ec2af-9f58-4b3f-8944-7ab15983a743/volumes"
Sep 08 02:27:04.228594 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.228550    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:04.329599 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.329569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:04.430555 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.430519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:04.439631 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.439598    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"]
Sep 08 02:27:04.442757 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.442729    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fcdd46-7ck8f"]
Sep 08 02:27:04.530037 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.529942    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:04.827508 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:04.827476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:05.070566 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:05.070531    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be683f5e-92c2-408d-a6e3-d1a796fbf954" path="/var/lib/kubelet/pods/be683f5e-92c2-408d-a6e3-d1a796fbf954/volumes"
Sep 08 02:27:06.932192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:06.932151    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:07.037285 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:07.037219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:07.720748 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:07.720716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:27:10.826948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:10.826902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:10.926795 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:10.926760    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:11.101824 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:11.101730    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:11.665456 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:11.665414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:21.992824 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:21.992789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:22.093702 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:22.093647    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:22.193671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:22.193636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:22.297137 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:22.297106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:22.601711 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:22.601626    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:24.070337 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:24.070307    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:27:29.594342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:29.594240    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:29.673333 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:29.673300    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:29.866156 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:29.866075    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"]
Sep 08 02:27:29.866316 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:29.866293    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" containerID="cri-o://92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20" gracePeriod=30
Sep 08 02:27:29.887073 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:29.887041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:27:34.724386 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:34.724349    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:27:35.122924 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.122886    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:27:35.231323 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231287    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-istio-token\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2741744-7012-4018-a2ec-cebfc906242b-istio-podinfo\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231377    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2741744-7012-4018-a2ec-cebfc906242b-istiod-ca-cert\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231520 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231499    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-credential-socket\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vwhcc\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-kube-api-access-vwhcc\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231599    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-socket\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231641    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-certs\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231666    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-data\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231708    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-envoy\") pod \"b2741744-7012-4018-a2ec-cebfc906242b\" (UID: \"b2741744-7012-4018-a2ec-cebfc906242b\") "
Sep 08 02:27:35.231898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231764    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:27:35.231898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.231799    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2741744-7012-4018-a2ec-cebfc906242b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:27:35.232101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.232003    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:27:35.232101 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.232090    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:27:35.232215 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.232114    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:27:35.232215 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.232133    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2741744-7012-4018-a2ec-cebfc906242b-istiod-ca-cert\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.232215 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.232151    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-credential-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.232215 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.232164    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.233987 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.233950    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 02:27:35.234228 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.234168    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2741744-7012-4018-a2ec-cebfc906242b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 02:27:35.234228 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.234180    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:27:35.234490 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.234455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-kube-api-access-vwhcc" (OuterVolumeSpecName: "kube-api-access-vwhcc") pod "b2741744-7012-4018-a2ec-cebfc906242b" (UID: "b2741744-7012-4018-a2ec-cebfc906242b"). InnerVolumeSpecName "kube-api-access-vwhcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:27:35.333192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.333151    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-istio-token\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.333192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.333187    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2741744-7012-4018-a2ec-cebfc906242b-istio-podinfo\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.333192 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.333196    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vwhcc\" (UniqueName: \"kubernetes.io/projected/b2741744-7012-4018-a2ec-cebfc906242b-kube-api-access-vwhcc\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.333440 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.333207    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-workload-socket\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.333440 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.333225    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-data\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.333440 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.333233    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2741744-7012-4018-a2ec-cebfc906242b-istio-envoy\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:27:35.752091 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.752054    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2741744-7012-4018-a2ec-cebfc906242b" containerID="92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20" exitCode=0
Sep 08 02:27:35.752571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.752099    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" event={"ID":"b2741744-7012-4018-a2ec-cebfc906242b","Type":"ContainerDied","Data":"92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20"}
Sep 08 02:27:35.752571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.752149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" event={"ID":"b2741744-7012-4018-a2ec-cebfc906242b","Type":"ContainerDied","Data":"e4e47883158fe7cdb7863ff7146eb566fba9ee79a15a1e72e5726e2583831fd6"}
Sep 08 02:27:35.752571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.752178    2562 scope.go:117] "RemoveContainer" containerID="92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20"
Sep 08 02:27:35.752571 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.752266    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"
Sep 08 02:27:35.764822 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.764794    2562 scope.go:117] "RemoveContainer" containerID="2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"
Sep 08 02:27:35.775248 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.775225    2562 scope.go:117] "RemoveContainer" containerID="92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20"
Sep 08 02:27:35.775565 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:27:35.775544    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20\": container with ID starting with 92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20 not found: ID does not exist" containerID="92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20"
Sep 08 02:27:35.775666 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.775574    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20"} err="failed to get container status \"92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20\": rpc error: code = NotFound desc = could not find container \"92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20\": container with ID starting with 92354c6bcec906a5a179db35cdccd5abca8738cdda2b2ef3c4c10a68b3cd9e20 not found: ID does not exist"
Sep 08 02:27:35.775666 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.775592    2562 scope.go:117] "RemoveContainer" containerID="2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"
Sep 08 02:27:35.775901 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:27:35.775885    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc\": container with ID starting with 2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc not found: ID does not exist" containerID="2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"
Sep 08 02:27:35.775993 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.775905    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc"} err="failed to get container status \"2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc\": rpc error: code = NotFound desc = could not find container \"2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc\": container with ID starting with 2febde1e8ddf106bc6ac915d3b37aa8c679a80f2184fa975c9a0eae67ae6f5fc not found: ID does not exist"
Sep 08 02:27:35.782605 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.782580    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"]
Sep 08 02:27:35.788202 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:35.788170    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm"]
Sep 08 02:27:36.115567 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:36.115536    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 02:27:36.115751 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:36.115589    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-527ac8-openshift-default-66f59f4498-9s7cm" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.52:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 02:27:37.070530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:27:37.070493    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2741744-7012-4018-a2ec-cebfc906242b" path="/var/lib/kubelet/pods/b2741744-7012-4018-a2ec-cebfc906242b/volumes"
Sep 08 02:28:03.450000 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:28:03.449966    2562 scope.go:117] "RemoveContainer" containerID="00eeaf9b7bfc1b0c225ab94e6dc0b84e5b0ac8a7dcb60872260e44fd353a60de"
Sep 08 02:28:12.182754 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:28:12.182702    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:28:52.881824 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:28:52.881782    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:28:53.162657 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:28:53.162503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:28:53.726734 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:28:53.726694    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:28:55.052515 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:28:55.052417    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:29:03.187171 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:03.187128    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:29:03.190645 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:03.190621    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-27nx6_96fbdf15-dfed-41b3-8589-4de4d76ba9d8/ovn-acl-logging/0.log"
Sep 08 02:29:03.475086 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:03.474985    2562 scope.go:117] "RemoveContainer" containerID="7086fbc3244411f471796c1bf31bb6cd20f69a87c23d52533abd8d68e26ee84a"
Sep 08 02:29:03.484110 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:03.484090    2562 scope.go:117] "RemoveContainer" containerID="b9337ab5f1f31508e00ceac00b5bfb42d4eff128d20524b78055cbb66b9650ff"
Sep 08 02:29:03.492264 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:03.492243    2562 scope.go:117] "RemoveContainer" containerID="7d8f5b211c3b7a8e644d146da423a5bfec2550f5c7aa8f178a700d434e96ffc0"
Sep 08 02:29:18.018025 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:18.017984    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:29:26.041498 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:26.041453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:29:35.954087 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:35.954048    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:29:40.162021 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:40.161984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:29:44.366388 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:44.366355    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:29:57.942307 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:29:57.942265    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:30:00.169963 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.169927    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"]
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170297    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170308    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170329    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170334    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170343    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be683f5e-92c2-408d-a6e3-d1a796fbf954" containerName="revoke-keys"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170349    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="be683f5e-92c2-408d-a6e3-d1a796fbf954" containerName="revoke-keys"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170357    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy"
Sep 08 02:30:00.170356 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170363    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="72691f5e-ce50-4f11-8162-c85b1d912930" containerName="istio-proxy"
Sep 08 02:30:00.170615 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170422    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy"
Sep 08 02:30:00.170615 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170430    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="be683f5e-92c2-408d-a6e3-d1a796fbf954" containerName="revoke-keys"
Sep 08 02:30:00.170615 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170439    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy"
Sep 08 02:30:00.170615 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.170445    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy"
Sep 08 02:30:00.173747 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.173725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"
Sep 08 02:30:00.177155 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.177132    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8mbwc\""
Sep 08 02:30:00.183781 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.183757    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"
Sep 08 02:30:00.187357 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.187039    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"]
Sep 08 02:30:00.460116 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.460043    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"]
Sep 08 02:30:00.462565 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:30:00.462536    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aafffce_00a0_4108_b640_d23d8758b8ca.slice/crio-40d0ada82f41396237221008cf7e2f9248b23a76cbb6d1c2aa4ace3ea615731f WatchSource:0}: Error finding container 40d0ada82f41396237221008cf7e2f9248b23a76cbb6d1c2aa4ace3ea615731f: Status 404 returned error can't find the container with id 40d0ada82f41396237221008cf7e2f9248b23a76cbb6d1c2aa4ace3ea615731f
Sep 08 02:30:00.507686 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:00.507652    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh" event={"ID":"4aafffce-00a0-4108-b640-d23d8758b8ca","Type":"ContainerStarted","Data":"40d0ada82f41396237221008cf7e2f9248b23a76cbb6d1c2aa4ace3ea615731f"}
Sep 08 02:30:01.515003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:01.514949    2562 generic.go:356] "Generic (PLEG): container finished" podID="4aafffce-00a0-4108-b640-d23d8758b8ca" containerID="b6986419087c597f80229e347b4a0356547296386d8da528ca65ade206a86e1f" exitCode=0
Sep 08 02:30:01.515689 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:01.515032    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh" event={"ID":"4aafffce-00a0-4108-b640-d23d8758b8ca","Type":"ContainerDied","Data":"b6986419087c597f80229e347b4a0356547296386d8da528ca65ade206a86e1f"}
Sep 08 02:30:02.658697 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:02.658661    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"
Sep 08 02:30:03.533371 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:03.533273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh" event={"ID":"4aafffce-00a0-4108-b640-d23d8758b8ca","Type":"ContainerDied","Data":"40d0ada82f41396237221008cf7e2f9248b23a76cbb6d1c2aa4ace3ea615731f"}
Sep 08 02:30:03.533371 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:03.533316    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813910-8dxwh"
Sep 08 02:30:03.533562 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:03.533374    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="40d0ada82f41396237221008cf7e2f9248b23a76cbb6d1c2aa4ace3ea615731f"
Sep 08 02:30:04.567998 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:30:04.567964    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:31:30.744717 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:30.744678    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:31:31.017905 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:31.017813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:31:37.714204 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:37.714166    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:31:44.818503 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:44.818466    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:31:51.455794 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:51.455757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:31:53.917246 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:53.917209    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:31:59.957090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:31:59.957055    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:32:00.075313 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:00.075277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:32:00.175594 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:00.175562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:32:03.544490 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:03.544458    2562 scope.go:117] "RemoveContainer" containerID="1b32d3929a90db16c051b8ee6ce3460104c476ee309170f6af6b0b7eb03c1ef3"
Sep 08 02:32:03.552715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:03.552698    2562 scope.go:117] "RemoveContainer" containerID="2b196f261caafe0f0bb901b8987f69ce427154119c77ba46897659a0f16d5635"
Sep 08 02:32:03.721971 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:03.721937    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:32:16.546149 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:16.546110    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:32:17.651145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:17.651109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:32:20.837051 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:20.837009    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:32:29.214060 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:29.214024    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:32:37.518350 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.518314    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:32:37.544465 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544434    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"]
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544867    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544889    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544926    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aafffce-00a0-4108-b640-d23d8758b8ca" containerName="cleanup"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544936    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aafffce-00a0-4108-b640-d23d8758b8ca" containerName="cleanup"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544962    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.544970    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2741744-7012-4018-a2ec-cebfc906242b" containerName="istio-proxy"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.545072    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="371ec2af-9f58-4b3f-8944-7ab15983a743" containerName="istio-proxy"
Sep 08 02:32:37.545291 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.545083    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aafffce-00a0-4108-b640-d23d8758b8ca" containerName="cleanup"
Sep 08 02:32:37.548198 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.548183    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.552226 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.552193    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tfvqz\""
Sep 08 02:32:37.552334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.552244    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 02:32:37.552334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.552255    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 02:32:37.552334 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.552282    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 02:32:37.552478 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.552390    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 02:32:37.558539 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.558518    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"]
Sep 08 02:32:37.643482 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.643452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2trxp\" (UniqueName: \"kubernetes.io/projected/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-kube-api-access-2trxp\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.643623 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.643489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-maas-api-tls\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.643623 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.643549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-metrics-certs\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.643623 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.643610    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-openshift-service-ca\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.744863 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.744831    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-metrics-certs\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.745004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.744879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-openshift-service-ca\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.745004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.744964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2trxp\" (UniqueName: \"kubernetes.io/projected/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-kube-api-access-2trxp\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.745004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.744987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-maas-api-tls\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.745596 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.745565    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-openshift-service-ca\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.747167 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.747145    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-metrics-certs\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.747301 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.747283    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-maas-api-tls\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.752145 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.752128    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2trxp\" (UniqueName: \"kubernetes.io/projected/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-kube-api-access-2trxp\") pod \"maas-api-7df9d55888-rtndh\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") " pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:37.860045 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:37.860019    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:38.128881 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:38.128857    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"]
Sep 08 02:32:38.131318 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:32:38.131290    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48cc17b_eeb1_4ef5_8273_2a964619c1d8.slice/crio-a76c28ba11e1a1d3bf4ccddf1362c7dab051d10b971ea3b552fa316dcda24f32 WatchSource:0}: Error finding container a76c28ba11e1a1d3bf4ccddf1362c7dab051d10b971ea3b552fa316dcda24f32: Status 404 returned error can't find the container with id a76c28ba11e1a1d3bf4ccddf1362c7dab051d10b971ea3b552fa316dcda24f32
Sep 08 02:32:38.132709 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:38.132691    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 02:32:38.326974 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:38.326947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh" event={"ID":"f48cc17b-eeb1-4ef5-8273-2a964619c1d8","Type":"ContainerStarted","Data":"a76c28ba11e1a1d3bf4ccddf1362c7dab051d10b971ea3b552fa316dcda24f32"}
Sep 08 02:32:41.346522 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:41.346484    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh" event={"ID":"f48cc17b-eeb1-4ef5-8273-2a964619c1d8","Type":"ContainerStarted","Data":"0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35"}
Sep 08 02:32:41.346942 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:41.346589    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:41.366318 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:41.366270    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh" podStartSLOduration=1.881039979 podStartE2EDuration="4.366256827s" totalImagesPullingTime="2.485216848s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 02:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:32:41.365304266 +0000 UTC m=+2018.820919198" watchObservedRunningTime="2026-09-08 02:32:41.366256827 +0000 UTC m=+2018.821871739"
Sep 08 02:32:44.819898 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:44.819861    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:32:45.509701 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.509663    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"]
Sep 08 02:32:45.509907 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.509881    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh" podUID="f48cc17b-eeb1-4ef5-8273-2a964619c1d8" containerName="maas-api" containerID="cri-o://0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35" gracePeriod=30
Sep 08 02:32:45.516668 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.516645    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:45.751677 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.751649    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:45.817260 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.817236    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-openshift-service-ca\") pod \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") "
Sep 08 02:32:45.817420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.817279    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2trxp\" (UniqueName: \"kubernetes.io/projected/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-kube-api-access-2trxp\") pod \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") "
Sep 08 02:32:45.817420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.817320    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-metrics-certs\") pod \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") "
Sep 08 02:32:45.817420 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.817380    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-maas-api-tls\") pod \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\" (UID: \"f48cc17b-eeb1-4ef5-8273-2a964619c1d8\") "
Sep 08 02:32:45.817600 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.817573    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f48cc17b-eeb1-4ef5-8273-2a964619c1d8" (UID: "f48cc17b-eeb1-4ef5-8273-2a964619c1d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 02:32:45.817718 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.817703    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-openshift-service-ca\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:32:45.819468 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.819445    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-kube-api-access-2trxp" (OuterVolumeSpecName: "kube-api-access-2trxp") pod "f48cc17b-eeb1-4ef5-8273-2a964619c1d8" (UID: "f48cc17b-eeb1-4ef5-8273-2a964619c1d8"). InnerVolumeSpecName "kube-api-access-2trxp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 02:32:45.819593 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.819497    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f48cc17b-eeb1-4ef5-8273-2a964619c1d8" (UID: "f48cc17b-eeb1-4ef5-8273-2a964619c1d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:32:45.819593 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.819546    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f48cc17b-eeb1-4ef5-8273-2a964619c1d8" (UID: "f48cc17b-eeb1-4ef5-8273-2a964619c1d8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 02:32:45.918449 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.918421    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2trxp\" (UniqueName: \"kubernetes.io/projected/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-kube-api-access-2trxp\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:32:45.918449 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.918447    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-metrics-certs\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:32:45.918783 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:45.918463    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f48cc17b-eeb1-4ef5-8273-2a964619c1d8-maas-api-tls\") on node \"ip-10-0-131-169.ec2.internal\" DevicePath \"\""
Sep 08 02:32:46.371624 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.371590    2562 generic.go:356] "Generic (PLEG): container finished" podID="f48cc17b-eeb1-4ef5-8273-2a964619c1d8" containerID="0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35" exitCode=0
Sep 08 02:32:46.371787 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.371633    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"
Sep 08 02:32:46.371787 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.371661    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh" event={"ID":"f48cc17b-eeb1-4ef5-8273-2a964619c1d8","Type":"ContainerDied","Data":"0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35"}
Sep 08 02:32:46.371787 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.371712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7df9d55888-rtndh" event={"ID":"f48cc17b-eeb1-4ef5-8273-2a964619c1d8","Type":"ContainerDied","Data":"a76c28ba11e1a1d3bf4ccddf1362c7dab051d10b971ea3b552fa316dcda24f32"}
Sep 08 02:32:46.371787 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.371734    2562 scope.go:117] "RemoveContainer" containerID="0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35"
Sep 08 02:32:46.382903 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.382880    2562 scope.go:117] "RemoveContainer" containerID="0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35"
Sep 08 02:32:46.383427 ip-10-0-131-169 kubenswrapper[2562]: E0908 02:32:46.383394    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35\": container with ID starting with 0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35 not found: ID does not exist" containerID="0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35"
Sep 08 02:32:46.383530 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.383438    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35"} err="failed to get container status \"0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35\": rpc error: code = NotFound desc = could not find container \"0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35\": container with ID starting with 0a3063bea0f4cc566d70c4da70f91cde1231289dd2956c3e7828398c67874b35 not found: ID does not exist"
Sep 08 02:32:46.395892 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.395866    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"]
Sep 08 02:32:46.399935 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:46.399886    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7df9d55888-rtndh"]
Sep 08 02:32:47.069543 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:47.069501    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48cc17b-eeb1-4ef5-8273-2a964619c1d8" path="/var/lib/kubelet/pods/f48cc17b-eeb1-4ef5-8273-2a964619c1d8/volumes"
Sep 08 02:32:52.308848 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:32:52.308815    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:33:00.609259 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:00.609221    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:33:03.574322 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:03.574285    2562 scope.go:117] "RemoveContainer" containerID="db265e57bc4d6409e6ecfd117b9153d91aefad671a2770af79c55f7189384197"
Sep 08 02:33:03.582395 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:03.582364    2562 scope.go:117] "RemoveContainer" containerID="acbefaea75c7a9ae6644a4cd9656ae7d58e5202232f9c175948f5b91a2a9afc5"
Sep 08 02:33:07.417758 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:07.417720    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-6q2x6"]
Sep 08 02:33:15.904003 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:15.903965    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-h5csc_b633329d-0fa9-4544-85c7-2f061a4ab0e2/manager/0.log"
Sep 08 02:33:16.251261 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:16.251191    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6566bd6ff-tfv76_f57ef65e-8fc6-4b7d-ab89-666b129073ee/copy-manifests/0.log"
Sep 08 02:33:16.258399 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:16.258371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6566bd6ff-tfv76_f57ef65e-8fc6-4b7d-ab89-666b129073ee/manager/0.log"
Sep 08 02:33:16.907113 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:16.907085    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813910-8dxwh_4aafffce-00a0-4108-b640-d23d8758b8ca/cleanup/0.log"
Sep 08 02:33:18.324222 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:18.324197    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-6q2x6_b8c0f92c-89f5-445a-9d26-38032e2ca16d/limitador/0.log"
Sep 08 02:33:18.776004 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:18.775908    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64_b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95/istio-proxy/0.log"
Sep 08 02:33:18.890946 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:18.890897    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6w5vp_6256e63c-28d4-462d-a128-e574a2a4e814/discovery/0.log"
Sep 08 02:33:19.218454 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:19.218424    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/1.log"
Sep 08 02:33:20.297634 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:20.297607    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68ftns84_a6542bf9-2373-4222-880e-7df50c7b8d23/main/0.log"
Sep 08 02:33:20.405993 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:20.405964    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cm5zp_7939e3e1-76ab-4098-8481-53be5266ddfc/main/0.log"
Sep 08 02:33:25.908971 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:25.908866    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:33:25.990589 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:25.990556    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log" limit=1024
Sep 08 02:33:28.894719 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:28.894664    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-m4v75_81de7c44-fc49-4e80-bdf7-7006f275207c/global-pull-secret-syncer/0.log"
Sep 08 02:33:28.985882 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:28.985845    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bglsd_076a973d-56e0-43e1-8ccd-46dd0ee0422b/konnectivity-agent/0.log"
Sep 08 02:33:29.079750 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:29.079714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-169.ec2.internal_578f76e9e3628a7f638f2eba0229db4a/haproxy/0.log"
Sep 08 02:33:33.450867 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:33.450843    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-6q2x6_b8c0f92c-89f5-445a-9d26-38032e2ca16d/limitador/0.log"
Sep 08 02:33:35.132534 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.132494    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/alertmanager/0.log"
Sep 08 02:33:35.164233 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.164198    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/config-reloader/0.log"
Sep 08 02:33:35.198294 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.198264    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/kube-rbac-proxy-web/0.log"
Sep 08 02:33:35.232441 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.232411    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/kube-rbac-proxy/0.log"
Sep 08 02:33:35.259558 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.259531    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/kube-rbac-proxy-metric/0.log"
Sep 08 02:33:35.285342 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.285319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/prom-label-proxy/0.log"
Sep 08 02:33:35.316049 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.316016    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_4ee87030-aa19-489e-bcae-d0c31f54866d/init-config-reloader/0.log"
Sep 08 02:33:35.426663 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.426628    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-jztz4_4f2e0641-99e2-4811-989b-f0bca295fb8f/kube-state-metrics/0.log"
Sep 08 02:33:35.455843 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.455809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-jztz4_4f2e0641-99e2-4811-989b-f0bca295fb8f/kube-rbac-proxy-main/0.log"
Sep 08 02:33:35.487715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.487684    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-jztz4_4f2e0641-99e2-4811-989b-f0bca295fb8f/kube-rbac-proxy-self/0.log"
Sep 08 02:33:35.529602 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.529574    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-f9d4b48d4-mmjsl_aa31503d-8f05-4ae5-b75a-bf271e6bdc8b/metrics-server/0.log"
Sep 08 02:33:35.564175 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.564140    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-7qwpw_64045453-d2bc-46b9-b3f8-225d4405ce67/monitoring-plugin/0.log"
Sep 08 02:33:35.743720 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.743691    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wczcg_78be9256-7099-4c0b-aa69-e4ca02bd1523/node-exporter/0.log"
Sep 08 02:33:35.766773 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.766739    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wczcg_78be9256-7099-4c0b-aa69-e4ca02bd1523/kube-rbac-proxy/0.log"
Sep 08 02:33:35.792959 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.792935    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wczcg_78be9256-7099-4c0b-aa69-e4ca02bd1523/init-textfile/0.log"
Sep 08 02:33:35.963295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:35.963266    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-h22dm_3717c5aa-0b56-47dd-9f69-0a126aed8923/kube-rbac-proxy-main/0.log"
Sep 08 02:33:36.001295 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.001258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-h22dm_3717c5aa-0b56-47dd-9f69-0a126aed8923/kube-rbac-proxy-self/0.log"
Sep 08 02:33:36.033764 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.033722    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-h22dm_3717c5aa-0b56-47dd-9f69-0a126aed8923/openshift-state-metrics/0.log"
Sep 08 02:33:36.089741 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.089714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/prometheus/0.log"
Sep 08 02:33:36.126126 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.126099    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/config-reloader/0.log"
Sep 08 02:33:36.155756 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.155726    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/thanos-sidecar/0.log"
Sep 08 02:33:36.179841 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.179810    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/kube-rbac-proxy-web/0.log"
Sep 08 02:33:36.215007 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.214979    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/kube-rbac-proxy/0.log"
Sep 08 02:33:36.259937 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.259884    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/kube-rbac-proxy-thanos/0.log"
Sep 08 02:33:36.298133 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.298106    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4ae59988-d270-4db1-b353-1f295138e46f/init-config-reloader/0.log"
Sep 08 02:33:36.332561 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.332527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-6vslf_915506d2-c6a8-4b4e-8c33-3eea19ed1bf9/prometheus-operator/0.log"
Sep 08 02:33:36.356139 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.356104    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-6vslf_915506d2-c6a8-4b4e-8c33-3eea19ed1bf9/kube-rbac-proxy/0.log"
Sep 08 02:33:36.391578 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.391551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-kkslp_7ecce13b-13d1-444d-a1c2-1efebb93051a/prometheus-operator-admission-webhook/0.log"
Sep 08 02:33:36.528671 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.528644    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fbbc6bc4-rqdqf_304c572b-23e4-4c83-91bc-cb2e423eaabb/thanos-query/0.log"
Sep 08 02:33:36.554793 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.554763    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fbbc6bc4-rqdqf_304c572b-23e4-4c83-91bc-cb2e423eaabb/kube-rbac-proxy-web/0.log"
Sep 08 02:33:36.578577 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.578551    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fbbc6bc4-rqdqf_304c572b-23e4-4c83-91bc-cb2e423eaabb/kube-rbac-proxy/0.log"
Sep 08 02:33:36.605894 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.605865    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fbbc6bc4-rqdqf_304c572b-23e4-4c83-91bc-cb2e423eaabb/prom-label-proxy/0.log"
Sep 08 02:33:36.636099 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.636064    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fbbc6bc4-rqdqf_304c572b-23e4-4c83-91bc-cb2e423eaabb/kube-rbac-proxy-rules/0.log"
Sep 08 02:33:36.660796 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:36.660756    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-58fbbc6bc4-rqdqf_304c572b-23e4-4c83-91bc-cb2e423eaabb/kube-rbac-proxy-metrics/0.log"
Sep 08 02:33:38.838482 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.838448    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"]
Sep 08 02:33:38.838948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.838876    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48cc17b-eeb1-4ef5-8273-2a964619c1d8" containerName="maas-api"
Sep 08 02:33:38.838948 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.838889    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48cc17b-eeb1-4ef5-8273-2a964619c1d8" containerName="maas-api"
Sep 08 02:33:38.839095 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.839014    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f48cc17b-eeb1-4ef5-8273-2a964619c1d8" containerName="maas-api"
Sep 08 02:33:38.842206 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.842186    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.845494 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.845468    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86shj\"/\"kube-root-ca.crt\""
Sep 08 02:33:38.846357 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.846335    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-86shj\"/\"default-dockercfg-5vlsl\""
Sep 08 02:33:38.846357 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.846351    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86shj\"/\"openshift-service-ca.crt\""
Sep 08 02:33:38.857348 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.857321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"]
Sep 08 02:33:38.890354 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.890322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-sys\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.890546 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.890387    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-podres\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.890546 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.890489    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddq98\" (UniqueName: \"kubernetes.io/projected/82914fd1-bb4d-4f2d-a82f-6632497905b0-kube-api-access-ddq98\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.890546 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.890510    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-lib-modules\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.890546 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.890534    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-proc\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.991928 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.991885    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-podres\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddq98\" (UniqueName: \"kubernetes.io/projected/82914fd1-bb4d-4f2d-a82f-6632497905b0-kube-api-access-ddq98\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-lib-modules\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-proc\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992070    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-podres\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992119 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-sys\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992129    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-proc\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992212    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-sys\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:38.992381 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:38.992217    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/82914fd1-bb4d-4f2d-a82f-6632497905b0-lib-modules\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:39.000803 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.000776    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddq98\" (UniqueName: \"kubernetes.io/projected/82914fd1-bb4d-4f2d-a82f-6632497905b0-kube-api-access-ddq98\") pod \"perf-node-gather-daemonset-hfjj2\" (UID: \"82914fd1-bb4d-4f2d-a82f-6632497905b0\") " pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:39.152640 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.152546    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:39.425767 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.425743    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"]
Sep 08 02:33:39.427016 ip-10-0-131-169 kubenswrapper[2562]: W0908 02:33:39.426988    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod82914fd1_bb4d_4f2d_a82f_6632497905b0.slice/crio-91850b16ecfa8936e3822b099de3aa9ab4df389cfd7ccca60f27f18b6ab4520b WatchSource:0}: Error finding container 91850b16ecfa8936e3822b099de3aa9ab4df389cfd7ccca60f27f18b6ab4520b: Status 404 returned error can't find the container with id 91850b16ecfa8936e3822b099de3aa9ab4df389cfd7ccca60f27f18b6ab4520b
Sep 08 02:33:39.641024 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.640986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2" event={"ID":"82914fd1-bb4d-4f2d-a82f-6632497905b0","Type":"ContainerStarted","Data":"d44e97bc96d265f17845723b6e8e60379a09202689456b0f4799e67c48fc7305"}
Sep 08 02:33:39.641184 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.641035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2" event={"ID":"82914fd1-bb4d-4f2d-a82f-6632497905b0","Type":"ContainerStarted","Data":"91850b16ecfa8936e3822b099de3aa9ab4df389cfd7ccca60f27f18b6ab4520b"}
Sep 08 02:33:39.641184 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.641098    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:39.660991 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:39.660927    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2" podStartSLOduration=1.660900236 podStartE2EDuration="1.660900236s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 02:33:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 02:33:39.658581521 +0000 UTC m=+2077.114196465" watchObservedRunningTime="2026-09-08 02:33:39.660900236 +0000 UTC m=+2077.116515148"
Sep 08 02:33:41.237903 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:41.237871    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2zl9_4424d2a4-36b2-4cb0-b11d-d045ba315048/dns/0.log"
Sep 08 02:33:41.277173 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:41.277146    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w2zl9_4424d2a4-36b2-4cb0-b11d-d045ba315048/kube-rbac-proxy/0.log"
Sep 08 02:33:41.415090 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:41.415062    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-swc6x_689f935b-6e31-4f84-9c72-a9334097564f/dns-node-resolver/0.log"
Sep 08 02:33:41.954037 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:41.954004    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dtxzg_a29481b6-14dc-4758-86ac-8432c48f1a9e/node-ca/0.log"
Sep 08 02:33:42.925005 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:42.924973    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64_b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95/istio-proxy/0.log"
Sep 08 02:33:43.451309 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:43.451277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6w5vp_6256e63c-28d4-462d-a128-e574a2a4e814/discovery/0.log"
Sep 08 02:33:43.528266 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:43.528227    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/0.log"
Sep 08 02:33:43.547338 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:43.547305    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/1.log"
Sep 08 02:33:44.530082 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:44.530049    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fb2vg_4a8ad92c-d83c-40c3-9956-5ab6b508ad53/serve-healthcheck-canary/0.log"
Sep 08 02:33:45.150361 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:45.150334    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbcq5_6e3bf649-b208-419c-94a1-63c780dd8dab/kube-rbac-proxy/0.log"
Sep 08 02:33:45.175385 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:45.175357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbcq5_6e3bf649-b208-419c-94a1-63c780dd8dab/exporter/0.log"
Sep 08 02:33:45.201516 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:45.201483    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fbcq5_6e3bf649-b208-419c-94a1-63c780dd8dab/extractor/0.log"
Sep 08 02:33:45.655866 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:45.655841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-86shj/perf-node-gather-daemonset-hfjj2"
Sep 08 02:33:48.278331 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:48.278290    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-h5csc_b633329d-0fa9-4544-85c7-2f061a4ab0e2/manager/0.log"
Sep 08 02:33:48.480168 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:48.480073    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6566bd6ff-tfv76_f57ef65e-8fc6-4b7d-ab89-666b129073ee/manager/0.log"
Sep 08 02:33:48.505929 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:48.505897    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6566bd6ff-tfv76_f57ef65e-8fc6-4b7d-ab89-666b129073ee/copy-manifests/0.log"
Sep 08 02:33:49.341039 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:49.341009    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64_b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95/istio-proxy/0.log"
Sep 08 02:33:49.788727 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:49.788694    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5777c545f5-4mrjn_c08fca8b-15d2-4bb2-8f23-ecd5cb8cdd98/manager/0.log"
Sep 08 02:33:49.854715 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:49.854684    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wq682_0daa8dff-8796-4757-9fdf-688c00327bb3/openshift-lws-operator/0.log"
Sep 08 02:33:49.884960 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:49.884901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6w5vp_6256e63c-28d4-462d-a128-e574a2a4e814/discovery/0.log"
Sep 08 02:33:49.939967 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:49.939936    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/0.log"
Sep 08 02:33:49.957636 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:49.957599    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/1.log"
Sep 08 02:33:51.559850 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:51.559807    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-lpz64_b73b4d0e-f7d0-4502-a5ba-4a30aa11ff95/istio-proxy/0.log"
Sep 08 02:33:52.112819 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:52.112788    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-6w5vp_6256e63c-28d4-462d-a128-e574a2a4e814/discovery/0.log"
Sep 08 02:33:52.176876 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:52.176834    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/0.log"
Sep 08 02:33:52.194827 ip-10-0-131-169 kubenswrapper[2562]: I0908 02:33:52.194789    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-wz4nb_ea9e7152-e1e9-4c84-9b39-a045f055fc02/istio-proxy/1.log"